2025-01-03T04:44:29,694 Created temporary directory: /tmp/pip-build-tracker-8k1wcg4v 2025-01-03T04:44:29,695 Initialized build tracking at /tmp/pip-build-tracker-8k1wcg4v 2025-01-03T04:44:29,696 Created build tracker: /tmp/pip-build-tracker-8k1wcg4v 2025-01-03T04:44:29,696 Entered build tracker: /tmp/pip-build-tracker-8k1wcg4v 2025-01-03T04:44:29,697 Created temporary directory: /tmp/pip-wheel-jsclqeyo 2025-01-03T04:44:29,701 Created temporary directory: /tmp/pip-ephem-wheel-cache-q_7j7mqi 2025-01-03T04:44:29,745 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-01-03T04:44:29,748 2 location(s) to search for versions of colossalai: 2025-01-03T04:44:29,748 * https://pypi.org/simple/colossalai/ 2025-01-03T04:44:29,748 * https://www.piwheels.org/simple/colossalai/ 2025-01-03T04:44:29,748 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2025-01-03T04:44:29,749 Getting page https://pypi.org/simple/colossalai/ 2025-01-03T04:44:29,751 Found index url https://pypi.org/simple/ 2025-01-03T04:44:29,973 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2025-01-03T04:44:29,979 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2025-01-03T04:44:29,980 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2025-01-03T04:44:29,981 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2025-01-03T04:44:29,982 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2025-01-03T04:44:29,983 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2025-01-03T04:44:29,984 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2025-01-03T04:44:29,985 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2025-01-03T04:44:29,986 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2025-01-03T04:44:29,987 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2025-01-03T04:44:29,987 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2025-01-03T04:44:29,988 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2025-01-03T04:44:29,989 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2025-01-03T04:44:29,990 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2025-01-03T04:44:29,991 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2025-01-03T04:44:29,992 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2025-01-03T04:44:29,993 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2025-01-03T04:44:29,994 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2025-01-03T04:44:29,995 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2025-01-03T04:44:29,995 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2025-01-03T04:44:29,996 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2025-01-03T04:44:29,997 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2025-01-03T04:44:29,998 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2025-01-03T04:44:29,999 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2025-01-03T04:44:30,000 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2025-01-03T04:44:30,001 Found link https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.5 2025-01-03T04:44:30,002 Found link https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.6 2025-01-03T04:44:30,002 Found link https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.7 2025-01-03T04:44:30,003 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2025-01-03T04:44:30,004 Getting page https://www.piwheels.org/simple/colossalai/ 2025-01-03T04:44:30,005 Found index url https://www.piwheels.org/simple/ 2025-01-03T04:44:30,170 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2025-01-03T04:44:30,178 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.6-py3-none-any.whl#sha256=ce3ac15dc7fb8d7f59a20837e206ffc2cfb5a8c4b716a00905cf50687aa8676b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,179 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.5-py3-none-any.whl#sha256=f94d4dad77d236b0cc6ea08c8a0016d2cd518bc546095a9e65c47fe4486cacfb (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,179 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.4-py3-none-any.whl#sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,179 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,180 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,180 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,181 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,182 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,182 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,183 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,183 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,184 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,184 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,185 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,185 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,186 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,187 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,187 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,187 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,188 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,189 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,189 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,190 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,190 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,191 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,191 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-01-03T04:44:30,192 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2025-01-03T04:44:30,192 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2025-01-03T04:44:30,213 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2025-01-03T04:44:30,215 Collecting colossalai==0.4.7 2025-01-03T04:44:30,218 Created temporary directory: /tmp/pip-unpack-yjokjk8d 2025-01-03T04:44:30,434 Downloading colossalai-0.4.7.tar.gz (1.4 MB) 2025-01-03T04:44:32,980 Added colossalai==0.4.7 from https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz to build tracker '/tmp/pip-build-tracker-8k1wcg4v' 2025-01-03T04:44:32,981 Running setup.py (path:/tmp/pip-wheel-jsclqeyo/colossalai_6b45e530ff4746b4a40499f544d0bfac/setup.py) egg_info for package colossalai 2025-01-03T04:44:32,982 Created temporary directory: /tmp/pip-pip-egg-info-vdptqfwm 2025-01-03T04:44:32,983 Preparing metadata (setup.py): started 2025-01-03T04:44:32,984 Running command python setup.py egg_info 2025-01-03T04:44:34,187 running egg_info 2025-01-03T04:44:34,216 creating /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info 2025-01-03T04:44:34,218 writing /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/PKG-INFO 2025-01-03T04:44:34,222 writing dependency_links to /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/dependency_links.txt 2025-01-03T04:44:34,224 writing entry points to /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/entry_points.txt 2025-01-03T04:44:34,226 writing requirements to /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/requires.txt 2025-01-03T04:44:34,227 writing top-level names to /tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/top_level.txt 2025-01-03T04:44:34,228 writing manifest file '/tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/SOURCES.txt' 2025-01-03T04:44:34,540 reading manifest file '/tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/SOURCES.txt' 2025-01-03T04:44:34,542 reading manifest template 'MANIFEST.in' 2025-01-03T04:44:36,308 warning: no files found matching '*.tr' under directory 'colossalai' 2025-01-03T04:44:37,044 warning: no files found matching '*.cc' under directory 'colossalai' 2025-01-03T04:44:37,375 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-01-03T04:44:37,524 warning: no files found matching '*.tr' under directory 'extensions' 2025-01-03T04:44:37,583 warning: no files found matching '*.cc' under directory 'extensions' 2025-01-03T04:44:37,614 warning: no files found matching '*.pyi' under directory 'extensions' 2025-01-03T04:44:37,614 adding license file 'LICENSE' 2025-01-03T04:44:37,649 writing manifest file '/tmp/pip-pip-egg-info-vdptqfwm/colossalai.egg-info/SOURCES.txt' 2025-01-03T04:44:37,759 Preparing metadata (setup.py): finished with status 'done' 2025-01-03T04:44:37,766 Source in /tmp/pip-wheel-jsclqeyo/colossalai_6b45e530ff4746b4a40499f544d0bfac has version 0.4.7, which satisfies requirement colossalai==0.4.7 from https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz 2025-01-03T04:44:37,767 Removed colossalai==0.4.7 from https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz from build tracker '/tmp/pip-build-tracker-8k1wcg4v' 2025-01-03T04:44:37,779 Created temporary directory: /tmp/pip-unpack-taj4o3do 2025-01-03T04:44:37,781 Created temporary directory: /tmp/pip-unpack-89tw4821 2025-01-03T04:44:37,781 Building wheels for collected packages: colossalai 2025-01-03T04:44:37,797 Created temporary directory: /tmp/pip-wheel-o6ulihrg 2025-01-03T04:44:37,798 Building wheel for colossalai (setup.py): started 2025-01-03T04:44:37,799 Destination directory: /tmp/pip-wheel-o6ulihrg 2025-01-03T04:44:37,800 Running command python setup.py bdist_wheel 2025-01-03T04:44:38,903 running bdist_wheel 2025-01-03T04:44:39,047 running build 2025-01-03T04:44:39,048 running build_py 2025-01-03T04:44:39,080 creating build/lib/colossalai 2025-01-03T04:44:39,083 copying colossalai/version.py -> build/lib/colossalai 2025-01-03T04:44:39,086 copying colossalai/initialize.py -> build/lib/colossalai 2025-01-03T04:44:39,088 copying colossalai/__init__.py -> build/lib/colossalai 2025-01-03T04:44:39,091 creating build/lib/colossalai/lazy 2025-01-03T04:44:39,092 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2025-01-03T04:44:39,095 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2025-01-03T04:44:39,097 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2025-01-03T04:44:39,099 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2025-01-03T04:44:39,102 creating build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,103 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,105 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,108 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,110 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,114 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,116 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,118 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-01-03T04:44:39,121 creating build/lib/colossalai/auto_parallel 2025-01-03T04:44:39,123 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2025-01-03T04:44:39,126 creating build/lib/colossalai/kernel 2025-01-03T04:44:39,127 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2025-01-03T04:44:39,129 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2025-01-03T04:44:39,131 creating build/lib/colossalai/inference 2025-01-03T04:44:39,132 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,135 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,137 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,140 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,142 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,144 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,147 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,150 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,151 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2025-01-03T04:44:39,154 creating build/lib/colossalai/pipeline 2025-01-03T04:44:39,155 copying colossalai/pipeline/weight_grad_store.py -> build/lib/colossalai/pipeline 2025-01-03T04:44:39,158 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2025-01-03T04:44:39,163 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2025-01-03T04:44:39,167 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2025-01-03T04:44:39,170 creating build/lib/colossalai/zero 2025-01-03T04:44:39,171 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2025-01-03T04:44:39,174 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2025-01-03T04:44:39,176 creating build/lib/colossalai/interface 2025-01-03T04:44:39,177 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2025-01-03T04:44:39,179 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2025-01-03T04:44:39,181 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2025-01-03T04:44:39,183 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2025-01-03T04:44:39,185 creating build/lib/colossalai/logging 2025-01-03T04:44:39,186 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2025-01-03T04:44:39,188 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2025-01-03T04:44:39,191 creating build/lib/colossalai/nn 2025-01-03T04:44:39,192 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2025-01-03T04:44:39,195 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2025-01-03T04:44:39,198 creating build/lib/colossalai/cluster 2025-01-03T04:44:39,199 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2025-01-03T04:44:39,202 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2025-01-03T04:44:39,204 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2025-01-03T04:44:39,206 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2025-01-03T04:44:39,208 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2025-01-03T04:44:39,210 creating build/lib/colossalai/cli 2025-01-03T04:44:39,211 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2025-01-03T04:44:39,214 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2025-01-03T04:44:39,216 creating build/lib/colossalai/quantization 2025-01-03T04:44:39,217 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,219 copying colossalai/quantization/fp8_config.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,221 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,223 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,226 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,228 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,230 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2025-01-03T04:44:39,232 creating build/lib/colossalai/utils 2025-01-03T04:44:39,233 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2025-01-03T04:44:39,236 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2025-01-03T04:44:39,239 copying colossalai/utils/safetensors.py -> build/lib/colossalai/utils 2025-01-03T04:44:39,243 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2025-01-03T04:44:39,245 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2025-01-03T04:44:39,249 creating build/lib/colossalai/legacy 2025-01-03T04:44:39,250 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2025-01-03T04:44:39,253 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2025-01-03T04:44:39,256 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2025-01-03T04:44:39,258 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2025-01-03T04:44:39,259 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2025-01-03T04:44:39,262 creating build/lib/colossalai/booster 2025-01-03T04:44:39,263 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2025-01-03T04:44:39,266 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2025-01-03T04:44:39,269 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2025-01-03T04:44:39,271 creating build/lib/colossalai/moe 2025-01-03T04:44:39,273 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2025-01-03T04:44:39,276 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2025-01-03T04:44:39,280 creating build/lib/colossalai/fx 2025-01-03T04:44:39,281 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,284 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,286 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,289 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,291 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,293 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2025-01-03T04:44:39,295 creating build/lib/colossalai/testing 2025-01-03T04:44:39,296 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2025-01-03T04:44:39,299 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2025-01-03T04:44:39,300 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2025-01-03T04:44:39,302 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2025-01-03T04:44:39,305 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2025-01-03T04:44:39,308 creating build/lib/colossalai/context 2025-01-03T04:44:39,310 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2025-01-03T04:44:39,312 copying colossalai/context/config.py -> build/lib/colossalai/context 2025-01-03T04:44:39,315 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2025-01-03T04:44:39,318 creating build/lib/colossalai/accelerator 2025-01-03T04:44:39,320 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,324 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,326 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,329 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,331 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,334 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2025-01-03T04:44:39,337 creating build/lib/colossalai/_analyzer 2025-01-03T04:44:39,338 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2025-01-03T04:44:39,340 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2025-01-03T04:44:39,343 creating build/lib/colossalai/device 2025-01-03T04:44:39,344 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2025-01-03T04:44:39,347 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2025-01-03T04:44:39,350 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2025-01-03T04:44:39,352 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2025-01-03T04:44:39,355 creating build/lib/colossalai/amp 2025-01-03T04:44:39,356 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2025-01-03T04:44:39,359 creating build/lib/colossalai/shardformer 2025-01-03T04:44:39,360 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2025-01-03T04:44:39,363 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2025-01-03T04:44:39,366 creating build/lib/colossalai/tensor 2025-01-03T04:44:39,367 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,370 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,373 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,376 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,378 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,381 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,384 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,386 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2025-01-03T04:44:39,389 creating build/lib/colossalai/_C 2025-01-03T04:44:39,390 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2025-01-03T04:44:39,393 creating build/lib/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:39,394 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:39,396 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:39,398 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:39,400 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:39,402 creating build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,403 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,406 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,408 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,410 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,412 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,414 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:39,416 creating build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,417 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,420 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,422 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,424 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,426 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:39,428 creating build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,430 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,432 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,434 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,437 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,439 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,441 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2025-01-03T04:44:39,443 creating build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,444 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,446 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,449 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,451 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,453 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,455 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,458 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,459 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,461 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,464 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2025-01-03T04:44:39,466 creating build/lib/colossalai/auto_parallel/pipeline_shard 2025-01-03T04:44:39,467 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2025-01-03T04:44:39,470 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,471 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,473 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,475 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,477 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,479 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,482 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,485 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,486 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,488 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,490 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,492 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:39,495 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,496 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,499 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,501 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,503 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,506 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,508 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,510 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,512 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,514 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,515 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,518 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,520 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,522 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,524 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,526 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,527 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,530 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,531 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,534 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,535 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,538 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,540 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,542 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,544 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,546 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,547 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,549 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:39,552 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,553 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,556 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,558 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,560 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,563 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,565 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:39,567 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,568 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,571 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,573 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,576 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,579 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:39,582 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,584 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,587 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,590 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,592 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,595 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,598 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,600 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,603 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,607 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,610 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,612 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,616 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,619 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,621 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,624 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,627 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,630 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,632 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,635 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:39,639 creating build/lib/colossalai/kernel/jit 2025-01-03T04:44:39,640 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2025-01-03T04:44:39,643 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2025-01-03T04:44:39,645 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2025-01-03T04:44:39,647 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2025-01-03T04:44:39,650 creating build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,652 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,655 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,658 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,661 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,664 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,668 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,671 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,673 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,676 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,678 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,680 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-01-03T04:44:39,684 creating build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,685 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,688 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,691 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,693 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,695 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,697 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2025-01-03T04:44:39,700 creating build/lib/colossalai/kernel/extensions/csrc 2025-01-03T04:44:39,701 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2025-01-03T04:44:39,704 creating build/lib/colossalai/kernel/extensions/pybind 2025-01-03T04:44:39,705 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2025-01-03T04:44:39,708 creating build/lib/colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:39,709 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:39,711 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:39,714 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:39,716 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:39,718 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:39,721 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:39,723 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:39,725 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:39,727 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:39,730 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:39,731 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:39,734 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:39,736 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:39,738 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:39,740 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:39,742 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:39,744 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:39,747 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:39,749 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:39,750 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:39,753 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:39,755 creating build/lib/colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:39,756 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:39,758 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:39,761 creating build/lib/colossalai/inference/executor 2025-01-03T04:44:39,762 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2025-01-03T04:44:39,765 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2025-01-03T04:44:39,768 creating build/lib/colossalai/inference/modeling 2025-01-03T04:44:39,769 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2025-01-03T04:44:39,772 creating build/lib/colossalai/inference/server 2025-01-03T04:44:39,773 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2025-01-03T04:44:39,776 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2025-01-03T04:44:39,778 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2025-01-03T04:44:39,781 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2025-01-03T04:44:39,784 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2025-01-03T04:44:39,787 creating build/lib/colossalai/inference/core 2025-01-03T04:44:39,788 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,791 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,793 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,795 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,798 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,803 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,805 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,808 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,810 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2025-01-03T04:44:39,814 creating build/lib/colossalai/inference/kv_cache 2025-01-03T04:44:39,815 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2025-01-03T04:44:39,818 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2025-01-03T04:44:39,820 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2025-01-03T04:44:39,823 creating build/lib/colossalai/inference/spec 2025-01-03T04:44:39,824 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2025-01-03T04:44:39,827 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2025-01-03T04:44:39,829 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2025-01-03T04:44:39,832 creating build/lib/colossalai/inference/modeling/backends 2025-01-03T04:44:39,833 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-01-03T04:44:39,836 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-01-03T04:44:39,839 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2025-01-03T04:44:39,842 creating build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,843 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,846 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,849 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,852 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,854 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,856 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2025-01-03T04:44:39,860 creating build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,861 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,864 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,867 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,869 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,871 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,874 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2025-01-03T04:44:39,877 creating build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,878 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,881 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,884 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,886 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,888 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2025-01-03T04:44:39,891 creating build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,893 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,895 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,898 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,900 copying colossalai/pipeline/schedule/zero_bubble_pp.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,903 copying colossalai/pipeline/schedule/v_schedule.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,906 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,909 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,912 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2025-01-03T04:44:39,915 creating build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,917 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,920 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,923 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,926 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,929 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,932 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,935 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2025-01-03T04:44:39,938 creating build/lib/colossalai/zero/low_level 2025-01-03T04:44:39,939 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2025-01-03T04:44:39,943 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2025-01-03T04:44:39,945 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2025-01-03T04:44:39,948 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2025-01-03T04:44:39,951 creating build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,952 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,955 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,957 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,959 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,961 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,964 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,966 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,968 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,970 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:39,974 creating build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,975 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,978 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,981 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,983 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,986 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2025-01-03T04:44:39,988 creating build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:39,990 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:39,992 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:39,994 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:39,996 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:39,999 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:40,002 creating build/lib/colossalai/nn/layer 2025-01-03T04:44:40,003 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2025-01-03T04:44:40,005 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2025-01-03T04:44:40,007 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2025-01-03T04:44:40,010 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2025-01-03T04:44:40,013 creating build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,014 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,017 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,019 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,022 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,025 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,027 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,030 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,032 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2025-01-03T04:44:40,035 creating build/lib/colossalai/nn/loss 2025-01-03T04:44:40,036 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2025-01-03T04:44:40,039 creating build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,041 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,044 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,047 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,051 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,053 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,056 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,059 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,061 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,063 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,066 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,068 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,070 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,072 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,076 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,078 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,080 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2025-01-03T04:44:40,082 creating build/lib/colossalai/cli/launcher 2025-01-03T04:44:40,084 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2025-01-03T04:44:40,086 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2025-01-03T04:44:40,088 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2025-01-03T04:44:40,090 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2025-01-03T04:44:40,093 creating build/lib/colossalai/cli/check 2025-01-03T04:44:40,094 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2025-01-03T04:44:40,096 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2025-01-03T04:44:40,098 creating build/lib/colossalai/utils/tensor_detector 2025-01-03T04:44:40,099 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2025-01-03T04:44:40,102 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2025-01-03T04:44:40,104 creating build/lib/colossalai/utils/multi_tensor_apply 2025-01-03T04:44:40,106 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-01-03T04:44:40,107 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-01-03T04:44:40,110 creating build/lib/colossalai/utils/model 2025-01-03T04:44:40,111 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2025-01-03T04:44:40,113 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2025-01-03T04:44:40,115 creating build/lib/colossalai/utils/rank_recorder 2025-01-03T04:44:40,116 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2025-01-03T04:44:40,118 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2025-01-03T04:44:40,121 creating build/lib/colossalai/legacy/inference 2025-01-03T04:44:40,122 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2025-01-03T04:44:40,125 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2025-01-03T04:44:40,127 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2025-01-03T04:44:40,130 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2025-01-03T04:44:40,132 creating build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,134 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,136 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,138 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,140 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,143 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2025-01-03T04:44:40,145 creating build/lib/colossalai/legacy/zero 2025-01-03T04:44:40,146 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2025-01-03T04:44:40,148 creating build/lib/colossalai/legacy/nn 2025-01-03T04:44:40,149 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2025-01-03T04:44:40,152 creating build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,153 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,155 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,157 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,159 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,162 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2025-01-03T04:44:40,164 creating build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,165 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,167 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,169 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,171 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,174 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,176 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2025-01-03T04:44:40,179 creating build/lib/colossalai/legacy/engine 2025-01-03T04:44:40,180 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2025-01-03T04:44:40,182 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2025-01-03T04:44:40,185 creating build/lib/colossalai/legacy/context 2025-01-03T04:44:40,186 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2025-01-03T04:44:40,189 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2025-01-03T04:44:40,191 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2025-01-03T04:44:40,193 creating build/lib/colossalai/legacy/registry 2025-01-03T04:44:40,194 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2025-01-03T04:44:40,196 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2025-01-03T04:44:40,199 creating build/lib/colossalai/legacy/builder 2025-01-03T04:44:40,200 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2025-01-03T04:44:40,202 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2025-01-03T04:44:40,204 creating build/lib/colossalai/legacy/trainer 2025-01-03T04:44:40,205 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2025-01-03T04:44:40,208 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2025-01-03T04:44:40,210 creating build/lib/colossalai/legacy/amp 2025-01-03T04:44:40,211 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2025-01-03T04:44:40,213 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2025-01-03T04:44:40,216 creating build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,217 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,219 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,221 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,223 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,225 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,226 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,229 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,231 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2025-01-03T04:44:40,233 creating build/lib/colossalai/legacy/inference/hybridengine 2025-01-03T04:44:40,234 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-01-03T04:44:40,237 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-01-03T04:44:40,239 creating build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,241 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,243 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,245 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,247 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,249 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,252 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,254 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,255 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,258 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:40,260 creating build/lib/colossalai/legacy/inference/pipeline 2025-01-03T04:44:40,261 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2025-01-03T04:44:40,264 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2025-01-03T04:44:40,266 creating build/lib/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:40,267 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:40,270 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:40,273 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:40,275 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:40,277 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:40,278 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:40,281 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:40,283 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:40,286 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:40,287 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:40,289 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:40,292 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,293 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,296 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,298 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,300 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,303 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:40,306 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:40,307 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:40,309 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:40,311 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:40,314 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:40,316 creating build/lib/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:40,317 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:40,321 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:40,323 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:40,326 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:40,328 creating build/lib/colossalai/legacy/pipeline/middleware 2025-01-03T04:44:40,330 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-01-03T04:44:40,332 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-01-03T04:44:40,335 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:40,336 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:40,338 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:40,341 creating build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,342 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,344 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,347 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,349 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,351 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,354 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,355 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2025-01-03T04:44:40,358 creating build/lib/colossalai/legacy/zero/init_ctx 2025-01-03T04:44:40,359 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-01-03T04:44:40,361 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-01-03T04:44:40,364 creating build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,365 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,367 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,370 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,372 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,374 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,376 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:40,379 creating build/lib/colossalai/legacy/zero/sharded_param 2025-01-03T04:44:40,380 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-01-03T04:44:40,383 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-01-03T04:44:40,385 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-01-03T04:44:40,388 creating build/lib/colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:40,389 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:40,392 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:40,394 creating build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,395 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,398 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,400 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,402 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,404 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:40,406 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,407 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,410 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,412 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,414 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,416 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:40,419 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:40,420 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:40,422 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:40,425 creating build/lib/colossalai/legacy/nn/layer 2025-01-03T04:44:40,426 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2025-01-03T04:44:40,428 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2025-01-03T04:44:40,430 creating build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,431 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,433 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,435 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,437 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,439 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2025-01-03T04:44:40,442 creating build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,443 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,445 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,448 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,450 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,452 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2025-01-03T04:44:40,455 creating build/lib/colossalai/legacy/nn/parallel 2025-01-03T04:44:40,456 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2025-01-03T04:44:40,459 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2025-01-03T04:44:40,461 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2025-01-03T04:44:40,463 creating build/lib/colossalai/legacy/nn/_ops 2025-01-03T04:44:40,464 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2025-01-03T04:44:40,467 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2025-01-03T04:44:40,469 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:40,470 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:40,472 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:40,475 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:40,477 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:40,481 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:40,482 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:40,484 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:40,487 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:40,489 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:40,493 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,494 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,496 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,499 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,501 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,503 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,504 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:40,507 creating build/lib/colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:40,508 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:40,510 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:40,513 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:40,514 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:40,516 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:40,518 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:40,520 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:40,523 creating build/lib/colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:40,524 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:40,526 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:40,530 creating build/lib/colossalai/legacy/nn/layer/utils 2025-01-03T04:44:40,531 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-01-03T04:44:40,533 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-01-03T04:44:40,535 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:40,539 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:40,542 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:40,544 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:40,546 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:40,550 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:40,551 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:40,553 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:40,556 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:40,558 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:40,562 creating build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,563 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,566 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,568 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,570 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,572 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:40,575 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,576 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,578 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,580 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,582 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,584 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,587 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,590 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,592 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,595 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:40,597 creating build/lib/colossalai/legacy/utils/data_sampler 2025-01-03T04:44:40,598 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-01-03T04:44:40,601 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-01-03T04:44:40,603 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-01-03T04:44:40,605 creating build/lib/colossalai/legacy/utils/checkpoint 2025-01-03T04:44:40,607 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-01-03T04:44:40,610 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-01-03T04:44:40,612 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-01-03T04:44:40,614 creating build/lib/colossalai/legacy/utils/profiler 2025-01-03T04:44:40,616 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-01-03T04:44:40,618 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-01-03T04:44:40,620 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2025-01-03T04:44:40,622 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2025-01-03T04:44:40,626 creating build/lib/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:40,627 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:40,630 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:40,632 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:40,635 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:40,637 creating build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,638 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,641 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,643 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,646 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,648 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-01-03T04:44:40,651 creating build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,652 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,654 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,656 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,658 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,660 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,662 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,664 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,666 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:40,668 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:40,670 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:40,672 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:40,675 creating build/lib/colossalai/legacy/context/random 2025-01-03T04:44:40,676 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2025-01-03T04:44:40,679 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2025-01-03T04:44:40,681 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2025-01-03T04:44:40,683 creating build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,684 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,687 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,689 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,692 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,694 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,696 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,698 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,700 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,703 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,704 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,707 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:40,709 creating build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,710 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,712 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,715 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,717 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,719 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,721 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,723 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-01-03T04:44:40,726 creating build/lib/colossalai/legacy/amp/torch_amp 2025-01-03T04:44:40,727 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-01-03T04:44:40,729 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-01-03T04:44:40,732 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-01-03T04:44:40,735 creating build/lib/colossalai/legacy/amp/apex_amp 2025-01-03T04:44:40,736 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-01-03T04:44:40,738 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-01-03T04:44:40,741 creating build/lib/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:40,742 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:40,744 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:40,746 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:40,749 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:40,751 creating build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,753 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,755 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,757 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,759 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,761 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,763 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,765 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2025-01-03T04:44:40,768 creating build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,769 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,772 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,775 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,777 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,780 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,782 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,785 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,789 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,791 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,795 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-01-03T04:44:40,797 creating build/lib/colossalai/fx/codegen 2025-01-03T04:44:40,798 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2025-01-03T04:44:40,803 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2025-01-03T04:44:40,806 creating build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,807 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,810 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,813 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,815 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,817 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,819 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,821 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,824 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2025-01-03T04:44:40,827 creating build/lib/colossalai/fx/passes 2025-01-03T04:44:40,828 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,831 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,835 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,838 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,841 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,844 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,846 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,848 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2025-01-03T04:44:40,851 creating build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,852 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,855 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,857 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,859 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,862 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,864 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,866 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2025-01-03T04:44:40,868 creating build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,870 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,872 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,874 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,875 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,877 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2025-01-03T04:44:40,880 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,881 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,883 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,885 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,887 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,889 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,891 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,893 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,895 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,897 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,899 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,901 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:40,904 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,905 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,907 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,909 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,911 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,913 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,915 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,917 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,919 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,921 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:40,923 creating build/lib/colossalai/fx/tracer/meta_patch 2025-01-03T04:44:40,925 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2025-01-03T04:44:40,928 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2025-01-03T04:44:40,929 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2025-01-03T04:44:40,932 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,933 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,936 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,938 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,940 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,942 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,944 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,946 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,948 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:40,950 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,952 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,954 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,956 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,958 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,960 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,962 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,964 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,966 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:40,970 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,971 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,973 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,975 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,978 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,979 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:40,982 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:40,983 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:40,986 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:40,988 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:40,990 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:40,992 creating build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:40,994 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:40,996 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:40,999 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:41,001 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:41,003 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2025-01-03T04:44:41,006 creating build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,007 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,010 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,013 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,016 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,020 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2025-01-03T04:44:41,023 creating build/lib/colossalai/_analyzer/fx/passes 2025-01-03T04:44:41,024 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2025-01-03T04:44:41,027 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2025-01-03T04:44:41,029 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2025-01-03T04:44:41,031 creating build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,033 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,035 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,038 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,040 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,043 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,045 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:41,047 creating build/lib/colossalai/amp/naive_amp 2025-01-03T04:44:41,048 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2025-01-03T04:44:41,050 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2025-01-03T04:44:41,053 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:41,054 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:41,056 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:41,058 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:41,061 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:41,063 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:41,065 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:41,067 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:41,069 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:41,070 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:41,073 creating build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,074 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,077 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,080 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,084 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,087 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,090 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,093 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,099 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,103 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,107 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,110 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2025-01-03T04:44:41,116 creating build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,117 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,121 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,126 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,129 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,133 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,136 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,140 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,144 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,149 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,153 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,157 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,161 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,165 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,169 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,171 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,175 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,178 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,180 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,184 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,187 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2025-01-03T04:44:41,191 creating build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,192 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,195 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,198 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,202 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,206 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,208 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,211 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,214 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,216 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,219 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,222 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,225 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,227 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,230 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,234 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,236 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,239 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,242 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,244 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,247 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,250 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2025-01-03T04:44:41,254 creating build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,256 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,258 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,260 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,263 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,265 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,266 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2025-01-03T04:44:41,269 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:41,270 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:41,272 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:41,276 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:41,278 creating build/lib/colossalai/tensor/moe_tensor 2025-01-03T04:44:41,279 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2025-01-03T04:44:41,282 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2025-01-03T04:44:41,284 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2025-01-03T04:44:41,286 creating build/lib/colossalai/tensor/padded_tensor 2025-01-03T04:44:41,287 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2025-01-03T04:44:41,289 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2025-01-03T04:44:41,292 creating build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,293 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,296 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,299 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,302 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,304 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,306 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,308 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,310 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-01-03T04:44:41,314 creating build/lib/extensions/csrc 2025-01-03T04:44:41,315 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2025-01-03T04:44:41,318 creating build/lib/extensions/pybind 2025-01-03T04:44:41,319 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2025-01-03T04:44:41,321 creating build/lib/extensions/pybind/inference 2025-01-03T04:44:41,322 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2025-01-03T04:44:41,324 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2025-01-03T04:44:41,326 creating build/lib/extensions/pybind/layernorm 2025-01-03T04:44:41,327 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2025-01-03T04:44:41,330 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2025-01-03T04:44:41,332 creating build/lib/extensions/pybind/cpu_adam 2025-01-03T04:44:41,333 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2025-01-03T04:44:41,335 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2025-01-03T04:44:41,337 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2025-01-03T04:44:41,339 creating build/lib/extensions/pybind/flash_attention 2025-01-03T04:44:41,340 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-01-03T04:44:41,343 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-01-03T04:44:41,345 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2025-01-03T04:44:41,347 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2025-01-03T04:44:41,349 creating build/lib/extensions/pybind/softmax 2025-01-03T04:44:41,350 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-01-03T04:44:41,352 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-01-03T04:44:41,355 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2025-01-03T04:44:41,357 creating build/lib/extensions/pybind/optimizer 2025-01-03T04:44:41,358 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2025-01-03T04:44:41,360 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2025-01-03T04:44:41,362 creating build/lib/extensions/pybind/moe 2025-01-03T04:44:41,364 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2025-01-03T04:44:41,366 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2025-01-03T04:44:41,458 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:41,460 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:41,463 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:41,466 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:41,467 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:41,471 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:41,473 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,475 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,478 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,483 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,486 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,489 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,492 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,495 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,498 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,501 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,503 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,506 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,509 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,512 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,514 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,518 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,521 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,523 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,526 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:41,528 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:41,530 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:41,532 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:41,534 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:41,537 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:41,539 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-01-03T04:44:41,540 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-01-03T04:44:41,543 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,544 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,547 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,550 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,553 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,555 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:41,558 creating build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,559 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,561 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,564 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,566 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,568 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:41,571 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:41,574 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:41,580 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:41,584 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:41,587 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:41,590 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:41,696 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-01-03T04:44:41,697 !! 2025-01-03T04:44:41,698 ******************************************************************************** 2025-01-03T04:44:41,698 Please avoid running ``setup.py`` directly. 2025-01-03T04:44:41,699 Instead, use pypa/build, pypa/installer or other 2025-01-03T04:44:41,699 standards-based tools. 2025-01-03T04:44:41,701 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-01-03T04:44:41,701 ******************************************************************************** 2025-01-03T04:44:41,702 !! 2025-01-03T04:44:41,703 self.initialize_options() 2025-01-03T04:44:41,725 installing to build/bdist.linux-armv7l/wheel 2025-01-03T04:44:41,726 running install 2025-01-03T04:44:41,750 running install_lib 2025-01-03T04:44:41,778 creating build/bdist.linux-armv7l/wheel 2025-01-03T04:44:41,781 creating build/bdist.linux-armv7l/wheel/colossalai 2025-01-03T04:44:41,783 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2025-01-03T04:44:41,784 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-01-03T04:44:41,787 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-01-03T04:44:41,790 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-01-03T04:44:41,791 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-01-03T04:44:41,794 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2025-01-03T04:44:41,795 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,798 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,800 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,803 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,806 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,809 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,811 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-01-03T04:44:41,814 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2025-01-03T04:44:41,816 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:41,817 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:41,819 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:41,821 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:41,823 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,824 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,826 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,828 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,831 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,832 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,835 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,837 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,839 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,841 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,843 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,845 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-01-03T04:44:41,847 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-01-03T04:44:41,850 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,851 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,854 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,856 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,859 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,861 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,863 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-01-03T04:44:41,865 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:41,866 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:41,870 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,871 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,873 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,875 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,877 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,879 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,882 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,884 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,885 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,887 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,890 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,892 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,894 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,896 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,898 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,900 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,902 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,904 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,907 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,908 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,911 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,913 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,915 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,918 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,920 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,922 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,924 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,928 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,930 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,932 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,934 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,936 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,938 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,941 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,942 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,945 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,947 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,949 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-01-03T04:44:41,952 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,953 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,955 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,957 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,959 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,961 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,963 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,965 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,967 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,969 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-01-03T04:44:41,971 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,972 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,975 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,977 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,979 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,981 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,983 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-01-03T04:44:41,985 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:41,988 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:41,989 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:41,991 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:41,993 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:41,996 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:41,998 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-01-03T04:44:42,000 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:42,002 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:42,004 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-01-03T04:44:42,006 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2025-01-03T04:44:42,007 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,009 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,012 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,015 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,017 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,019 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-01-03T04:44:42,021 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2025-01-03T04:44:42,022 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,024 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,027 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,028 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,031 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,033 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,036 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,037 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,040 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,044 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-01-03T04:44:42,046 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2025-01-03T04:44:42,047 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2025-01-03T04:44:42,049 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2025-01-03T04:44:42,051 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2025-01-03T04:44:42,052 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2025-01-03T04:44:42,054 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-01-03T04:44:42,055 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-01-03T04:44:42,057 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-01-03T04:44:42,059 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-01-03T04:44:42,060 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-01-03T04:44:42,063 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2025-01-03T04:44:42,064 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,066 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,069 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,072 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,074 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,076 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,079 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,080 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,083 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,085 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,087 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-01-03T04:44:42,090 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2025-01-03T04:44:42,091 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,094 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2025-01-03T04:44:42,096 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2025-01-03T04:44:42,099 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:42,100 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:42,103 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-01-03T04:44:42,106 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:42,108 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:42,111 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-01-03T04:44:42,115 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,116 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,119 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,121 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,123 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,126 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,128 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,131 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,133 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,135 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,138 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,140 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,143 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,146 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,149 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:42,150 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:42,152 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:42,154 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:42,156 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-01-03T04:44:42,159 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,162 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,165 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,167 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,169 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-01-03T04:44:42,171 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-01-03T04:44:42,172 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-01-03T04:44:42,176 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,177 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,179 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,181 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,183 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,185 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-01-03T04:44:42,188 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2025-01-03T04:44:42,190 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,191 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,193 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,195 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,197 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,199 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-01-03T04:44:42,202 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2025-01-03T04:44:42,203 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:42,205 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:42,207 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:42,209 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-01-03T04:44:42,211 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:42,213 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:42,215 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:42,217 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-01-03T04:44:42,219 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:42,220 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:42,222 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:42,224 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-01-03T04:44:42,226 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:42,227 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:42,229 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:42,231 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:42,233 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-01-03T04:44:42,235 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,236 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,238 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,240 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,241 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,243 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-01-03T04:44:42,246 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:42,247 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:42,249 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:42,250 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-01-03T04:44:42,253 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:42,254 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:42,256 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:42,258 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-01-03T04:44:42,260 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2025-01-03T04:44:42,261 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,263 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,265 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,267 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,268 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-01-03T04:44:42,271 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-01-03T04:44:42,273 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2025-01-03T04:44:42,274 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2025-01-03T04:44:42,276 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-01-03T04:44:42,278 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-01-03T04:44:42,280 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2025-01-03T04:44:42,282 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2025-01-03T04:44:42,284 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-01-03T04:44:42,286 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-01-03T04:44:42,288 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-01-03T04:44:42,290 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2025-01-03T04:44:42,292 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,294 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,297 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,299 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,300 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,303 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-01-03T04:44:42,305 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2025-01-03T04:44:42,308 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2025-01-03T04:44:42,309 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,311 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,313 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,315 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,317 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,318 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-01-03T04:44:42,321 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2025-01-03T04:44:42,322 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-01-03T04:44:42,324 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-01-03T04:44:42,326 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-01-03T04:44:42,328 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-01-03T04:44:42,330 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-01-03T04:44:42,332 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,334 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,337 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2025-01-03T04:44:42,338 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-01-03T04:44:42,340 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-01-03T04:44:42,342 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-01-03T04:44:42,345 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-01-03T04:44:42,346 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-01-03T04:44:42,348 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,351 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2025-01-03T04:44:42,352 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,354 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,357 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,359 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,361 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,363 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,365 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,368 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,370 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-01-03T04:44:42,372 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,374 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,376 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,378 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,381 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,382 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-01-03T04:44:42,385 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2025-01-03T04:44:42,386 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-01-03T04:44:42,388 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-01-03T04:44:42,390 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-01-03T04:44:42,392 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2025-01-03T04:44:42,394 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-01-03T04:44:42,396 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-01-03T04:44:42,398 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-01-03T04:44:42,400 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2025-01-03T04:44:42,402 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2025-01-03T04:44:42,403 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,405 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,408 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,410 copying build/lib/colossalai/pipeline/schedule/zero_bubble_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,412 copying build/lib/colossalai/pipeline/schedule/v_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,415 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,418 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,420 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-01-03T04:44:42,422 copying build/lib/colossalai/pipeline/weight_grad_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-01-03T04:44:42,424 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-01-03T04:44:42,426 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-01-03T04:44:42,429 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-01-03T04:44:42,431 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2025-01-03T04:44:42,433 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2025-01-03T04:44:42,434 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,436 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,440 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,441 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,443 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,445 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,447 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,448 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,450 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,453 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,454 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,456 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-01-03T04:44:42,458 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,461 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2025-01-03T04:44:42,463 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-01-03T04:44:42,466 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-01-03T04:44:42,468 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-01-03T04:44:42,470 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-01-03T04:44:42,472 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-01-03T04:44:42,474 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,476 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,478 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,480 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-01-03T04:44:42,482 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-01-03T04:44:42,485 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2025-01-03T04:44:42,486 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-01-03T04:44:42,489 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-01-03T04:44:42,490 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-01-03T04:44:42,493 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-01-03T04:44:42,495 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,496 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,498 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,500 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,501 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,504 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-01-03T04:44:42,505 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-01-03T04:44:42,508 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2025-01-03T04:44:42,509 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-01-03T04:44:42,511 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-01-03T04:44:42,512 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-01-03T04:44:42,514 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-01-03T04:44:42,517 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2025-01-03T04:44:42,518 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-01-03T04:44:42,520 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-01-03T04:44:42,522 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2025-01-03T04:44:42,524 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2025-01-03T04:44:42,525 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-01-03T04:44:42,527 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-01-03T04:44:42,529 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-01-03T04:44:42,531 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-01-03T04:44:42,533 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-01-03T04:44:42,536 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2025-01-03T04:44:42,537 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,539 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,541 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,543 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,546 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,548 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,550 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,552 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-01-03T04:44:42,556 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2025-01-03T04:44:42,557 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2025-01-03T04:44:42,559 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2025-01-03T04:44:42,560 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,563 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,566 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,568 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,571 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,574 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,576 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,578 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,580 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,582 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,584 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,586 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,589 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,591 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,594 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,597 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-01-03T04:44:42,600 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-01-03T04:44:42,604 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2025-01-03T04:44:42,606 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-01-03T04:44:42,609 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-01-03T04:44:42,613 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-01-03T04:44:42,615 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-01-03T04:44:42,618 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-01-03T04:44:42,623 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2025-01-03T04:44:42,625 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-01-03T04:44:42,629 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2025-01-03T04:44:42,631 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-01-03T04:44:42,634 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-01-03T04:44:42,638 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-01-03T04:44:42,642 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-01-03T04:44:42,646 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2025-01-03T04:44:42,647 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-01-03T04:44:42,650 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-01-03T04:44:42,653 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-01-03T04:44:42,656 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2025-01-03T04:44:42,657 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,660 copying build/lib/colossalai/quantization/fp8_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,662 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,666 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,669 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,671 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,674 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-01-03T04:44:42,677 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2025-01-03T04:44:42,679 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-01-03T04:44:42,683 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-01-03T04:44:42,686 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2025-01-03T04:44:42,688 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-01-03T04:44:42,693 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-01-03T04:44:42,695 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2025-01-03T04:44:42,696 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-01-03T04:44:42,699 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-01-03T04:44:42,700 copying build/lib/colossalai/utils/safetensors.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-01-03T04:44:42,703 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2025-01-03T04:44:42,705 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-01-03T04:44:42,707 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-01-03T04:44:42,709 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2025-01-03T04:44:42,710 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-01-03T04:44:42,712 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-01-03T04:44:42,714 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-01-03T04:44:42,716 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-01-03T04:44:42,718 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2025-01-03T04:44:42,720 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2025-01-03T04:44:42,722 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2025-01-03T04:44:42,723 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:42,725 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:42,727 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:42,729 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-01-03T04:44:42,731 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-01-03T04:44:42,734 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:42,735 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:42,737 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-01-03T04:44:42,739 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-01-03T04:44:42,741 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,743 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,745 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,746 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,748 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,750 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,752 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,755 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,756 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,759 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-01-03T04:44:42,761 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2025-01-03T04:44:42,762 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-01-03T04:44:42,765 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-01-03T04:44:42,767 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-01-03T04:44:42,769 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-01-03T04:44:42,771 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-01-03T04:44:42,774 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:42,775 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:42,778 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,779 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,782 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,784 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,787 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,790 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-01-03T04:44:42,792 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:42,795 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:42,796 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:42,799 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:42,801 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:42,803 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-01-03T04:44:42,804 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:42,807 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-01-03T04:44:42,808 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-01-03T04:44:42,811 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2025-01-03T04:44:42,813 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2025-01-03T04:44:42,814 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-01-03T04:44:42,818 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-01-03T04:44:42,820 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-01-03T04:44:42,823 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-01-03T04:44:42,824 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-01-03T04:44:42,826 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-01-03T04:44:42,828 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-01-03T04:44:42,831 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-01-03T04:44:42,834 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2025-01-03T04:44:42,835 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-01-03T04:44:42,837 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-01-03T04:44:42,839 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:42,841 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:42,843 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-01-03T04:44:42,845 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-01-03T04:44:42,847 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2025-01-03T04:44:42,849 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2025-01-03T04:44:42,851 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,853 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,855 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,857 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,859 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,861 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-01-03T04:44:42,863 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,865 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,867 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,870 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:42,871 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:42,873 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-01-03T04:44:42,874 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,876 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,879 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,880 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-01-03T04:44:42,883 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2025-01-03T04:44:42,884 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-01-03T04:44:42,886 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-01-03T04:44:42,889 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,890 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,892 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,894 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,897 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,898 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,901 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-01-03T04:44:42,903 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2025-01-03T04:44:42,904 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-01-03T04:44:42,907 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-01-03T04:44:42,909 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-01-03T04:44:42,912 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:42,913 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:42,916 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-01-03T04:44:42,918 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,919 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,922 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,924 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,926 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,928 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-01-03T04:44:42,929 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2025-01-03T04:44:42,932 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2025-01-03T04:44:42,934 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2025-01-03T04:44:42,935 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:42,937 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:42,938 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:42,941 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:42,943 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-01-03T04:44:42,947 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:42,948 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:42,951 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:42,953 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:42,955 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-01-03T04:44:42,959 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,960 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,962 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,964 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,966 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,968 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,970 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-01-03T04:44:42,973 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:42,974 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:42,976 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-01-03T04:44:42,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:42,980 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:42,982 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:42,984 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:42,986 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-01-03T04:44:42,989 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:42,990 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:42,992 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-01-03T04:44:42,995 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2025-01-03T04:44:42,996 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-01-03T04:44:42,999 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-01-03T04:44:43,000 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-01-03T04:44:43,003 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:43,004 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:43,007 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:43,009 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:43,011 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-01-03T04:44:43,014 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-01-03T04:44:43,016 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:43,017 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:43,019 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:43,022 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:43,024 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-01-03T04:44:43,028 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2025-01-03T04:44:43,029 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-01-03T04:44:43,031 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-01-03T04:44:43,033 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-01-03T04:44:43,035 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-01-03T04:44:43,036 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-01-03T04:44:43,039 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2025-01-03T04:44:43,040 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-01-03T04:44:43,043 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-01-03T04:44:43,045 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-01-03T04:44:43,047 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-01-03T04:44:43,049 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-01-03T04:44:43,051 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2025-01-03T04:44:43,053 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-01-03T04:44:43,055 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-01-03T04:44:43,057 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-01-03T04:44:43,059 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,060 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,062 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,064 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,067 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,068 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,070 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,072 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,074 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,076 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,079 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,081 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,084 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,086 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-01-03T04:44:43,088 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,090 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-01-03T04:44:43,092 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2025-01-03T04:44:43,093 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-01-03T04:44:43,096 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-01-03T04:44:43,097 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2025-01-03T04:44:43,100 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2025-01-03T04:44:43,101 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2025-01-03T04:44:43,102 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-01-03T04:44:43,105 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-01-03T04:44:43,107 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-01-03T04:44:43,108 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-01-03T04:44:43,111 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2025-01-03T04:44:43,113 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-01-03T04:44:43,115 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-01-03T04:44:43,117 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-01-03T04:44:43,119 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-01-03T04:44:43,121 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-01-03T04:44:43,124 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2025-01-03T04:44:43,125 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-01-03T04:44:43,128 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:43,129 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:43,131 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:43,134 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:43,136 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-01-03T04:44:43,138 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-01-03T04:44:43,139 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-01-03T04:44:43,141 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-01-03T04:44:43,144 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-01-03T04:44:43,146 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-01-03T04:44:43,148 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2025-01-03T04:44:43,150 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,151 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,154 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,156 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,158 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,160 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-01-03T04:44:43,163 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2025-01-03T04:44:43,164 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-01-03T04:44:43,167 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2025-01-03T04:44:43,168 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-01-03T04:44:43,170 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-01-03T04:44:43,172 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-01-03T04:44:43,175 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-01-03T04:44:43,177 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-01-03T04:44:43,180 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,181 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,183 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,185 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,186 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,188 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,190 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,192 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,194 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-01-03T04:44:43,196 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:43,197 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:43,200 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-01-03T04:44:43,201 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-01-03T04:44:43,204 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2025-01-03T04:44:43,205 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2025-01-03T04:44:43,207 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-01-03T04:44:43,209 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-01-03T04:44:43,211 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-01-03T04:44:43,213 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,214 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,216 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,218 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,220 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,222 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,225 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,226 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,228 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,231 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,232 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,235 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-01-03T04:44:43,236 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-01-03T04:44:43,239 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-01-03T04:44:43,241 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-01-03T04:44:43,243 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-01-03T04:44:43,245 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2025-01-03T04:44:43,246 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-01-03T04:44:43,248 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-01-03T04:44:43,250 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2025-01-03T04:44:43,252 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-01-03T04:44:43,253 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-01-03T04:44:43,255 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-01-03T04:44:43,258 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-01-03T04:44:43,260 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2025-01-03T04:44:43,262 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,263 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,265 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,267 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,269 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,271 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,274 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,275 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-01-03T04:44:43,277 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-01-03T04:44:43,280 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-01-03T04:44:43,281 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-01-03T04:44:43,283 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-01-03T04:44:43,285 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2025-01-03T04:44:43,287 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2025-01-03T04:44:43,288 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-01-03T04:44:43,290 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-01-03T04:44:43,293 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-01-03T04:44:43,295 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2025-01-03T04:44:43,297 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-01-03T04:44:43,299 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-01-03T04:44:43,301 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-01-03T04:44:43,303 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2025-01-03T04:44:43,304 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-01-03T04:44:43,306 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-01-03T04:44:43,308 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-01-03T04:44:43,311 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-01-03T04:44:43,313 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-01-03T04:44:43,315 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2025-01-03T04:44:43,316 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,318 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,320 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,322 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,324 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,326 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,328 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,330 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-01-03T04:44:43,332 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2025-01-03T04:44:43,334 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2025-01-03T04:44:43,335 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,337 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,339 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,341 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,343 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,344 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,346 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-01-03T04:44:43,348 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-01-03T04:44:43,351 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-01-03T04:44:43,353 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2025-01-03T04:44:43,354 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,358 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,360 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,362 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,364 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,366 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,369 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,371 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,373 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,375 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-01-03T04:44:43,377 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-01-03T04:44:43,379 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2025-01-03T04:44:43,380 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-01-03T04:44:43,383 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-01-03T04:44:43,384 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-01-03T04:44:43,387 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2025-01-03T04:44:43,388 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,390 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2025-01-03T04:44:43,392 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-01-03T04:44:43,395 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-01-03T04:44:43,397 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,399 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,403 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2025-01-03T04:44:43,404 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,407 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,410 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,412 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,415 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,418 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2025-01-03T04:44:43,420 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,422 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,425 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,427 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,430 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,432 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,434 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,436 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,438 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,440 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,443 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,445 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-01-03T04:44:43,447 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-01-03T04:44:43,450 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-01-03T04:44:43,452 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-01-03T04:44:43,454 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-01-03T04:44:43,457 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-01-03T04:44:43,460 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,462 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,464 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,467 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,469 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,471 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,473 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,476 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,478 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,480 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-01-03T04:44:43,482 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,484 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,487 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-01-03T04:44:43,491 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2025-01-03T04:44:43,492 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,496 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,498 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,500 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,503 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,505 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,507 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,509 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-01-03T04:44:43,511 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,513 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,516 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2025-01-03T04:44:43,517 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,520 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,522 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2025-01-03T04:44:43,524 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,525 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,527 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,529 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,531 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,533 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,535 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,537 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,539 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-01-03T04:44:43,541 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,543 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,544 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,546 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,548 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,550 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,552 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,554 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,556 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-01-03T04:44:43,558 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2025-01-03T04:44:43,560 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2025-01-03T04:44:43,562 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,563 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,565 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,567 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,569 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,571 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-01-03T04:44:43,573 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2025-01-03T04:44:43,575 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:43,577 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:43,579 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:43,581 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:43,583 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-01-03T04:44:43,585 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,586 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,588 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,591 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,593 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-01-03T04:44:43,595 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-01-03T04:44:43,598 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2025-01-03T04:44:43,599 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-01-03T04:44:43,601 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-01-03T04:44:43,603 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-01-03T04:44:43,605 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-01-03T04:44:43,607 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-01-03T04:44:43,610 creating build/bdist.linux-armv7l/wheel/colossalai/context 2025-01-03T04:44:43,611 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-01-03T04:44:43,613 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-01-03T04:44:43,615 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-01-03T04:44:43,617 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-01-03T04:44:43,619 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2025-01-03T04:44:43,620 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,623 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,625 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,627 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,629 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,631 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-01-03T04:44:43,634 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2025-01-03T04:44:43,636 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-01-03T04:44:43,639 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2025-01-03T04:44:43,640 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-01-03T04:44:43,644 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-01-03T04:44:43,646 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-01-03T04:44:43,649 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2025-01-03T04:44:43,650 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-01-03T04:44:43,653 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-01-03T04:44:43,656 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-01-03T04:44:43,658 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-01-03T04:44:43,661 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,663 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,665 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,668 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,670 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,673 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,675 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-01-03T04:44:43,678 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-01-03T04:44:43,680 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,682 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,685 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,688 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,691 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,694 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-01-03T04:44:43,696 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-01-03T04:44:43,698 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-01-03T04:44:43,700 creating build/bdist.linux-armv7l/wheel/colossalai/device 2025-01-03T04:44:43,702 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-01-03T04:44:43,705 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-01-03T04:44:43,708 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-01-03T04:44:43,711 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-01-03T04:44:43,714 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2025-01-03T04:44:43,716 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2025-01-03T04:44:43,718 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:43,720 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:43,722 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:43,725 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:43,727 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-01-03T04:44:43,730 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:43,732 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:43,734 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:43,736 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:43,739 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-01-03T04:44:43,741 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-01-03T04:44:43,742 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-01-03T04:44:43,746 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2025-01-03T04:44:43,748 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2025-01-03T04:44:43,750 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-01-03T04:44:43,754 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2025-01-03T04:44:43,755 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,758 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,762 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,765 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,768 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,771 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,773 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,776 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,778 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,781 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,783 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-01-03T04:44:43,787 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2025-01-03T04:44:43,788 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,791 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,794 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,796 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,799 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,801 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,804 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,807 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,810 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,813 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,816 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,819 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,822 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,825 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,828 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:43,829 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:43,831 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:43,835 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-01-03T04:44:43,836 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,840 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,843 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,845 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,848 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,850 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-01-03T04:44:43,854 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2025-01-03T04:44:43,855 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,858 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,860 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,862 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,865 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,867 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,870 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,872 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,875 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,877 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,879 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,882 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,884 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,887 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,889 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,892 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,894 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,897 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,899 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,901 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,904 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-01-03T04:44:43,907 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2025-01-03T04:44:43,909 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,910 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,913 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,915 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,917 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,919 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-01-03T04:44:43,920 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-01-03T04:44:43,923 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2025-01-03T04:44:43,925 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2025-01-03T04:44:43,926 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-01-03T04:44:43,928 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-01-03T04:44:43,930 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-01-03T04:44:43,932 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2025-01-03T04:44:43,933 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-01-03T04:44:43,935 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-01-03T04:44:43,936 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,939 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,941 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,944 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,946 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,947 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,950 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,952 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2025-01-03T04:44:43,953 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,956 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,959 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,961 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,963 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,965 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,967 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,969 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-01-03T04:44:43,971 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-01-03T04:44:43,974 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2025-01-03T04:44:43,976 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2025-01-03T04:44:43,978 creating build/bdist.linux-armv7l/wheel/extensions 2025-01-03T04:44:43,980 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2025-01-03T04:44:43,981 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2025-01-03T04:44:43,983 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2025-01-03T04:44:43,985 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2025-01-03T04:44:43,986 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-01-03T04:44:43,988 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-01-03T04:44:43,990 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2025-01-03T04:44:43,991 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-01-03T04:44:43,993 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-01-03T04:44:43,995 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2025-01-03T04:44:43,996 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-01-03T04:44:43,998 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-01-03T04:44:44,000 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-01-03T04:44:44,002 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2025-01-03T04:44:44,003 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-01-03T04:44:44,005 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-01-03T04:44:44,007 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-01-03T04:44:44,009 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-01-03T04:44:44,011 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2025-01-03T04:44:44,013 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-01-03T04:44:44,015 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-01-03T04:44:44,016 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-01-03T04:44:44,019 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2025-01-03T04:44:44,020 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-01-03T04:44:44,022 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-01-03T04:44:44,025 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2025-01-03T04:44:44,026 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-01-03T04:44:44,028 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-01-03T04:44:44,030 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2025-01-03T04:44:44,031 running install_egg_info 2025-01-03T04:44:44,065 running egg_info 2025-01-03T04:44:44,093 writing colossalai.egg-info/PKG-INFO 2025-01-03T04:44:44,097 writing dependency_links to colossalai.egg-info/dependency_links.txt 2025-01-03T04:44:44,099 writing entry points to colossalai.egg-info/entry_points.txt 2025-01-03T04:44:44,100 writing requirements to colossalai.egg-info/requires.txt 2025-01-03T04:44:44,102 writing top-level names to colossalai.egg-info/top_level.txt 2025-01-03T04:44:44,371 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2025-01-03T04:44:44,455 reading manifest template 'MANIFEST.in' 2025-01-03T04:44:45,942 warning: no files found matching '*.tr' under directory 'colossalai' 2025-01-03T04:44:46,574 warning: no files found matching '*.cc' under directory 'colossalai' 2025-01-03T04:44:46,882 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-01-03T04:44:47,017 warning: no files found matching '*.tr' under directory 'extensions' 2025-01-03T04:44:47,071 warning: no files found matching '*.cc' under directory 'extensions' 2025-01-03T04:44:47,098 warning: no files found matching '*.pyi' under directory 'extensions' 2025-01-03T04:44:47,098 adding license file 'LICENSE' 2025-01-03T04:44:47,148 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2025-01-03T04:44:47,150 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.7-py3.11.egg-info 2025-01-03T04:44:47,163 running install_scripts 2025-01-03T04:44:47,190 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.7.dist-info/WHEEL 2025-01-03T04:44:47,192 creating '/tmp/pip-wheel-o6ulihrg/colossalai-0.4.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-01-03T04:44:47,195 adding 'colossalai/__init__.py' 2025-01-03T04:44:47,196 adding 'colossalai/initialize.py' 2025-01-03T04:44:47,198 adding 'colossalai/version.py' 2025-01-03T04:44:47,199 adding 'colossalai/_C/__init__.py' 2025-01-03T04:44:47,201 adding 'colossalai/_analyzer/__init__.py' 2025-01-03T04:44:47,202 adding 'colossalai/_analyzer/envs.py' 2025-01-03T04:44:47,204 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2025-01-03T04:44:47,207 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2025-01-03T04:44:47,208 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2025-01-03T04:44:47,211 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2025-01-03T04:44:47,213 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2025-01-03T04:44:47,215 adding 'colossalai/_analyzer/fx/__init__.py' 2025-01-03T04:44:47,217 adding 'colossalai/_analyzer/fx/codegen.py' 2025-01-03T04:44:47,219 adding 'colossalai/_analyzer/fx/graph_module.py' 2025-01-03T04:44:47,221 adding 'colossalai/_analyzer/fx/node_util.py' 2025-01-03T04:44:47,222 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2025-01-03T04:44:47,224 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2025-01-03T04:44:47,226 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2025-01-03T04:44:47,228 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2025-01-03T04:44:47,230 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2025-01-03T04:44:47,231 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2025-01-03T04:44:47,233 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2025-01-03T04:44:47,234 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2025-01-03T04:44:47,236 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2025-01-03T04:44:47,238 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2025-01-03T04:44:47,240 adding 'colossalai/accelerator/__init__.py' 2025-01-03T04:44:47,241 adding 'colossalai/accelerator/api.py' 2025-01-03T04:44:47,243 adding 'colossalai/accelerator/base_accelerator.py' 2025-01-03T04:44:47,244 adding 'colossalai/accelerator/cpu_accelerator.py' 2025-01-03T04:44:47,246 adding 'colossalai/accelerator/cuda_accelerator.py' 2025-01-03T04:44:47,248 adding 'colossalai/accelerator/npu_accelerator.py' 2025-01-03T04:44:47,250 adding 'colossalai/amp/__init__.py' 2025-01-03T04:44:47,252 adding 'colossalai/amp/naive_amp/__init__.py' 2025-01-03T04:44:47,253 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2025-01-03T04:44:47,255 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2025-01-03T04:44:47,256 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2025-01-03T04:44:47,258 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2025-01-03T04:44:47,259 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2025-01-03T04:44:47,261 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2025-01-03T04:44:47,262 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2025-01-03T04:44:47,263 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2025-01-03T04:44:47,264 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2025-01-03T04:44:47,266 adding 'colossalai/auto_parallel/__init__.py' 2025-01-03T04:44:47,268 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2025-01-03T04:44:47,269 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2025-01-03T04:44:47,270 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2025-01-03T04:44:47,272 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2025-01-03T04:44:47,274 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2025-01-03T04:44:47,276 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2025-01-03T04:44:47,278 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2025-01-03T04:44:47,279 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2025-01-03T04:44:47,280 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2025-01-03T04:44:47,282 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2025-01-03T04:44:47,283 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2025-01-03T04:44:47,285 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2025-01-03T04:44:47,286 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2025-01-03T04:44:47,288 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2025-01-03T04:44:47,289 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2025-01-03T04:44:47,292 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2025-01-03T04:44:47,294 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2025-01-03T04:44:47,296 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2025-01-03T04:44:47,298 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2025-01-03T04:44:47,299 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2025-01-03T04:44:47,301 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2025-01-03T04:44:47,302 adding 'colossalai/auto_parallel/offload/__init__.py' 2025-01-03T04:44:47,304 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2025-01-03T04:44:47,305 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2025-01-03T04:44:47,307 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2025-01-03T04:44:47,308 adding 'colossalai/auto_parallel/offload/region.py' 2025-01-03T04:44:47,311 adding 'colossalai/auto_parallel/offload/region_manager.py' 2025-01-03T04:44:47,313 adding 'colossalai/auto_parallel/offload/runtime.py' 2025-01-03T04:44:47,315 adding 'colossalai/auto_parallel/offload/solver.py' 2025-01-03T04:44:47,318 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2025-01-03T04:44:47,319 adding 'colossalai/auto_parallel/offload/util.py' 2025-01-03T04:44:47,321 adding 'colossalai/auto_parallel/passes/__init__.py' 2025-01-03T04:44:47,322 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2025-01-03T04:44:47,323 adding 'colossalai/auto_parallel/passes/constants.py' 2025-01-03T04:44:47,325 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2025-01-03T04:44:47,327 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2025-01-03T04:44:47,329 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2025-01-03T04:44:47,331 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2025-01-03T04:44:47,333 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2025-01-03T04:44:47,334 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2025-01-03T04:44:47,336 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2025-01-03T04:44:47,337 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2025-01-03T04:44:47,339 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2025-01-03T04:44:47,341 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2025-01-03T04:44:47,342 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2025-01-03T04:44:47,343 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2025-01-03T04:44:47,345 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2025-01-03T04:44:47,346 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2025-01-03T04:44:47,348 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2025-01-03T04:44:47,349 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2025-01-03T04:44:47,351 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2025-01-03T04:44:47,352 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2025-01-03T04:44:47,353 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2025-01-03T04:44:47,355 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2025-01-03T04:44:47,356 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2025-01-03T04:44:47,359 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2025-01-03T04:44:47,361 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2025-01-03T04:44:47,362 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2025-01-03T04:44:47,364 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2025-01-03T04:44:47,365 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2025-01-03T04:44:47,366 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2025-01-03T04:44:47,367 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2025-01-03T04:44:47,369 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2025-01-03T04:44:47,370 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2025-01-03T04:44:47,371 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2025-01-03T04:44:47,373 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2025-01-03T04:44:47,374 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2025-01-03T04:44:47,375 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2025-01-03T04:44:47,377 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2025-01-03T04:44:47,378 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2025-01-03T04:44:47,380 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2025-01-03T04:44:47,382 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2025-01-03T04:44:47,384 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2025-01-03T04:44:47,386 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2025-01-03T04:44:47,388 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2025-01-03T04:44:47,390 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2025-01-03T04:44:47,391 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2025-01-03T04:44:47,393 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2025-01-03T04:44:47,396 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2025-01-03T04:44:47,398 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2025-01-03T04:44:47,399 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2025-01-03T04:44:47,401 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2025-01-03T04:44:47,403 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2025-01-03T04:44:47,404 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2025-01-03T04:44:47,406 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2025-01-03T04:44:47,408 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2025-01-03T04:44:47,409 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2025-01-03T04:44:47,410 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2025-01-03T04:44:47,412 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2025-01-03T04:44:47,413 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2025-01-03T04:44:47,415 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2025-01-03T04:44:47,417 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2025-01-03T04:44:47,419 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2025-01-03T04:44:47,421 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2025-01-03T04:44:47,423 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2025-01-03T04:44:47,424 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2025-01-03T04:44:47,426 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2025-01-03T04:44:47,428 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2025-01-03T04:44:47,429 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2025-01-03T04:44:47,431 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2025-01-03T04:44:47,433 adding 'colossalai/booster/__init__.py' 2025-01-03T04:44:47,434 adding 'colossalai/booster/accelerator.py' 2025-01-03T04:44:47,436 adding 'colossalai/booster/booster.py' 2025-01-03T04:44:47,440 adding 'colossalai/booster/mixed_precision/__init__.py' 2025-01-03T04:44:47,441 adding 'colossalai/booster/mixed_precision/bf16.py' 2025-01-03T04:44:47,442 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2025-01-03T04:44:47,444 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2025-01-03T04:44:47,446 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2025-01-03T04:44:47,447 adding 'colossalai/booster/mixed_precision/fp8.py' 2025-01-03T04:44:47,448 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2025-01-03T04:44:47,450 adding 'colossalai/booster/plugin/__init__.py' 2025-01-03T04:44:47,452 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2025-01-03T04:44:47,456 adding 'colossalai/booster/plugin/gemini_plugin.py' 2025-01-03T04:44:47,464 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2025-01-03T04:44:47,467 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2025-01-03T04:44:47,471 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2025-01-03T04:44:47,472 adding 'colossalai/booster/plugin/plugin_base.py' 2025-01-03T04:44:47,474 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2025-01-03T04:44:47,476 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2025-01-03T04:44:47,478 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2025-01-03T04:44:47,480 adding 'colossalai/checkpoint_io/__init__.py' 2025-01-03T04:44:47,483 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2025-01-03T04:44:47,485 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2025-01-03T04:44:47,490 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2025-01-03T04:44:47,491 adding 'colossalai/checkpoint_io/index_file.py' 2025-01-03T04:44:47,495 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2025-01-03T04:44:47,500 adding 'colossalai/checkpoint_io/utils.py' 2025-01-03T04:44:47,502 adding 'colossalai/cli/__init__.py' 2025-01-03T04:44:47,503 adding 'colossalai/cli/cli.py' 2025-01-03T04:44:47,505 adding 'colossalai/cli/check/__init__.py' 2025-01-03T04:44:47,506 adding 'colossalai/cli/check/check_installation.py' 2025-01-03T04:44:47,508 adding 'colossalai/cli/launcher/__init__.py' 2025-01-03T04:44:47,510 adding 'colossalai/cli/launcher/hostinfo.py' 2025-01-03T04:44:47,511 adding 'colossalai/cli/launcher/multinode_runner.py' 2025-01-03T04:44:47,513 adding 'colossalai/cli/launcher/run.py' 2025-01-03T04:44:47,515 adding 'colossalai/cluster/__init__.py' 2025-01-03T04:44:47,516 adding 'colossalai/cluster/device_mesh_manager.py' 2025-01-03T04:44:47,518 adding 'colossalai/cluster/dist_coordinator.py' 2025-01-03T04:44:47,519 adding 'colossalai/cluster/process_group_manager.py' 2025-01-03T04:44:47,521 adding 'colossalai/cluster/process_group_mesh.py' 2025-01-03T04:44:47,523 adding 'colossalai/context/__init__.py' 2025-01-03T04:44:47,525 adding 'colossalai/context/config.py' 2025-01-03T04:44:47,526 adding 'colossalai/context/singleton_meta.py' 2025-01-03T04:44:47,528 adding 'colossalai/device/__init__.py' 2025-01-03T04:44:47,530 adding 'colossalai/device/alpha_beta_profiler.py' 2025-01-03T04:44:47,531 adding 'colossalai/device/calc_pipeline_strategy.py' 2025-01-03T04:44:47,534 adding 'colossalai/device/device_mesh.py' 2025-01-03T04:44:47,536 adding 'colossalai/fx/__init__.py' 2025-01-03T04:44:47,538 adding 'colossalai/fx/_compatibility.py' 2025-01-03T04:44:47,540 adding 'colossalai/fx/_meta_regist_12.py' 2025-01-03T04:44:47,541 adding 'colossalai/fx/_meta_regist_13.py' 2025-01-03T04:44:47,543 adding 'colossalai/fx/graph_module.py' 2025-01-03T04:44:47,544 adding 'colossalai/fx/proxy.py' 2025-01-03T04:44:47,546 adding 'colossalai/fx/codegen/__init__.py' 2025-01-03T04:44:47,550 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2025-01-03T04:44:47,552 adding 'colossalai/fx/passes/__init__.py' 2025-01-03T04:44:47,554 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2025-01-03T04:44:47,556 adding 'colossalai/fx/passes/concrete_info_prop.py' 2025-01-03T04:44:47,558 adding 'colossalai/fx/passes/meta_info_prop.py' 2025-01-03T04:44:47,561 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2025-01-03T04:44:47,563 adding 'colossalai/fx/passes/shard_1d_pass.py' 2025-01-03T04:44:47,565 adding 'colossalai/fx/passes/split_module.py' 2025-01-03T04:44:47,566 adding 'colossalai/fx/passes/utils.py' 2025-01-03T04:44:47,568 adding 'colossalai/fx/profiler/__init__.py' 2025-01-03T04:44:47,570 adding 'colossalai/fx/profiler/constants.py' 2025-01-03T04:44:47,571 adding 'colossalai/fx/profiler/dataflow.py' 2025-01-03T04:44:47,573 adding 'colossalai/fx/profiler/memory_utils.py' 2025-01-03T04:44:47,575 adding 'colossalai/fx/profiler/opcount.py' 2025-01-03T04:44:47,577 adding 'colossalai/fx/profiler/profiler.py' 2025-01-03T04:44:47,578 adding 'colossalai/fx/profiler/shard_utils.py' 2025-01-03T04:44:47,580 adding 'colossalai/fx/profiler/tensor.py' 2025-01-03T04:44:47,582 adding 'colossalai/fx/profiler/experimental/__init__.py' 2025-01-03T04:44:47,583 adding 'colossalai/fx/profiler/experimental/constants.py' 2025-01-03T04:44:47,585 adding 'colossalai/fx/profiler/experimental/profiler.py' 2025-01-03T04:44:47,586 adding 'colossalai/fx/profiler/experimental/registry.py' 2025-01-03T04:44:47,587 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2025-01-03T04:44:47,589 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2025-01-03T04:44:47,590 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2025-01-03T04:44:47,591 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2025-01-03T04:44:47,593 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2025-01-03T04:44:47,594 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2025-01-03T04:44:47,595 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2025-01-03T04:44:47,596 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2025-01-03T04:44:47,597 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2025-01-03T04:44:47,599 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2025-01-03T04:44:47,600 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2025-01-03T04:44:47,602 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2025-01-03T04:44:47,603 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2025-01-03T04:44:47,604 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2025-01-03T04:44:47,606 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2025-01-03T04:44:47,607 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2025-01-03T04:44:47,608 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2025-01-03T04:44:47,610 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2025-01-03T04:44:47,611 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2025-01-03T04:44:47,613 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2025-01-03T04:44:47,614 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2025-01-03T04:44:47,616 adding 'colossalai/fx/tracer/__init__.py' 2025-01-03T04:44:47,617 adding 'colossalai/fx/tracer/_meta_trace.py' 2025-01-03T04:44:47,618 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2025-01-03T04:44:47,620 adding 'colossalai/fx/tracer/_tracer_utils.py' 2025-01-03T04:44:47,623 adding 'colossalai/fx/tracer/experimental.py' 2025-01-03T04:44:47,624 adding 'colossalai/fx/tracer/registry.py' 2025-01-03T04:44:47,627 adding 'colossalai/fx/tracer/tracer.py' 2025-01-03T04:44:47,629 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2025-01-03T04:44:47,631 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2025-01-03T04:44:47,632 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2025-01-03T04:44:47,634 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2025-01-03T04:44:47,635 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2025-01-03T04:44:47,636 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2025-01-03T04:44:47,638 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2025-01-03T04:44:47,639 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2025-01-03T04:44:47,641 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2025-01-03T04:44:47,642 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2025-01-03T04:44:47,644 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2025-01-03T04:44:47,645 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2025-01-03T04:44:47,646 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2025-01-03T04:44:47,648 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2025-01-03T04:44:47,649 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2025-01-03T04:44:47,651 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2025-01-03T04:44:47,652 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2025-01-03T04:44:47,653 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2025-01-03T04:44:47,655 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2025-01-03T04:44:47,657 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2025-01-03T04:44:47,658 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2025-01-03T04:44:47,659 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2025-01-03T04:44:47,660 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2025-01-03T04:44:47,661 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2025-01-03T04:44:47,663 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2025-01-03T04:44:47,664 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2025-01-03T04:44:47,665 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2025-01-03T04:44:47,667 adding 'colossalai/inference/__init__.py' 2025-01-03T04:44:47,670 adding 'colossalai/inference/batch_bucket.py' 2025-01-03T04:44:47,673 adding 'colossalai/inference/config.py' 2025-01-03T04:44:47,674 adding 'colossalai/inference/flash_decoding_utils.py' 2025-01-03T04:44:47,676 adding 'colossalai/inference/graph_runner.py' 2025-01-03T04:44:47,678 adding 'colossalai/inference/logit_processors.py' 2025-01-03T04:44:47,679 adding 'colossalai/inference/sampler.py' 2025-01-03T04:44:47,681 adding 'colossalai/inference/struct.py' 2025-01-03T04:44:47,682 adding 'colossalai/inference/utils.py' 2025-01-03T04:44:47,684 adding 'colossalai/inference/core/__init__.py' 2025-01-03T04:44:47,686 adding 'colossalai/inference/core/async_engine.py' 2025-01-03T04:44:47,688 adding 'colossalai/inference/core/base_engine.py' 2025-01-03T04:44:47,689 adding 'colossalai/inference/core/diffusion_engine.py' 2025-01-03T04:44:47,691 adding 'colossalai/inference/core/engine.py' 2025-01-03T04:44:47,695 adding 'colossalai/inference/core/llm_engine.py' 2025-01-03T04:44:47,697 adding 'colossalai/inference/core/plugin.py' 2025-01-03T04:44:47,699 adding 'colossalai/inference/core/request_handler.py' 2025-01-03T04:44:47,701 adding 'colossalai/inference/core/rpc_engine.py' 2025-01-03T04:44:47,703 adding 'colossalai/inference/executor/__init__.py' 2025-01-03T04:44:47,705 adding 'colossalai/inference/executor/rpc_worker.py' 2025-01-03T04:44:47,707 adding 'colossalai/inference/kv_cache/__init__.py' 2025-01-03T04:44:47,708 adding 'colossalai/inference/kv_cache/block_cache.py' 2025-01-03T04:44:47,711 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2025-01-03T04:44:47,713 adding 'colossalai/inference/modeling/__init__.py' 2025-01-03T04:44:47,715 adding 'colossalai/inference/modeling/backends/__init__.py' 2025-01-03T04:44:47,716 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2025-01-03T04:44:47,718 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2025-01-03T04:44:47,719 adding 'colossalai/inference/modeling/layers/__init__.py' 2025-01-03T04:44:47,721 adding 'colossalai/inference/modeling/layers/attention.py' 2025-01-03T04:44:47,722 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2025-01-03T04:44:47,724 adding 'colossalai/inference/modeling/layers/diffusion.py' 2025-01-03T04:44:47,727 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2025-01-03T04:44:47,729 adding 'colossalai/inference/modeling/models/__init__.py' 2025-01-03T04:44:47,732 adding 'colossalai/inference/modeling/models/glide_llama.py' 2025-01-03T04:44:47,734 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2025-01-03T04:44:47,737 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2025-01-03T04:44:47,739 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2025-01-03T04:44:47,741 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2025-01-03T04:44:47,742 adding 'colossalai/inference/modeling/policy/__init__.py' 2025-01-03T04:44:47,744 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2025-01-03T04:44:47,745 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2025-01-03T04:44:47,747 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2025-01-03T04:44:47,748 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2025-01-03T04:44:47,750 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2025-01-03T04:44:47,751 adding 'colossalai/inference/server/__init__.py' 2025-01-03T04:44:47,753 adding 'colossalai/inference/server/api_server.py' 2025-01-03T04:44:47,755 adding 'colossalai/inference/server/chat_service.py' 2025-01-03T04:44:47,756 adding 'colossalai/inference/server/completion_service.py' 2025-01-03T04:44:47,757 adding 'colossalai/inference/server/utils.py' 2025-01-03T04:44:47,758 adding 'colossalai/inference/spec/__init__.py' 2025-01-03T04:44:47,760 adding 'colossalai/inference/spec/drafter.py' 2025-01-03T04:44:47,761 adding 'colossalai/inference/spec/struct.py' 2025-01-03T04:44:47,763 adding 'colossalai/interface/__init__.py' 2025-01-03T04:44:47,764 adding 'colossalai/interface/model.py' 2025-01-03T04:44:47,766 adding 'colossalai/interface/optimizer.py' 2025-01-03T04:44:47,767 adding 'colossalai/interface/pretrained.py' 2025-01-03T04:44:47,769 adding 'colossalai/kernel/__init__.py' 2025-01-03T04:44:47,770 adding 'colossalai/kernel/kernel_loader.py' 2025-01-03T04:44:47,772 adding 'colossalai/kernel/extensions/__init__.py' 2025-01-03T04:44:47,773 adding 'colossalai/kernel/extensions/base_extension.py' 2025-01-03T04:44:47,775 adding 'colossalai/kernel/extensions/cpp_extension.py' 2025-01-03T04:44:47,776 adding 'colossalai/kernel/extensions/cuda_extension.py' 2025-01-03T04:44:47,778 adding 'colossalai/kernel/extensions/triton_extension.py' 2025-01-03T04:44:47,779 adding 'colossalai/kernel/extensions/utils.py' 2025-01-03T04:44:47,781 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2025-01-03T04:44:47,783 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2025-01-03T04:44:47,785 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2025-01-03T04:44:47,786 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2025-01-03T04:44:47,787 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2025-01-03T04:44:47,789 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2025-01-03T04:44:47,791 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2025-01-03T04:44:47,793 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2025-01-03T04:44:47,795 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2025-01-03T04:44:47,796 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2025-01-03T04:44:47,798 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2025-01-03T04:44:47,800 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2025-01-03T04:44:47,802 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2025-01-03T04:44:47,804 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2025-01-03T04:44:47,806 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2025-01-03T04:44:47,810 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2025-01-03T04:44:47,812 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2025-01-03T04:44:47,816 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2025-01-03T04:44:47,818 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2025-01-03T04:44:47,820 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2025-01-03T04:44:47,823 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2025-01-03T04:44:47,826 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2025-01-03T04:44:47,828 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2025-01-03T04:44:47,829 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2025-01-03T04:44:47,831 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2025-01-03T04:44:47,833 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2025-01-03T04:44:47,835 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2025-01-03T04:44:47,836 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2025-01-03T04:44:47,838 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2025-01-03T04:44:47,841 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2025-01-03T04:44:47,843 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2025-01-03T04:44:47,845 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2025-01-03T04:44:47,847 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2025-01-03T04:44:47,848 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2025-01-03T04:44:47,850 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2025-01-03T04:44:47,851 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2025-01-03T04:44:47,854 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2025-01-03T04:44:47,856 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2025-01-03T04:44:47,857 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2025-01-03T04:44:47,859 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2025-01-03T04:44:47,860 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-01-03T04:44:47,861 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-01-03T04:44:47,863 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2025-01-03T04:44:47,864 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-01-03T04:44:47,866 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2025-01-03T04:44:47,867 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-01-03T04:44:47,869 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2025-01-03T04:44:47,870 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2025-01-03T04:44:47,871 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2025-01-03T04:44:47,873 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2025-01-03T04:44:47,874 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2025-01-03T04:44:47,876 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2025-01-03T04:44:47,877 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2025-01-03T04:44:47,878 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2025-01-03T04:44:47,880 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2025-01-03T04:44:47,881 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2025-01-03T04:44:47,883 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-01-03T04:44:47,884 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2025-01-03T04:44:47,886 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2025-01-03T04:44:47,887 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2025-01-03T04:44:47,888 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-01-03T04:44:47,890 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2025-01-03T04:44:47,891 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-01-03T04:44:47,892 adding 'colossalai/kernel/jit/__init__.py' 2025-01-03T04:44:47,894 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2025-01-03T04:44:47,895 adding 'colossalai/kernel/jit/bias_gelu.py' 2025-01-03T04:44:47,896 adding 'colossalai/kernel/jit/option.py' 2025-01-03T04:44:47,898 adding 'colossalai/kernel/triton/__init__.py' 2025-01-03T04:44:47,900 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2025-01-03T04:44:47,903 adding 'colossalai/kernel/triton/flash_decoding.py' 2025-01-03T04:44:47,904 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2025-01-03T04:44:47,906 adding 'colossalai/kernel/triton/kvcache_copy.py' 2025-01-03T04:44:47,908 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2025-01-03T04:44:47,910 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2025-01-03T04:44:47,912 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2025-01-03T04:44:47,914 adding 'colossalai/kernel/triton/rms_layernorm.py' 2025-01-03T04:44:47,915 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2025-01-03T04:44:47,916 adding 'colossalai/kernel/triton/softmax.py' 2025-01-03T04:44:47,918 adding 'colossalai/lazy/__init__.py' 2025-01-03T04:44:47,919 adding 'colossalai/lazy/construction.py' 2025-01-03T04:44:47,922 adding 'colossalai/lazy/lazy_init.py' 2025-01-03T04:44:47,925 adding 'colossalai/lazy/pretrained.py' 2025-01-03T04:44:47,926 adding 'colossalai/legacy/__init__.py' 2025-01-03T04:44:47,928 adding 'colossalai/legacy/constants.py' 2025-01-03T04:44:47,929 adding 'colossalai/legacy/core.py' 2025-01-03T04:44:47,930 adding 'colossalai/legacy/global_variables.py' 2025-01-03T04:44:47,933 adding 'colossalai/legacy/initialize.py' 2025-01-03T04:44:47,935 adding 'colossalai/legacy/amp/__init__.py' 2025-01-03T04:44:47,936 adding 'colossalai/legacy/amp/amp_type.py' 2025-01-03T04:44:47,937 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2025-01-03T04:44:47,939 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2025-01-03T04:44:47,941 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2025-01-03T04:44:47,943 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2025-01-03T04:44:47,944 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2025-01-03T04:44:47,946 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2025-01-03T04:44:47,947 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2025-01-03T04:44:47,951 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2025-01-03T04:44:47,952 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2025-01-03T04:44:47,954 adding 'colossalai/legacy/builder/__init__.py' 2025-01-03T04:44:47,955 adding 'colossalai/legacy/builder/builder.py' 2025-01-03T04:44:47,957 adding 'colossalai/legacy/communication/__init__.py' 2025-01-03T04:44:47,959 adding 'colossalai/legacy/communication/collective.py' 2025-01-03T04:44:47,961 adding 'colossalai/legacy/communication/p2p.py' 2025-01-03T04:44:47,963 adding 'colossalai/legacy/communication/p2p_v2.py' 2025-01-03T04:44:47,964 adding 'colossalai/legacy/communication/ring.py' 2025-01-03T04:44:47,966 adding 'colossalai/legacy/communication/utils.py' 2025-01-03T04:44:47,967 adding 'colossalai/legacy/context/__init__.py' 2025-01-03T04:44:47,970 adding 'colossalai/legacy/context/parallel_context.py' 2025-01-03T04:44:47,972 adding 'colossalai/legacy/context/parallel_mode.py' 2025-01-03T04:44:47,973 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2025-01-03T04:44:47,975 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2025-01-03T04:44:47,976 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2025-01-03T04:44:47,978 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2025-01-03T04:44:47,980 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2025-01-03T04:44:47,981 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2025-01-03T04:44:47,982 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2025-01-03T04:44:47,983 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2025-01-03T04:44:47,985 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2025-01-03T04:44:47,986 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2025-01-03T04:44:47,987 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2025-01-03T04:44:47,989 adding 'colossalai/legacy/context/random/__init__.py' 2025-01-03T04:44:47,990 adding 'colossalai/legacy/context/random/_helper.py' 2025-01-03T04:44:47,991 adding 'colossalai/legacy/context/random/seed_manager.py' 2025-01-03T04:44:47,993 adding 'colossalai/legacy/engine/__init__.py' 2025-01-03T04:44:47,995 adding 'colossalai/legacy/engine/_base_engine.py' 2025-01-03T04:44:47,996 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2025-01-03T04:44:47,998 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2025-01-03T04:44:48,000 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2025-01-03T04:44:48,001 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2025-01-03T04:44:48,002 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2025-01-03T04:44:48,004 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2025-01-03T04:44:48,005 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2025-01-03T04:44:48,006 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2025-01-03T04:44:48,007 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2025-01-03T04:44:48,009 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2025-01-03T04:44:48,010 adding 'colossalai/legacy/engine/schedule/__init__.py' 2025-01-03T04:44:48,012 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2025-01-03T04:44:48,013 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2025-01-03T04:44:48,017 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2025-01-03T04:44:48,019 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2025-01-03T04:44:48,020 adding 'colossalai/legacy/inference/__init__.py' 2025-01-03T04:44:48,022 adding 'colossalai/legacy/inference/async_engine.py' 2025-01-03T04:44:48,023 adding 'colossalai/legacy/inference/async_manager.py' 2025-01-03T04:44:48,025 adding 'colossalai/legacy/inference/manager.py' 2025-01-03T04:44:48,027 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2025-01-03T04:44:48,028 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2025-01-03T04:44:48,030 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2025-01-03T04:44:48,032 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2025-01-03T04:44:48,034 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2025-01-03T04:44:48,035 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2025-01-03T04:44:48,036 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2025-01-03T04:44:48,038 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2025-01-03T04:44:48,039 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2025-01-03T04:44:48,041 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2025-01-03T04:44:48,043 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2025-01-03T04:44:48,045 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2025-01-03T04:44:48,046 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2025-01-03T04:44:48,049 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2025-01-03T04:44:48,050 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2025-01-03T04:44:48,052 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2025-01-03T04:44:48,053 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2025-01-03T04:44:48,055 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2025-01-03T04:44:48,056 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2025-01-03T04:44:48,058 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2025-01-03T04:44:48,060 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2025-01-03T04:44:48,062 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2025-01-03T04:44:48,064 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2025-01-03T04:44:48,065 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2025-01-03T04:44:48,068 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2025-01-03T04:44:48,071 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2025-01-03T04:44:48,073 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2025-01-03T04:44:48,075 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2025-01-03T04:44:48,076 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2025-01-03T04:44:48,077 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2025-01-03T04:44:48,079 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2025-01-03T04:44:48,080 adding 'colossalai/legacy/nn/__init__.py' 2025-01-03T04:44:48,082 adding 'colossalai/legacy/nn/_ops/__init__.py' 2025-01-03T04:44:48,084 adding 'colossalai/legacy/nn/_ops/_utils.py' 2025-01-03T04:44:48,085 adding 'colossalai/legacy/nn/layer/__init__.py' 2025-01-03T04:44:48,087 adding 'colossalai/legacy/nn/layer/base_layer.py' 2025-01-03T04:44:48,088 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2025-01-03T04:44:48,090 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2025-01-03T04:44:48,091 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2025-01-03T04:44:48,092 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2025-01-03T04:44:48,094 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2025-01-03T04:44:48,095 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2025-01-03T04:44:48,097 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2025-01-03T04:44:48,098 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2025-01-03T04:44:48,099 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2025-01-03T04:44:48,103 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2025-01-03T04:44:48,105 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2025-01-03T04:44:48,108 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2025-01-03T04:44:48,109 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2025-01-03T04:44:48,113 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2025-01-03T04:44:48,115 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2025-01-03T04:44:48,118 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2025-01-03T04:44:48,119 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2025-01-03T04:44:48,123 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2025-01-03T04:44:48,125 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2025-01-03T04:44:48,127 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2025-01-03T04:44:48,129 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2025-01-03T04:44:48,132 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2025-01-03T04:44:48,134 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2025-01-03T04:44:48,135 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2025-01-03T04:44:48,136 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2025-01-03T04:44:48,138 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2025-01-03T04:44:48,140 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2025-01-03T04:44:48,141 adding 'colossalai/legacy/nn/layer/utils/common.py' 2025-01-03T04:44:48,143 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2025-01-03T04:44:48,145 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2025-01-03T04:44:48,146 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2025-01-03T04:44:48,147 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2025-01-03T04:44:48,149 adding 'colossalai/legacy/nn/loss/__init__.py' 2025-01-03T04:44:48,151 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2025-01-03T04:44:48,152 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2025-01-03T04:44:48,154 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2025-01-03T04:44:48,155 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2025-01-03T04:44:48,157 adding 'colossalai/legacy/nn/metric/__init__.py' 2025-01-03T04:44:48,158 adding 'colossalai/legacy/nn/metric/_utils.py' 2025-01-03T04:44:48,159 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2025-01-03T04:44:48,160 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2025-01-03T04:44:48,162 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2025-01-03T04:44:48,163 adding 'colossalai/legacy/nn/parallel/__init__.py' 2025-01-03T04:44:48,165 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2025-01-03T04:44:48,166 adding 'colossalai/legacy/nn/parallel/reducer.py' 2025-01-03T04:44:48,168 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2025-01-03T04:44:48,169 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2025-01-03T04:44:48,170 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2025-01-03T04:44:48,171 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2025-01-03T04:44:48,173 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2025-01-03T04:44:48,175 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2025-01-03T04:44:48,176 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2025-01-03T04:44:48,179 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2025-01-03T04:44:48,181 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2025-01-03T04:44:48,182 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2025-01-03T04:44:48,184 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2025-01-03T04:44:48,185 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2025-01-03T04:44:48,187 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2025-01-03T04:44:48,188 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2025-01-03T04:44:48,190 adding 'colossalai/legacy/pipeline/__init__.py' 2025-01-03T04:44:48,191 adding 'colossalai/legacy/pipeline/layer_spec.py' 2025-01-03T04:44:48,193 adding 'colossalai/legacy/pipeline/pipelinable.py' 2025-01-03T04:44:48,195 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2025-01-03T04:44:48,197 adding 'colossalai/legacy/pipeline/utils.py' 2025-01-03T04:44:48,198 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2025-01-03T04:44:48,200 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2025-01-03T04:44:48,202 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2025-01-03T04:44:48,203 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2025-01-03T04:44:48,205 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2025-01-03T04:44:48,211 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2025-01-03T04:44:48,214 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2025-01-03T04:44:48,215 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2025-01-03T04:44:48,217 adding 'colossalai/legacy/registry/__init__.py' 2025-01-03T04:44:48,218 adding 'colossalai/legacy/registry/registry.py' 2025-01-03T04:44:48,219 adding 'colossalai/legacy/tensor/__init__.py' 2025-01-03T04:44:48,221 adding 'colossalai/legacy/tensor/compute_spec.py' 2025-01-03T04:44:48,222 adding 'colossalai/legacy/tensor/const.py' 2025-01-03T04:44:48,223 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2025-01-03T04:44:48,224 adding 'colossalai/legacy/tensor/distspec.py' 2025-01-03T04:44:48,226 adding 'colossalai/legacy/tensor/op_wrapper.py' 2025-01-03T04:44:48,227 adding 'colossalai/legacy/tensor/process_group.py' 2025-01-03T04:44:48,228 adding 'colossalai/legacy/tensor/tensor_spec.py' 2025-01-03T04:44:48,230 adding 'colossalai/legacy/trainer/__init__.py' 2025-01-03T04:44:48,232 adding 'colossalai/legacy/trainer/_trainer.py' 2025-01-03T04:44:48,234 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2025-01-03T04:44:48,235 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2025-01-03T04:44:48,236 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2025-01-03T04:44:48,237 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2025-01-03T04:44:48,239 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2025-01-03T04:44:48,240 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2025-01-03T04:44:48,242 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2025-01-03T04:44:48,244 adding 'colossalai/legacy/utils/__init__.py' 2025-01-03T04:44:48,246 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2025-01-03T04:44:48,248 adding 'colossalai/legacy/utils/checkpointing.py' 2025-01-03T04:44:48,250 adding 'colossalai/legacy/utils/common.py' 2025-01-03T04:44:48,252 adding 'colossalai/legacy/utils/memory.py' 2025-01-03T04:44:48,254 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2025-01-03T04:44:48,255 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2025-01-03T04:44:48,256 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2025-01-03T04:44:48,258 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2025-01-03T04:44:48,259 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2025-01-03T04:44:48,261 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2025-01-03T04:44:48,263 adding 'colossalai/legacy/utils/profiler/__init__.py' 2025-01-03T04:44:48,264 adding 'colossalai/legacy/utils/profiler/extention.py' 2025-01-03T04:44:48,266 adding 'colossalai/legacy/utils/profiler/profiler.py' 2025-01-03T04:44:48,267 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2025-01-03T04:44:48,269 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2025-01-03T04:44:48,271 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2025-01-03T04:44:48,273 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2025-01-03T04:44:48,274 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2025-01-03T04:44:48,276 adding 'colossalai/legacy/zero/__init__.py' 2025-01-03T04:44:48,278 adding 'colossalai/legacy/zero/gemini/__init__.py' 2025-01-03T04:44:48,279 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2025-01-03T04:44:48,281 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2025-01-03T04:44:48,282 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2025-01-03T04:44:48,284 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2025-01-03T04:44:48,285 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2025-01-03T04:44:48,287 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2025-01-03T04:44:48,288 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2025-01-03T04:44:48,290 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2025-01-03T04:44:48,291 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2025-01-03T04:44:48,292 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2025-01-03T04:44:48,294 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2025-01-03T04:44:48,295 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2025-01-03T04:44:48,296 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2025-01-03T04:44:48,298 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2025-01-03T04:44:48,300 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2025-01-03T04:44:48,302 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2025-01-03T04:44:48,303 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2025-01-03T04:44:48,304 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2025-01-03T04:44:48,305 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2025-01-03T04:44:48,307 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2025-01-03T04:44:48,308 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2025-01-03T04:44:48,310 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2025-01-03T04:44:48,311 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2025-01-03T04:44:48,315 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2025-01-03T04:44:48,316 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2025-01-03T04:44:48,317 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2025-01-03T04:44:48,319 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2025-01-03T04:44:48,322 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2025-01-03T04:44:48,323 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2025-01-03T04:44:48,325 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2025-01-03T04:44:48,326 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2025-01-03T04:44:48,328 adding 'colossalai/logging/__init__.py' 2025-01-03T04:44:48,329 adding 'colossalai/logging/logger.py' 2025-01-03T04:44:48,331 adding 'colossalai/moe/__init__.py' 2025-01-03T04:44:48,333 adding 'colossalai/moe/_operation.py' 2025-01-03T04:44:48,334 adding 'colossalai/nn/__init__.py' 2025-01-03T04:44:48,336 adding 'colossalai/nn/init.py' 2025-01-03T04:44:48,338 adding 'colossalai/nn/layer/__init__.py' 2025-01-03T04:44:48,339 adding 'colossalai/nn/layer/layernorm.py' 2025-01-03T04:44:48,341 adding 'colossalai/nn/layer/scaled_softmax.py' 2025-01-03T04:44:48,342 adding 'colossalai/nn/layer/utils.py' 2025-01-03T04:44:48,343 adding 'colossalai/nn/loss/__init__.py' 2025-01-03T04:44:48,345 adding 'colossalai/nn/lr_scheduler/__init__.py' 2025-01-03T04:44:48,346 adding 'colossalai/nn/lr_scheduler/cosine.py' 2025-01-03T04:44:48,348 adding 'colossalai/nn/lr_scheduler/delayed.py' 2025-01-03T04:44:48,349 adding 'colossalai/nn/lr_scheduler/linear.py' 2025-01-03T04:44:48,351 adding 'colossalai/nn/lr_scheduler/multistep.py' 2025-01-03T04:44:48,352 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2025-01-03T04:44:48,353 adding 'colossalai/nn/lr_scheduler/poly.py' 2025-01-03T04:44:48,355 adding 'colossalai/nn/lr_scheduler/torch.py' 2025-01-03T04:44:48,357 adding 'colossalai/nn/optimizer/__init__.py' 2025-01-03T04:44:48,358 adding 'colossalai/nn/optimizer/adafactor.py' 2025-01-03T04:44:48,360 adding 'colossalai/nn/optimizer/came.py' 2025-01-03T04:44:48,362 adding 'colossalai/nn/optimizer/cpu_adam.py' 2025-01-03T04:44:48,365 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2025-01-03T04:44:48,368 adding 'colossalai/nn/optimizer/distributed_came.py' 2025-01-03T04:44:48,370 adding 'colossalai/nn/optimizer/distributed_galore.py' 2025-01-03T04:44:48,372 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2025-01-03T04:44:48,374 adding 'colossalai/nn/optimizer/fused_adam.py' 2025-01-03T04:44:48,376 adding 'colossalai/nn/optimizer/fused_lamb.py' 2025-01-03T04:44:48,377 adding 'colossalai/nn/optimizer/fused_sgd.py' 2025-01-03T04:44:48,379 adding 'colossalai/nn/optimizer/galore.py' 2025-01-03T04:44:48,381 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2025-01-03T04:44:48,382 adding 'colossalai/nn/optimizer/lamb.py' 2025-01-03T04:44:48,384 adding 'colossalai/nn/optimizer/lars.py' 2025-01-03T04:44:48,385 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2025-01-03T04:44:48,387 adding 'colossalai/pipeline/__init__.py' 2025-01-03T04:44:48,390 adding 'colossalai/pipeline/p2p.py' 2025-01-03T04:44:48,392 adding 'colossalai/pipeline/stage_manager.py' 2025-01-03T04:44:48,393 adding 'colossalai/pipeline/weight_grad_store.py' 2025-01-03T04:44:48,395 adding 'colossalai/pipeline/schedule/__init__.py' 2025-01-03T04:44:48,396 adding 'colossalai/pipeline/schedule/_utils.py' 2025-01-03T04:44:48,398 adding 'colossalai/pipeline/schedule/base.py' 2025-01-03T04:44:48,400 adding 'colossalai/pipeline/schedule/generate.py' 2025-01-03T04:44:48,403 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2025-01-03T04:44:48,405 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2025-01-03T04:44:48,407 adding 'colossalai/pipeline/schedule/v_schedule.py' 2025-01-03T04:44:48,411 adding 'colossalai/pipeline/schedule/zero_bubble_pp.py' 2025-01-03T04:44:48,413 adding 'colossalai/quantization/__init__.py' 2025-01-03T04:44:48,415 adding 'colossalai/quantization/bnb.py' 2025-01-03T04:44:48,417 adding 'colossalai/quantization/bnb_config.py' 2025-01-03T04:44:48,420 adding 'colossalai/quantization/fp8.py' 2025-01-03T04:44:48,422 adding 'colossalai/quantization/fp8_config.py' 2025-01-03T04:44:48,423 adding 'colossalai/quantization/fp8_hook.py' 2025-01-03T04:44:48,424 adding 'colossalai/quantization/utils.py' 2025-01-03T04:44:48,426 adding 'colossalai/shardformer/__init__.py' 2025-01-03T04:44:48,427 adding 'colossalai/shardformer/_utils.py' 2025-01-03T04:44:48,429 adding 'colossalai/shardformer/layer/__init__.py' 2025-01-03T04:44:48,434 adding 'colossalai/shardformer/layer/_operation.py' 2025-01-03T04:44:48,439 adding 'colossalai/shardformer/layer/attn.py' 2025-01-03T04:44:48,441 adding 'colossalai/shardformer/layer/dropout.py' 2025-01-03T04:44:48,443 adding 'colossalai/shardformer/layer/embedding.py' 2025-01-03T04:44:48,446 adding 'colossalai/shardformer/layer/linear.py' 2025-01-03T04:44:48,448 adding 'colossalai/shardformer/layer/loss.py' 2025-01-03T04:44:48,450 adding 'colossalai/shardformer/layer/normalization.py' 2025-01-03T04:44:48,451 adding 'colossalai/shardformer/layer/parallel_module.py' 2025-01-03T04:44:48,455 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2025-01-03T04:44:48,458 adding 'colossalai/shardformer/layer/utils.py' 2025-01-03T04:44:48,460 adding 'colossalai/shardformer/modeling/__init__.py' 2025-01-03T04:44:48,464 adding 'colossalai/shardformer/modeling/bert.py' 2025-01-03T04:44:48,466 adding 'colossalai/shardformer/modeling/blip2.py' 2025-01-03T04:44:48,470 adding 'colossalai/shardformer/modeling/bloom.py' 2025-01-03T04:44:48,473 adding 'colossalai/shardformer/modeling/chatglm2.py' 2025-01-03T04:44:48,476 adding 'colossalai/shardformer/modeling/command.py' 2025-01-03T04:44:48,480 adding 'colossalai/shardformer/modeling/deepseek.py' 2025-01-03T04:44:48,484 adding 'colossalai/shardformer/modeling/falcon.py' 2025-01-03T04:44:48,488 adding 'colossalai/shardformer/modeling/gpt2.py' 2025-01-03T04:44:48,492 adding 'colossalai/shardformer/modeling/gptj.py' 2025-01-03T04:44:48,493 adding 'colossalai/shardformer/modeling/jit.py' 2025-01-03T04:44:48,496 adding 'colossalai/shardformer/modeling/llama.py' 2025-01-03T04:44:48,499 adding 'colossalai/shardformer/modeling/mistral.py' 2025-01-03T04:44:48,504 adding 'colossalai/shardformer/modeling/mixtral.py' 2025-01-03T04:44:48,508 adding 'colossalai/shardformer/modeling/opt.py' 2025-01-03T04:44:48,511 adding 'colossalai/shardformer/modeling/qwen2.py' 2025-01-03T04:44:48,513 adding 'colossalai/shardformer/modeling/sam.py' 2025-01-03T04:44:48,517 adding 'colossalai/shardformer/modeling/t5.py' 2025-01-03T04:44:48,519 adding 'colossalai/shardformer/modeling/vit.py' 2025-01-03T04:44:48,524 adding 'colossalai/shardformer/modeling/whisper.py' 2025-01-03T04:44:48,526 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2025-01-03T04:44:48,528 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2025-01-03T04:44:48,534 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2025-01-03T04:44:48,536 adding 'colossalai/shardformer/policies/__init__.py' 2025-01-03T04:44:48,538 adding 'colossalai/shardformer/policies/auto_policy.py' 2025-01-03T04:44:48,540 adding 'colossalai/shardformer/policies/base_policy.py' 2025-01-03T04:44:48,543 adding 'colossalai/shardformer/policies/bert.py' 2025-01-03T04:44:48,546 adding 'colossalai/shardformer/policies/blip2.py' 2025-01-03T04:44:48,548 adding 'colossalai/shardformer/policies/bloom.py' 2025-01-03T04:44:48,551 adding 'colossalai/shardformer/policies/chatglm2.py' 2025-01-03T04:44:48,553 adding 'colossalai/shardformer/policies/command.py' 2025-01-03T04:44:48,556 adding 'colossalai/shardformer/policies/deepseek.py' 2025-01-03T04:44:48,558 adding 'colossalai/shardformer/policies/falcon.py' 2025-01-03T04:44:48,562 adding 'colossalai/shardformer/policies/gpt2.py' 2025-01-03T04:44:48,565 adding 'colossalai/shardformer/policies/gptj.py' 2025-01-03T04:44:48,568 adding 'colossalai/shardformer/policies/llama.py' 2025-01-03T04:44:48,571 adding 'colossalai/shardformer/policies/mistral.py' 2025-01-03T04:44:48,573 adding 'colossalai/shardformer/policies/mixtral.py' 2025-01-03T04:44:48,575 adding 'colossalai/shardformer/policies/opt.py' 2025-01-03T04:44:48,577 adding 'colossalai/shardformer/policies/qwen2.py' 2025-01-03T04:44:48,579 adding 'colossalai/shardformer/policies/sam.py' 2025-01-03T04:44:48,582 adding 'colossalai/shardformer/policies/t5.py' 2025-01-03T04:44:48,585 adding 'colossalai/shardformer/policies/vit.py' 2025-01-03T04:44:48,588 adding 'colossalai/shardformer/policies/whisper.py' 2025-01-03T04:44:48,590 adding 'colossalai/shardformer/shard/__init__.py' 2025-01-03T04:44:48,592 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2025-01-03T04:44:48,594 adding 'colossalai/shardformer/shard/shard_config.py' 2025-01-03T04:44:48,596 adding 'colossalai/shardformer/shard/sharder.py' 2025-01-03T04:44:48,598 adding 'colossalai/shardformer/shard/shardformer.py' 2025-01-03T04:44:48,599 adding 'colossalai/shardformer/shard/utils.py' 2025-01-03T04:44:48,601 adding 'colossalai/tensor/__init__.py' 2025-01-03T04:44:48,602 adding 'colossalai/tensor/colo_parameter.py' 2025-01-03T04:44:48,604 adding 'colossalai/tensor/colo_tensor.py' 2025-01-03T04:44:48,606 adding 'colossalai/tensor/comm_spec.py' 2025-01-03T04:44:48,608 adding 'colossalai/tensor/param_op_hook.py' 2025-01-03T04:44:48,611 adding 'colossalai/tensor/shape_consistency.py' 2025-01-03T04:44:48,613 adding 'colossalai/tensor/sharding_spec.py' 2025-01-03T04:44:48,615 adding 'colossalai/tensor/utils.py' 2025-01-03T04:44:48,618 adding 'colossalai/tensor/d_tensor/__init__.py' 2025-01-03T04:44:48,620 adding 'colossalai/tensor/d_tensor/api.py' 2025-01-03T04:44:48,621 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2025-01-03T04:44:48,623 adding 'colossalai/tensor/d_tensor/layout.py' 2025-01-03T04:44:48,626 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2025-01-03T04:44:48,628 adding 'colossalai/tensor/d_tensor/misc.py' 2025-01-03T04:44:48,629 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2025-01-03T04:44:48,631 adding 'colossalai/tensor/d_tensor/utils.py' 2025-01-03T04:44:48,633 adding 'colossalai/tensor/moe_tensor/__init__.py' 2025-01-03T04:44:48,635 adding 'colossalai/tensor/moe_tensor/api.py' 2025-01-03T04:44:48,636 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2025-01-03T04:44:48,639 adding 'colossalai/tensor/padded_tensor/__init__.py' 2025-01-03T04:44:48,640 adding 'colossalai/tensor/padded_tensor/api.py' 2025-01-03T04:44:48,642 adding 'colossalai/testing/__init__.py' 2025-01-03T04:44:48,644 adding 'colossalai/testing/comparison.py' 2025-01-03T04:44:48,645 adding 'colossalai/testing/pytest_wrapper.py' 2025-01-03T04:44:48,646 adding 'colossalai/testing/random.py' 2025-01-03T04:44:48,648 adding 'colossalai/testing/utils.py' 2025-01-03T04:44:48,650 adding 'colossalai/utils/__init__.py' 2025-01-03T04:44:48,652 adding 'colossalai/utils/common.py' 2025-01-03T04:44:48,653 adding 'colossalai/utils/memory.py' 2025-01-03T04:44:48,655 adding 'colossalai/utils/safetensors.py' 2025-01-03T04:44:48,657 adding 'colossalai/utils/timer.py' 2025-01-03T04:44:48,658 adding 'colossalai/utils/model/__init__.py' 2025-01-03T04:44:48,659 adding 'colossalai/utils/model/utils.py' 2025-01-03T04:44:48,661 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2025-01-03T04:44:48,663 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2025-01-03T04:44:48,664 adding 'colossalai/utils/rank_recorder/__init__.py' 2025-01-03T04:44:48,666 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2025-01-03T04:44:48,667 adding 'colossalai/utils/tensor_detector/__init__.py' 2025-01-03T04:44:48,669 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2025-01-03T04:44:48,670 adding 'colossalai/zero/__init__.py' 2025-01-03T04:44:48,672 adding 'colossalai/zero/wrapper.py' 2025-01-03T04:44:48,673 adding 'colossalai/zero/gemini/__init__.py' 2025-01-03T04:44:48,678 adding 'colossalai/zero/gemini/gemini_ddp.py' 2025-01-03T04:44:48,680 adding 'colossalai/zero/gemini/gemini_hook.py' 2025-01-03T04:44:48,681 adding 'colossalai/zero/gemini/gemini_mgr.py' 2025-01-03T04:44:48,686 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2025-01-03T04:44:48,688 adding 'colossalai/zero/gemini/placement_policy.py' 2025-01-03T04:44:48,689 adding 'colossalai/zero/gemini/utils.py' 2025-01-03T04:44:48,691 adding 'colossalai/zero/gemini/chunk/__init__.py' 2025-01-03T04:44:48,694 adding 'colossalai/zero/gemini/chunk/chunk.py' 2025-01-03T04:44:48,696 adding 'colossalai/zero/gemini/chunk/manager.py' 2025-01-03T04:44:48,698 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2025-01-03T04:44:48,699 adding 'colossalai/zero/gemini/chunk/utils.py' 2025-01-03T04:44:48,701 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2025-01-03T04:44:48,702 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2025-01-03T04:44:48,704 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2025-01-03T04:44:48,706 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2025-01-03T04:44:48,707 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2025-01-03T04:44:48,708 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2025-01-03T04:44:48,710 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2025-01-03T04:44:48,711 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2025-01-03T04:44:48,712 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2025-01-03T04:44:48,714 adding 'colossalai/zero/low_level/__init__.py' 2025-01-03T04:44:48,716 adding 'colossalai/zero/low_level/_utils.py' 2025-01-03T04:44:48,721 adding 'colossalai/zero/low_level/low_level_optim.py' 2025-01-03T04:44:48,722 adding 'colossalai/zero/low_level/zero_hook.py' 2025-01-03T04:44:48,724 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2025-01-03T04:44:48,726 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2025-01-03T04:44:48,727 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2025-01-03T04:44:48,728 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2025-01-03T04:44:48,730 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2025-01-03T04:44:48,733 adding 'extensions/csrc/__init__.py' 2025-01-03T04:44:48,734 adding 'extensions/pybind/__init__.py' 2025-01-03T04:44:48,736 adding 'extensions/pybind/cpu_adam/__init__.py' 2025-01-03T04:44:48,737 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-01-03T04:44:48,738 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-01-03T04:44:48,740 adding 'extensions/pybind/flash_attention/__init__.py' 2025-01-03T04:44:48,742 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-01-03T04:44:48,743 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2025-01-03T04:44:48,744 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-01-03T04:44:48,746 adding 'extensions/pybind/inference/__init__.py' 2025-01-03T04:44:48,747 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2025-01-03T04:44:48,749 adding 'extensions/pybind/layernorm/__init__.py' 2025-01-03T04:44:48,750 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2025-01-03T04:44:48,751 adding 'extensions/pybind/moe/__init__.py' 2025-01-03T04:44:48,752 adding 'extensions/pybind/moe/moe_cuda.py' 2025-01-03T04:44:48,754 adding 'extensions/pybind/optimizer/__init__.py' 2025-01-03T04:44:48,755 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-01-03T04:44:48,757 adding 'extensions/pybind/softmax/__init__.py' 2025-01-03T04:44:48,758 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-01-03T04:44:48,759 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-01-03T04:44:48,762 adding 'colossalai-0.4.7.dist-info/LICENSE' 2025-01-03T04:44:48,766 adding 'colossalai-0.4.7.dist-info/METADATA' 2025-01-03T04:44:48,767 adding 'colossalai-0.4.7.dist-info/WHEEL' 2025-01-03T04:44:48,768 adding 'colossalai-0.4.7.dist-info/entry_points.txt' 2025-01-03T04:44:48,769 adding 'colossalai-0.4.7.dist-info/top_level.txt' 2025-01-03T04:44:48,784 adding 'colossalai-0.4.7.dist-info/RECORD' 2025-01-03T04:44:48,811 removing build/bdist.linux-armv7l/wheel 2025-01-03T04:44:49,400 Building wheel for colossalai (setup.py): finished with status 'done' 2025-01-03T04:44:49,429 Created wheel for colossalai: filename=colossalai-0.4.7-py3-none-any.whl size=1614212 sha256=f8ebf35db2ba7317fd8a9aa6c8786fea97acce4e40f7462775aa9e18fe0480ba 2025-01-03T04:44:49,431 Stored in directory: /tmp/pip-ephem-wheel-cache-q_7j7mqi/wheels/b6/95/90/747aa1b1edbdd43d56cd0fe6a4fc8bea4b36dff977ce233080 2025-01-03T04:44:49,489 Successfully built colossalai 2025-01-03T04:44:49,541 Removed build tracker: '/tmp/pip-build-tracker-8k1wcg4v'