2025-03-03T09:14:22,015 Created temporary directory: /tmp/pip-build-tracker-ljn_kcuf 2025-03-03T09:14:22,016 Initialized build tracking at /tmp/pip-build-tracker-ljn_kcuf 2025-03-03T09:14:22,017 Created build tracker: /tmp/pip-build-tracker-ljn_kcuf 2025-03-03T09:14:22,017 Entered build tracker: /tmp/pip-build-tracker-ljn_kcuf 2025-03-03T09:14:22,018 Created temporary directory: /tmp/pip-wheel-f7hab0_a 2025-03-03T09:14:22,022 Created temporary directory: /tmp/pip-ephem-wheel-cache-70miqlyo 2025-03-03T09:14:22,067 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-03-03T09:14:22,070 2 location(s) to search for versions of colossalai: 2025-03-03T09:14:22,070 * https://pypi.org/simple/colossalai/ 2025-03-03T09:14:22,070 * https://www.piwheels.org/simple/colossalai/ 2025-03-03T09:14:22,071 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2025-03-03T09:14:22,071 Getting page https://pypi.org/simple/colossalai/ 2025-03-03T09:14:22,073 Found index url https://pypi.org/simple/ 2025-03-03T09:14:22,299 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2025-03-03T09:14:22,306 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2025-03-03T09:14:22,307 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2025-03-03T09:14:22,308 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2025-03-03T09:14:22,309 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2025-03-03T09:14:22,310 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2025-03-03T09:14:22,311 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2025-03-03T09:14:22,312 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2025-03-03T09:14:22,313 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2025-03-03T09:14:22,314 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2025-03-03T09:14:22,315 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2025-03-03T09:14:22,316 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2025-03-03T09:14:22,317 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2025-03-03T09:14:22,318 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2025-03-03T09:14:22,319 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2025-03-03T09:14:22,320 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2025-03-03T09:14:22,321 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2025-03-03T09:14:22,322 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2025-03-03T09:14:22,323 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2025-03-03T09:14:22,324 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2025-03-03T09:14:22,325 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2025-03-03T09:14:22,326 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2025-03-03T09:14:22,326 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2025-03-03T09:14:22,327 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2025-03-03T09:14:22,328 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2025-03-03T09:14:22,330 Found link https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.5 2025-03-03T09:14:22,330 Found link https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.6 2025-03-03T09:14:22,331 Found link https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.7 2025-03-03T09:14:22,332 Found link https://files.pythonhosted.org/packages/15/b3/ef0726bd75bd9348e004a0ae1f4944a747a54f269bf8012dabc9ef129195/colossalai-0.4.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.8 2025-03-03T09:14:22,333 Found link https://files.pythonhosted.org/packages/56/60/cadb87dd24034f283479e85b092883000fddc2ac3bdb31cc5c1568d7c7c3/colossalai-0.4.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.9 2025-03-03T09:14:22,334 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2025-03-03T09:14:22,335 Getting page https://www.piwheels.org/simple/colossalai/ 2025-03-03T09:14:22,336 Found index url https://www.piwheels.org/simple/ 2025-03-03T09:14:22,505 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2025-03-03T09:14:22,513 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.8-py3-none-any.whl#sha256=6d7c2647635a1f730bc800fa155d205d6b32b3bf67cf251567751416a518d537 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,514 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.7-py3-none-any.whl#sha256=f8ebf35db2ba7317fd8a9aa6c8786fea97acce4e40f7462775aa9e18fe0480ba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,515 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.6-py3-none-any.whl#sha256=ce3ac15dc7fb8d7f59a20837e206ffc2cfb5a8c4b716a00905cf50687aa8676b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,515 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.5-py3-none-any.whl#sha256=f94d4dad77d236b0cc6ea08c8a0016d2cd518bc546095a9e65c47fe4486cacfb (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,515 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.4-py3-none-any.whl#sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,516 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,517 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,517 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,518 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,519 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,519 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,520 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,520 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,521 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,522 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,522 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,522 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,523 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,523 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,524 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,525 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,525 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,526 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,526 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,527 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,528 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,528 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,529 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-03-03T09:14:22,530 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2025-03-03T09:14:22,530 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2025-03-03T09:14:22,552 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2025-03-03T09:14:22,554 Collecting colossalai==0.4.9 2025-03-03T09:14:22,557 Created temporary directory: /tmp/pip-unpack-wuxz7un1 2025-03-03T09:14:22,775 Downloading colossalai-0.4.9.tar.gz (1.4 MB) 2025-03-03T09:14:25,219 Added colossalai==0.4.9 from https://files.pythonhosted.org/packages/56/60/cadb87dd24034f283479e85b092883000fddc2ac3bdb31cc5c1568d7c7c3/colossalai-0.4.9.tar.gz to build tracker '/tmp/pip-build-tracker-ljn_kcuf' 2025-03-03T09:14:25,220 Running setup.py (path:/tmp/pip-wheel-f7hab0_a/colossalai_fe7cf2b339a746c78c9965e67a12db32/setup.py) egg_info for package colossalai 2025-03-03T09:14:25,221 Created temporary directory: /tmp/pip-pip-egg-info-sr4inqgq 2025-03-03T09:14:25,222 Preparing metadata (setup.py): started 2025-03-03T09:14:25,223 Running command python setup.py egg_info 2025-03-03T09:14:26,401 running egg_info 2025-03-03T09:14:26,429 creating /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info 2025-03-03T09:14:26,430 writing /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/PKG-INFO 2025-03-03T09:14:26,435 writing dependency_links to /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/dependency_links.txt 2025-03-03T09:14:26,436 writing entry points to /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/entry_points.txt 2025-03-03T09:14:26,438 writing requirements to /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/requires.txt 2025-03-03T09:14:26,439 writing top-level names to /tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/top_level.txt 2025-03-03T09:14:26,441 writing manifest file '/tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/SOURCES.txt' 2025-03-03T09:14:26,741 reading manifest file '/tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/SOURCES.txt' 2025-03-03T09:14:26,743 reading manifest template 'MANIFEST.in' 2025-03-03T09:14:28,104 warning: no files found matching '*.tr' under directory 'colossalai' 2025-03-03T09:14:28,773 warning: no files found matching '*.cc' under directory 'colossalai' 2025-03-03T09:14:29,105 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-03-03T09:14:29,252 warning: no files found matching '*.tr' under directory 'extensions' 2025-03-03T09:14:29,311 warning: no files found matching '*.cc' under directory 'extensions' 2025-03-03T09:14:29,340 warning: no files found matching '*.pyi' under directory 'extensions' 2025-03-03T09:14:29,341 adding license file 'LICENSE' 2025-03-03T09:14:29,377 writing manifest file '/tmp/pip-pip-egg-info-sr4inqgq/colossalai.egg-info/SOURCES.txt' 2025-03-03T09:14:29,489 Preparing metadata (setup.py): finished with status 'done' 2025-03-03T09:14:29,495 Source in /tmp/pip-wheel-f7hab0_a/colossalai_fe7cf2b339a746c78c9965e67a12db32 has version 0.4.9, which satisfies requirement colossalai==0.4.9 from https://files.pythonhosted.org/packages/56/60/cadb87dd24034f283479e85b092883000fddc2ac3bdb31cc5c1568d7c7c3/colossalai-0.4.9.tar.gz 2025-03-03T09:14:29,496 Removed colossalai==0.4.9 from https://files.pythonhosted.org/packages/56/60/cadb87dd24034f283479e85b092883000fddc2ac3bdb31cc5c1568d7c7c3/colossalai-0.4.9.tar.gz from build tracker '/tmp/pip-build-tracker-ljn_kcuf' 2025-03-03T09:14:29,511 Created temporary directory: /tmp/pip-unpack-njzzimyw 2025-03-03T09:14:29,512 Created temporary directory: /tmp/pip-unpack-jej0qgos 2025-03-03T09:14:29,513 Building wheels for collected packages: colossalai 2025-03-03T09:14:29,517 Created temporary directory: /tmp/pip-wheel-u637sidc 2025-03-03T09:14:29,517 Building wheel for colossalai (setup.py): started 2025-03-03T09:14:29,518 Destination directory: /tmp/pip-wheel-u637sidc 2025-03-03T09:14:29,519 Running command python setup.py bdist_wheel 2025-03-03T09:14:30,640 running bdist_wheel 2025-03-03T09:14:30,772 running build 2025-03-03T09:14:30,772 running build_py 2025-03-03T09:14:30,802 creating build/lib/colossalai 2025-03-03T09:14:30,804 copying colossalai/initialize.py -> build/lib/colossalai 2025-03-03T09:14:30,807 copying colossalai/__init__.py -> build/lib/colossalai 2025-03-03T09:14:30,809 copying colossalai/version.py -> build/lib/colossalai 2025-03-03T09:14:30,811 creating build/lib/colossalai/booster 2025-03-03T09:14:30,812 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2025-03-03T09:14:30,814 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2025-03-03T09:14:30,817 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2025-03-03T09:14:30,824 creating build/lib/colossalai/_C 2025-03-03T09:14:30,825 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2025-03-03T09:14:30,827 creating build/lib/colossalai/nn 2025-03-03T09:14:30,828 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2025-03-03T09:14:30,830 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2025-03-03T09:14:30,833 creating build/lib/colossalai/auto_parallel 2025-03-03T09:14:30,834 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2025-03-03T09:14:30,836 creating build/lib/colossalai/amp 2025-03-03T09:14:30,837 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2025-03-03T09:14:30,839 creating build/lib/colossalai/shardformer 2025-03-03T09:14:30,840 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2025-03-03T09:14:30,842 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2025-03-03T09:14:30,845 creating build/lib/colossalai/inference 2025-03-03T09:14:30,847 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,849 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,851 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,854 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,856 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,858 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,860 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,863 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,865 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2025-03-03T09:14:30,868 creating build/lib/colossalai/quantization 2025-03-03T09:14:30,869 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,871 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,874 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,876 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,883 copying colossalai/quantization/fp8_config.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,884 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,887 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2025-03-03T09:14:30,889 creating build/lib/colossalai/interface 2025-03-03T09:14:30,890 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2025-03-03T09:14:30,893 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2025-03-03T09:14:30,895 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2025-03-03T09:14:30,897 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2025-03-03T09:14:30,899 creating build/lib/colossalai/_analyzer 2025-03-03T09:14:30,900 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2025-03-03T09:14:30,902 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2025-03-03T09:14:30,904 creating build/lib/colossalai/moe 2025-03-03T09:14:30,905 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2025-03-03T09:14:30,907 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2025-03-03T09:14:30,910 creating build/lib/colossalai/cluster 2025-03-03T09:14:30,911 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2025-03-03T09:14:30,913 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2025-03-03T09:14:30,915 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2025-03-03T09:14:30,916 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2025-03-03T09:14:30,919 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2025-03-03T09:14:30,921 creating build/lib/colossalai/accelerator 2025-03-03T09:14:30,923 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,925 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,927 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,929 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,931 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,934 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2025-03-03T09:14:30,936 creating build/lib/colossalai/lazy 2025-03-03T09:14:30,938 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2025-03-03T09:14:30,940 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2025-03-03T09:14:30,943 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2025-03-03T09:14:30,945 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2025-03-03T09:14:30,948 creating build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,949 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,951 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,955 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,957 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,959 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,963 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,965 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2025-03-03T09:14:30,969 creating build/lib/colossalai/utils 2025-03-03T09:14:30,970 copying colossalai/utils/safetensors.py -> build/lib/colossalai/utils 2025-03-03T09:14:30,972 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2025-03-03T09:14:30,974 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2025-03-03T09:14:30,976 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2025-03-03T09:14:30,978 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2025-03-03T09:14:30,981 creating build/lib/colossalai/pipeline 2025-03-03T09:14:30,982 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2025-03-03T09:14:30,985 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2025-03-03T09:14:30,986 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2025-03-03T09:14:30,989 copying colossalai/pipeline/weight_grad_store.py -> build/lib/colossalai/pipeline 2025-03-03T09:14:30,991 creating build/lib/colossalai/context 2025-03-03T09:14:30,992 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2025-03-03T09:14:30,994 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2025-03-03T09:14:30,996 copying colossalai/context/config.py -> build/lib/colossalai/context 2025-03-03T09:14:30,998 creating build/lib/colossalai/fx 2025-03-03T09:14:30,999 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,002 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,004 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,006 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,007 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,010 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2025-03-03T09:14:31,012 creating build/lib/colossalai/kernel 2025-03-03T09:14:31,014 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2025-03-03T09:14:31,015 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2025-03-03T09:14:31,018 creating build/lib/colossalai/device 2025-03-03T09:14:31,019 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2025-03-03T09:14:31,022 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2025-03-03T09:14:31,024 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2025-03-03T09:14:31,026 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2025-03-03T09:14:31,029 creating build/lib/colossalai/testing 2025-03-03T09:14:31,030 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2025-03-03T09:14:31,033 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2025-03-03T09:14:31,035 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2025-03-03T09:14:31,036 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2025-03-03T09:14:31,039 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2025-03-03T09:14:31,041 creating build/lib/colossalai/legacy 2025-03-03T09:14:31,042 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2025-03-03T09:14:31,045 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2025-03-03T09:14:31,047 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2025-03-03T09:14:31,048 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2025-03-03T09:14:31,050 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2025-03-03T09:14:31,052 creating build/lib/colossalai/zero 2025-03-03T09:14:31,054 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2025-03-03T09:14:31,056 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2025-03-03T09:14:31,058 creating build/lib/colossalai/cli 2025-03-03T09:14:31,059 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2025-03-03T09:14:31,062 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2025-03-03T09:14:31,064 creating build/lib/colossalai/logging 2025-03-03T09:14:31,065 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2025-03-03T09:14:31,067 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2025-03-03T09:14:31,070 creating build/lib/colossalai/tensor 2025-03-03T09:14:31,071 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,073 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,075 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,078 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,080 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,082 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,085 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,087 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2025-03-03T09:14:31,090 creating build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,091 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,093 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,095 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,096 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,098 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,100 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,102 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2025-03-03T09:14:31,105 creating build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,106 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,109 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,112 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,113 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,116 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,119 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,121 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,124 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,127 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,129 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-03-03T09:14:31,131 creating build/lib/colossalai/nn/layer 2025-03-03T09:14:31,132 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2025-03-03T09:14:31,134 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2025-03-03T09:14:31,137 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2025-03-03T09:14:31,139 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2025-03-03T09:14:31,142 creating build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,143 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,146 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,148 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,150 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,152 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,154 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,157 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,159 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,161 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,163 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,165 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,168 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,170 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,172 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,175 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,177 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2025-03-03T09:14:31,179 creating build/lib/colossalai/nn/loss 2025-03-03T09:14:31,180 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2025-03-03T09:14:31,183 creating build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,184 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,187 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,189 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,191 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,193 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,195 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,197 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,199 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2025-03-03T09:14:31,202 creating build/lib/colossalai/auto_parallel/pipeline_shard 2025-03-03T09:14:31,203 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2025-03-03T09:14:31,205 creating build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,206 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,208 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,210 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,212 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,214 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,217 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:31,220 creating build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,221 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,223 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,226 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,228 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,230 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,232 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,234 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,236 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,239 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,241 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2025-03-03T09:14:31,244 creating build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,245 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,248 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,249 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,251 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,253 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:31,256 creating build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,257 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,260 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,261 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,264 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,267 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,269 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2025-03-03T09:14:31,271 creating build/lib/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:31,272 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:31,275 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:31,277 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:31,279 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:31,281 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,282 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,284 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,286 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,288 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,291 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,293 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:31,296 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,297 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,300 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,302 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,304 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,306 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:31,309 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,310 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,312 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,315 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,317 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,319 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,321 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,323 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,325 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,327 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,329 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,330 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,332 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,334 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,336 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,338 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,340 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,342 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,344 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,346 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,349 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,351 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,352 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,355 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,356 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,360 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,361 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,363 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:31,367 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,368 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,370 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,372 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,375 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,377 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,380 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,382 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,384 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,387 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,389 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,393 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,395 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,397 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,399 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,402 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,405 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,408 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,410 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,413 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:31,417 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,418 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,421 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,423 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,425 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,428 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,431 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,433 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,436 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,439 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,441 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,444 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:31,447 creating build/lib/colossalai/amp/naive_amp 2025-03-03T09:14:31,449 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2025-03-03T09:14:31,451 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2025-03-03T09:14:31,455 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:31,456 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:31,459 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:31,461 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:31,463 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:31,467 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:31,468 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:31,471 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:31,473 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:31,475 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:31,478 creating build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,480 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,482 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,485 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,487 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,489 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,492 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2025-03-03T09:14:31,495 creating build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,496 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,500 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,502 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,504 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,506 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,509 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,512 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,514 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,517 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,520 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,522 copying colossalai/shardformer/policies/deepseek_v3.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,524 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,528 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,530 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,533 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,536 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,538 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,541 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,544 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,546 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,549 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,551 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2025-03-03T09:14:31,555 creating build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,556 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,558 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,560 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,562 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,565 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,568 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,571 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,574 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,576 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,579 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,582 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2025-03-03T09:14:31,586 creating build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,587 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,590 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,592 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,594 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,597 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,599 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,602 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,605 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,608 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,611 copying colossalai/shardformer/modeling/deepseek_v3.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,614 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,616 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,619 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,622 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,625 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,628 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,631 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,635 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,637 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,640 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,643 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2025-03-03T09:14:31,646 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:31,647 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:31,649 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:31,652 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:31,654 creating build/lib/colossalai/inference/kv_cache 2025-03-03T09:14:31,655 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2025-03-03T09:14:31,657 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2025-03-03T09:14:31,659 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2025-03-03T09:14:31,662 creating build/lib/colossalai/inference/executor 2025-03-03T09:14:31,663 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2025-03-03T09:14:31,666 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2025-03-03T09:14:31,668 creating build/lib/colossalai/inference/server 2025-03-03T09:14:31,670 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2025-03-03T09:14:31,672 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2025-03-03T09:14:31,674 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2025-03-03T09:14:31,676 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2025-03-03T09:14:31,678 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2025-03-03T09:14:31,680 creating build/lib/colossalai/inference/modeling 2025-03-03T09:14:31,681 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2025-03-03T09:14:31,683 creating build/lib/colossalai/inference/core 2025-03-03T09:14:31,685 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,688 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,691 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,692 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,695 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,697 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,699 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,702 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,704 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2025-03-03T09:14:31,707 creating build/lib/colossalai/inference/spec 2025-03-03T09:14:31,709 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2025-03-03T09:14:31,711 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2025-03-03T09:14:31,712 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2025-03-03T09:14:31,715 creating build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,716 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,719 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,722 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,723 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,726 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,729 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2025-03-03T09:14:31,732 creating build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,733 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,736 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,738 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,739 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,741 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2025-03-03T09:14:31,745 creating build/lib/colossalai/inference/modeling/backends 2025-03-03T09:14:31,746 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2025-03-03T09:14:31,748 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-03-03T09:14:31,750 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-03-03T09:14:31,753 creating build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,754 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,756 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,758 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,760 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,762 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,764 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2025-03-03T09:14:31,767 creating build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,768 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,771 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,774 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,776 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,779 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2025-03-03T09:14:31,781 creating build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,782 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,784 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,787 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,789 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,791 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-03-03T09:14:31,794 creating build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,795 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,798 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,800 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,802 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,805 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,807 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:31,809 creating build/lib/colossalai/_analyzer/fx/passes 2025-03-03T09:14:31,811 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2025-03-03T09:14:31,813 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2025-03-03T09:14:31,815 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2025-03-03T09:14:31,818 creating build/lib/colossalai/utils/rank_recorder 2025-03-03T09:14:31,819 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2025-03-03T09:14:31,821 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2025-03-03T09:14:31,824 creating build/lib/colossalai/utils/multi_tensor_apply 2025-03-03T09:14:31,825 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-03-03T09:14:31,827 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-03-03T09:14:31,829 creating build/lib/colossalai/utils/model 2025-03-03T09:14:31,830 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2025-03-03T09:14:31,831 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2025-03-03T09:14:31,834 creating build/lib/colossalai/utils/tensor_detector 2025-03-03T09:14:31,835 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2025-03-03T09:14:31,837 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2025-03-03T09:14:31,840 creating build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,841 copying colossalai/pipeline/schedule/v_schedule.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,844 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,846 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,848 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,851 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,854 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,856 copying colossalai/pipeline/schedule/zero_bubble_pp.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,859 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2025-03-03T09:14:31,862 creating build/lib/colossalai/fx/codegen 2025-03-03T09:14:31,863 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2025-03-03T09:14:31,865 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2025-03-03T09:14:31,869 creating build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,870 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,872 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,875 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,877 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,879 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,881 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,883 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2025-03-03T09:14:31,886 creating build/lib/colossalai/fx/passes 2025-03-03T09:14:31,887 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,890 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,892 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,894 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,896 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,899 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,901 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,903 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2025-03-03T09:14:31,906 creating build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,907 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,910 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,912 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,914 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,917 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,919 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,921 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,923 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2025-03-03T09:14:31,926 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2025-03-03T09:14:31,927 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2025-03-03T09:14:31,930 creating build/lib/colossalai/fx/tracer/meta_patch 2025-03-03T09:14:31,931 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2025-03-03T09:14:31,934 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:31,935 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:31,937 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:31,940 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:31,942 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:31,944 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,945 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,947 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,950 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,952 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,954 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:31,956 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,958 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,960 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,962 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,964 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,967 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,969 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,971 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,973 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:31,976 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,977 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,979 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,981 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,983 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,986 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,988 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,990 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,992 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:31,995 creating build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:31,996 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:31,998 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:32,000 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:32,002 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:32,004 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2025-03-03T09:14:32,007 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,009 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,011 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,012 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,014 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,016 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,018 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,020 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,022 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,024 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:32,026 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,028 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,030 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,032 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,034 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,036 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,038 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,040 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,043 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,045 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,047 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,049 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:32,052 creating build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,053 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,056 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,058 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,060 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,063 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,066 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,068 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,070 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,073 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,075 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,077 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2025-03-03T09:14:32,080 creating build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,081 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,084 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,085 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,087 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,090 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,092 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2025-03-03T09:14:32,095 creating build/lib/colossalai/kernel/jit 2025-03-03T09:14:32,096 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2025-03-03T09:14:32,098 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2025-03-03T09:14:32,100 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2025-03-03T09:14:32,102 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2025-03-03T09:14:32,105 creating build/lib/colossalai/kernel/extensions/pybind 2025-03-03T09:14:32,106 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2025-03-03T09:14:32,108 creating build/lib/colossalai/kernel/extensions/csrc 2025-03-03T09:14:32,109 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2025-03-03T09:14:32,112 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:32,113 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:32,115 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:32,118 creating build/lib/colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:32,119 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:32,121 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:32,124 creating build/lib/colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:32,125 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:32,127 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:32,130 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:32,131 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:32,133 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:32,136 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:32,137 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:32,139 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:32,141 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:32,143 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:32,144 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:32,146 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:32,148 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:32,150 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:32,153 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:32,154 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:32,156 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:32,158 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:32,160 creating build/lib/colossalai/legacy/nn 2025-03-03T09:14:32,161 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2025-03-03T09:14:32,164 creating build/lib/colossalai/legacy/amp 2025-03-03T09:14:32,165 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2025-03-03T09:14:32,167 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2025-03-03T09:14:32,169 creating build/lib/colossalai/legacy/inference 2025-03-03T09:14:32,171 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2025-03-03T09:14:32,174 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2025-03-03T09:14:32,176 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2025-03-03T09:14:32,178 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2025-03-03T09:14:32,180 creating build/lib/colossalai/legacy/engine 2025-03-03T09:14:32,181 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2025-03-03T09:14:32,183 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2025-03-03T09:14:32,186 creating build/lib/colossalai/legacy/registry 2025-03-03T09:14:32,188 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2025-03-03T09:14:32,190 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2025-03-03T09:14:32,192 creating build/lib/colossalai/legacy/trainer 2025-03-03T09:14:32,193 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2025-03-03T09:14:32,196 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2025-03-03T09:14:32,199 creating build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,200 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,203 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,205 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,208 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,210 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2025-03-03T09:14:32,213 creating build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,214 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,216 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,218 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,220 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,223 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2025-03-03T09:14:32,226 creating build/lib/colossalai/legacy/context 2025-03-03T09:14:32,227 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2025-03-03T09:14:32,229 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2025-03-03T09:14:32,231 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2025-03-03T09:14:32,234 creating build/lib/colossalai/legacy/builder 2025-03-03T09:14:32,235 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2025-03-03T09:14:32,237 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2025-03-03T09:14:32,239 creating build/lib/colossalai/legacy/zero 2025-03-03T09:14:32,241 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2025-03-03T09:14:32,243 creating build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,245 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,248 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,250 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,252 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,254 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,256 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2025-03-03T09:14:32,259 creating build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,261 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,263 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,265 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,267 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,270 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,272 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,274 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,276 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2025-03-03T09:14:32,279 creating build/lib/colossalai/legacy/nn/layer 2025-03-03T09:14:32,280 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2025-03-03T09:14:32,282 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2025-03-03T09:14:32,285 creating build/lib/colossalai/legacy/nn/parallel 2025-03-03T09:14:32,287 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2025-03-03T09:14:32,289 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2025-03-03T09:14:32,291 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2025-03-03T09:14:32,294 creating build/lib/colossalai/legacy/nn/_ops 2025-03-03T09:14:32,295 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2025-03-03T09:14:32,297 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2025-03-03T09:14:32,300 creating build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,301 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,304 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,306 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,308 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,310 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2025-03-03T09:14:32,313 creating build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,314 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,316 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,318 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,320 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,322 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2025-03-03T09:14:32,324 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:32,325 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:32,327 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:32,330 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:32,334 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:32,336 creating build/lib/colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:32,337 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:32,339 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:32,342 creating build/lib/colossalai/legacy/nn/layer/utils 2025-03-03T09:14:32,344 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-03-03T09:14:32,346 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-03-03T09:14:32,348 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:32,350 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:32,352 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:32,355 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:32,358 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:32,360 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,362 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,364 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,366 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,368 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,370 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,373 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:32,375 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:32,376 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:32,379 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:32,382 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:32,385 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:32,388 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:32,389 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:32,391 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:32,394 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:32,396 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:32,400 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:32,401 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:32,403 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:32,406 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:32,408 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:32,411 creating build/lib/colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:32,412 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:32,415 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:32,418 creating build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,420 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,423 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,425 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,427 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,430 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:32,433 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,434 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,437 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,440 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,443 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,446 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,448 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,450 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,453 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,456 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:32,459 creating build/lib/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:32,460 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:32,463 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:32,465 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:32,468 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:32,471 creating build/lib/colossalai/legacy/amp/apex_amp 2025-03-03T09:14:32,472 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-03-03T09:14:32,475 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-03-03T09:14:32,477 creating build/lib/colossalai/legacy/amp/torch_amp 2025-03-03T09:14:32,479 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-03-03T09:14:32,481 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-03-03T09:14:32,484 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-03-03T09:14:32,487 creating build/lib/colossalai/legacy/inference/pipeline 2025-03-03T09:14:32,488 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2025-03-03T09:14:32,490 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2025-03-03T09:14:32,494 creating build/lib/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:32,495 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:32,497 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:32,500 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:32,502 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:32,505 creating build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,506 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,508 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,510 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,512 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,514 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,516 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,519 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,521 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,523 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:32,526 creating build/lib/colossalai/legacy/inference/hybridengine 2025-03-03T09:14:32,527 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-03-03T09:14:32,529 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-03-03T09:14:32,532 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:32,533 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:32,535 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:32,537 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:32,539 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:32,543 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,544 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,547 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,549 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,552 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,555 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:32,557 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:32,558 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:32,560 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:32,564 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:32,565 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:32,567 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:32,570 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:32,573 creating build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,574 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,576 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,578 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,580 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,582 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,584 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,586 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,588 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:32,590 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:32,591 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:32,593 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:32,596 creating build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,598 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,601 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,604 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,606 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,608 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-03-03T09:14:32,611 creating build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,612 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,614 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,616 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,618 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,620 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,623 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,625 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-03-03T09:14:32,628 creating build/lib/colossalai/legacy/utils/checkpoint 2025-03-03T09:14:32,629 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-03-03T09:14:32,631 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-03-03T09:14:32,634 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-03-03T09:14:32,636 creating build/lib/colossalai/legacy/utils/data_sampler 2025-03-03T09:14:32,638 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-03-03T09:14:32,640 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-03-03T09:14:32,642 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-03-03T09:14:32,645 creating build/lib/colossalai/legacy/utils/profiler 2025-03-03T09:14:32,646 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2025-03-03T09:14:32,648 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2025-03-03T09:14:32,650 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-03-03T09:14:32,652 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-03-03T09:14:32,654 creating build/lib/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:32,656 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:32,658 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:32,660 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:32,662 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:32,665 creating build/lib/colossalai/legacy/pipeline/middleware 2025-03-03T09:14:32,666 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-03-03T09:14:32,668 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-03-03T09:14:32,671 creating build/lib/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:32,672 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:32,675 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:32,677 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:32,680 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:32,683 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:32,684 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:32,687 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:32,690 creating build/lib/colossalai/legacy/context/random 2025-03-03T09:14:32,691 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2025-03-03T09:14:32,693 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2025-03-03T09:14:32,695 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2025-03-03T09:14:32,698 creating build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,699 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,702 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,704 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,706 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,708 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,710 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,712 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,714 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,716 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,719 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,720 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:32,723 creating build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,724 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,727 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,729 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,731 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,739 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,742 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,744 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-03-03T09:14:32,746 creating build/lib/colossalai/legacy/zero/init_ctx 2025-03-03T09:14:32,747 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-03-03T09:14:32,749 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-03-03T09:14:32,752 creating build/lib/colossalai/legacy/zero/sharded_param 2025-03-03T09:14:32,754 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-03-03T09:14:32,756 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-03-03T09:14:32,758 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-03-03T09:14:32,760 creating build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,762 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,764 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,766 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,768 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,770 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:32,773 creating build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,774 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,776 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,778 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,781 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,783 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,785 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:32,788 creating build/lib/colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:32,790 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:32,792 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:32,795 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,796 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,798 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,800 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,803 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,805 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:32,808 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:32,809 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:32,811 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:32,814 creating build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,815 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,817 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,819 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,822 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,824 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,827 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,830 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2025-03-03T09:14:32,832 creating build/lib/colossalai/zero/low_level 2025-03-03T09:14:32,834 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2025-03-03T09:14:32,836 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2025-03-03T09:14:32,839 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2025-03-03T09:14:32,840 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2025-03-03T09:14:32,843 creating build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,844 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,847 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,849 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,851 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,853 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,856 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,858 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,860 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,862 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:32,864 creating build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,865 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,868 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,870 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,872 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,874 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-03-03T09:14:32,877 creating build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,878 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,880 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,882 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,884 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,887 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:32,889 creating build/lib/colossalai/cli/launcher 2025-03-03T09:14:32,890 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2025-03-03T09:14:32,893 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2025-03-03T09:14:32,895 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2025-03-03T09:14:32,898 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2025-03-03T09:14:32,901 creating build/lib/colossalai/cli/check 2025-03-03T09:14:32,902 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2025-03-03T09:14:32,904 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2025-03-03T09:14:32,907 creating build/lib/colossalai/tensor/moe_tensor 2025-03-03T09:14:32,908 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2025-03-03T09:14:32,910 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2025-03-03T09:14:32,913 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2025-03-03T09:14:32,916 creating build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,918 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,921 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,924 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,927 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,930 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,933 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,936 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,939 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2025-03-03T09:14:32,943 creating build/lib/colossalai/tensor/padded_tensor 2025-03-03T09:14:32,945 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2025-03-03T09:14:32,947 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2025-03-03T09:14:32,950 creating build/lib/extensions/pybind 2025-03-03T09:14:32,952 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2025-03-03T09:14:32,955 creating build/lib/extensions/csrc 2025-03-03T09:14:32,956 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2025-03-03T09:14:32,959 creating build/lib/extensions/pybind/layernorm 2025-03-03T09:14:32,961 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2025-03-03T09:14:32,963 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2025-03-03T09:14:32,966 creating build/lib/extensions/pybind/inference 2025-03-03T09:14:32,968 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2025-03-03T09:14:32,971 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2025-03-03T09:14:32,974 creating build/lib/extensions/pybind/moe 2025-03-03T09:14:32,975 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2025-03-03T09:14:32,978 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2025-03-03T09:14:32,981 creating build/lib/extensions/pybind/optimizer 2025-03-03T09:14:32,983 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2025-03-03T09:14:32,985 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2025-03-03T09:14:32,988 creating build/lib/extensions/pybind/cpu_adam 2025-03-03T09:14:32,990 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2025-03-03T09:14:32,992 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2025-03-03T09:14:32,995 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2025-03-03T09:14:32,998 creating build/lib/extensions/pybind/flash_attention 2025-03-03T09:14:32,999 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2025-03-03T09:14:33,002 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-03-03T09:14:33,004 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2025-03-03T09:14:33,007 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-03-03T09:14:33,010 creating build/lib/extensions/pybind/softmax 2025-03-03T09:14:33,011 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-03-03T09:14:33,013 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-03-03T09:14:33,015 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2025-03-03T09:14:33,103 creating build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,105 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,108 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,110 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,112 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,115 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:33,117 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,118 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,121 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,123 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,126 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,128 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:33,131 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,133 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,136 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,139 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,142 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,146 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,149 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,153 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,156 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,161 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,164 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,167 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,171 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,174 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,177 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,181 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,184 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,187 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,189 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:33,192 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:33,194 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:33,196 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:33,199 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:33,201 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:33,203 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-03-03T09:14:33,204 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-03-03T09:14:33,207 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:33,208 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:33,211 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:33,215 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:33,216 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:33,219 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:33,223 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:33,227 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:33,230 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:33,234 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:33,240 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:33,242 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:33,350 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-03T09:14:33,350 !! 2025-03-03T09:14:33,351 ******************************************************************************** 2025-03-03T09:14:33,352 Please avoid running ``setup.py`` directly. 2025-03-03T09:14:33,353 Instead, use pypa/build, pypa/installer or other 2025-03-03T09:14:33,353 standards-based tools. 2025-03-03T09:14:33,355 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-03T09:14:33,355 ******************************************************************************** 2025-03-03T09:14:33,356 !! 2025-03-03T09:14:33,357 self.initialize_options() 2025-03-03T09:14:33,377 installing to build/bdist.linux-armv7l/wheel 2025-03-03T09:14:33,378 running install 2025-03-03T09:14:33,402 running install_lib 2025-03-03T09:14:33,430 creating build/bdist.linux-armv7l/wheel 2025-03-03T09:14:33,432 creating build/bdist.linux-armv7l/wheel/colossalai 2025-03-03T09:14:33,434 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2025-03-03T09:14:33,435 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2025-03-03T09:14:33,437 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,439 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,441 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,442 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,444 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,446 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,448 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-03-03T09:14:33,451 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2025-03-03T09:14:33,452 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,455 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,458 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,460 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,462 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,465 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,467 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,470 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,473 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,475 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-03-03T09:14:33,477 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-03-03T09:14:33,479 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-03-03T09:14:33,481 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-03-03T09:14:33,484 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2025-03-03T09:14:33,485 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2025-03-03T09:14:33,487 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2025-03-03T09:14:33,488 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-03-03T09:14:33,491 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2025-03-03T09:14:33,492 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-03-03T09:14:33,494 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-03-03T09:14:33,496 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-03-03T09:14:33,498 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-03-03T09:14:33,500 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-03-03T09:14:33,503 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2025-03-03T09:14:33,504 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,507 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,509 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,511 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,514 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,516 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,518 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,520 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,523 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,525 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,527 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,530 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,532 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,534 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,537 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,540 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-03-03T09:14:33,543 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2025-03-03T09:14:33,544 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2025-03-03T09:14:33,546 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2025-03-03T09:14:33,547 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,550 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,552 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,553 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,555 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,558 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,560 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,562 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-03-03T09:14:33,564 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-03-03T09:14:33,568 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2025-03-03T09:14:33,569 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2025-03-03T09:14:33,571 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2025-03-03T09:14:33,572 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2025-03-03T09:14:33,575 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,576 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,579 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,584 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,587 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,589 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,591 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-03-03T09:14:33,594 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2025-03-03T09:14:33,595 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,597 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,600 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,602 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,604 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,606 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,608 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,610 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,613 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,615 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-03-03T09:14:33,618 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,619 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,622 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,624 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,626 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,627 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,630 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,631 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,634 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,636 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,638 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-03-03T09:14:33,640 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,643 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-03-03T09:14:33,645 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,646 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,648 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,651 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,653 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,655 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-03-03T09:14:33,658 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,660 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,662 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,665 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,672 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,673 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,675 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,678 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,680 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,683 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,686 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,688 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,691 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,693 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,696 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,699 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,701 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,703 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,705 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,707 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,710 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,712 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,714 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,716 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-03-03T09:14:33,719 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,721 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,723 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,725 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,727 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,730 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,732 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,734 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,736 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,738 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,740 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,742 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,744 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,746 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,748 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,750 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,753 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,755 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,757 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,766 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,768 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,771 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,773 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,775 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-03-03T09:14:33,778 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2025-03-03T09:14:33,779 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,782 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,783 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,786 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,788 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,795 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-03-03T09:14:33,797 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:33,799 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:33,800 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:33,803 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:33,804 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-03-03T09:14:33,807 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,808 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,810 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,812 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,814 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,816 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,818 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,820 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,823 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,824 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,826 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,829 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-03-03T09:14:33,832 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2025-03-03T09:14:33,834 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2025-03-03T09:14:33,836 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-03-03T09:14:33,838 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:33,839 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:33,841 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:33,843 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:33,844 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-03-03T09:14:33,847 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-03-03T09:14:33,849 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:33,850 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:33,852 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:33,858 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:33,860 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-03-03T09:14:33,861 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2025-03-03T09:14:33,864 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2025-03-03T09:14:33,865 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2025-03-03T09:14:33,867 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,869 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,871 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,873 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,875 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,878 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-03-03T09:14:33,880 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2025-03-03T09:14:33,881 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,884 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,886 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,888 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,890 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,893 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,896 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,898 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,901 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,903 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,906 copying build/lib/colossalai/shardformer/policies/deepseek_v3.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,908 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,911 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,914 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,917 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,920 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,924 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,927 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,930 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,933 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,937 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,940 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-03-03T09:14:33,943 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-03-03T09:14:33,946 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2025-03-03T09:14:33,948 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,950 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,953 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,955 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,958 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,962 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,965 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,968 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,971 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,974 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,976 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-03-03T09:14:33,980 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2025-03-03T09:14:33,981 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:33,985 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:33,986 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:33,988 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:33,992 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-03-03T09:14:33,994 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:33,996 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:33,998 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,001 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,003 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,006 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,010 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,013 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,016 copying build/lib/colossalai/shardformer/modeling/deepseek_v3.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,019 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,023 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,027 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,030 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,033 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,037 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,040 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,044 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,046 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,050 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,053 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-03-03T09:14:34,055 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-03-03T09:14:34,058 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2025-03-03T09:14:34,060 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,062 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,065 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2025-03-03T09:14:34,066 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-03-03T09:14:34,068 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-03-03T09:14:34,070 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-03-03T09:14:34,073 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,076 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,079 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2025-03-03T09:14:34,080 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-03-03T09:14:34,083 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-03-03T09:14:34,085 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2025-03-03T09:14:34,086 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-03-03T09:14:34,089 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-03-03T09:14:34,090 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-03-03T09:14:34,093 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-03-03T09:14:34,095 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-03-03T09:14:34,096 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,099 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2025-03-03T09:14:34,101 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2025-03-03T09:14:34,103 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,105 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,108 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,109 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,113 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,118 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-03-03T09:14:34,124 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2025-03-03T09:14:34,129 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2025-03-03T09:14:34,132 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-03-03T09:14:34,140 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-03-03T09:14:34,145 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-03-03T09:14:34,147 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-03-03T09:14:34,149 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-03-03T09:14:34,152 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2025-03-03T09:14:34,154 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-03-03T09:14:34,156 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-03-03T09:14:34,158 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-03-03T09:14:34,162 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2025-03-03T09:14:34,163 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,166 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,169 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,171 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,174 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,176 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-03-03T09:14:34,180 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2025-03-03T09:14:34,181 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,184 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,187 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,189 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,192 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,195 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,197 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,200 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,202 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-03-03T09:14:34,206 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2025-03-03T09:14:34,207 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-03-03T09:14:34,210 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-03-03T09:14:34,212 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-03-03T09:14:34,215 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,218 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,220 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,223 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-03-03T09:14:34,226 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2025-03-03T09:14:34,228 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,230 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,233 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,235 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,238 copying build/lib/colossalai/quantization/fp8_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,240 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,243 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-03-03T09:14:34,246 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2025-03-03T09:14:34,248 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-03-03T09:14:34,250 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-03-03T09:14:34,253 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-03-03T09:14:34,255 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-03-03T09:14:34,258 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2025-03-03T09:14:34,259 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-03-03T09:14:34,262 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2025-03-03T09:14:34,263 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-03-03T09:14:34,266 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-03-03T09:14:34,269 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,270 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,273 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,276 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,278 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,280 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,283 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-03-03T09:14:34,284 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-03-03T09:14:34,287 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2025-03-03T09:14:34,288 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-03-03T09:14:34,290 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-03-03T09:14:34,293 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-03-03T09:14:34,295 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-03-03T09:14:34,298 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-03-03T09:14:34,299 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-03-03T09:14:34,302 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,303 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,305 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,307 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,310 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,312 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-03-03T09:14:34,315 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-03-03T09:14:34,317 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2025-03-03T09:14:34,318 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-03-03T09:14:34,320 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-03-03T09:14:34,323 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2025-03-03T09:14:34,324 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-03-03T09:14:34,326 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-03-03T09:14:34,328 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-03-03T09:14:34,330 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-03-03T09:14:34,332 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-03-03T09:14:34,335 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2025-03-03T09:14:34,337 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,339 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,342 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,343 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,345 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,347 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-03-03T09:14:34,350 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2025-03-03T09:14:34,351 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-03-03T09:14:34,353 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-03-03T09:14:34,356 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-03-03T09:14:34,358 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-03-03T09:14:34,361 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2025-03-03T09:14:34,362 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,365 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,368 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,370 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,372 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,376 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,378 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-03-03T09:14:34,382 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2025-03-03T09:14:34,383 copying build/lib/colossalai/utils/safetensors.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-03-03T09:14:34,385 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-03-03T09:14:34,388 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2025-03-03T09:14:34,390 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-03-03T09:14:34,392 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-03-03T09:14:34,394 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-03-03T09:14:34,396 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2025-03-03T09:14:34,397 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-03-03T09:14:34,399 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-03-03T09:14:34,402 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2025-03-03T09:14:34,403 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-03-03T09:14:34,405 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-03-03T09:14:34,407 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2025-03-03T09:14:34,408 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-03-03T09:14:34,410 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-03-03T09:14:34,412 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-03-03T09:14:34,414 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-03-03T09:14:34,417 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2025-03-03T09:14:34,418 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-03-03T09:14:34,421 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-03-03T09:14:34,423 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-03-03T09:14:34,426 copying build/lib/colossalai/pipeline/weight_grad_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-03-03T09:14:34,429 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2025-03-03T09:14:34,431 copying build/lib/colossalai/pipeline/schedule/v_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,434 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,437 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,440 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,444 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,448 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,450 copying build/lib/colossalai/pipeline/schedule/zero_bubble_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,454 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-03-03T09:14:34,459 creating build/bdist.linux-armv7l/wheel/colossalai/context 2025-03-03T09:14:34,460 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-03-03T09:14:34,463 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-03-03T09:14:34,465 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-03-03T09:14:34,469 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2025-03-03T09:14:34,471 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2025-03-03T09:14:34,472 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-03-03T09:14:34,475 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-03-03T09:14:34,479 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,483 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,486 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,489 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,492 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2025-03-03T09:14:34,494 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,497 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,502 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,505 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2025-03-03T09:14:34,507 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2025-03-03T09:14:34,511 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:34,513 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:34,516 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:34,519 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:34,522 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-03-03T09:14:34,526 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,528 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,531 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,533 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,536 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,538 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-03-03T09:14:34,542 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,546 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2025-03-03T09:14:34,548 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2025-03-03T09:14:34,551 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,553 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,556 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,559 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,562 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,565 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,568 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,571 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,573 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-03-03T09:14:34,577 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,579 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,582 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,585 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,587 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,591 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,594 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,596 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,599 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-03-03T09:14:34,601 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,603 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,606 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-03-03T09:14:34,609 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2025-03-03T09:14:34,611 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,614 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,617 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,620 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,622 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,624 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,627 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,630 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-03-03T09:14:34,632 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,634 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-03-03T09:14:34,636 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2025-03-03T09:14:34,637 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,640 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,642 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,643 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,646 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,649 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2025-03-03T09:14:34,650 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-03-03T09:14:34,652 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-03-03T09:14:34,654 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,656 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,658 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,660 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,662 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,663 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,665 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,667 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,669 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,671 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-03-03T09:14:34,673 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-03-03T09:14:34,675 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-03-03T09:14:34,678 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,680 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,682 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,683 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,685 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,687 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,689 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,691 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,693 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,695 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,697 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,699 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-03-03T09:14:34,701 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-03-03T09:14:34,703 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,704 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,706 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-03-03T09:14:34,709 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2025-03-03T09:14:34,710 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-03-03T09:14:34,712 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2025-03-03T09:14:34,714 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,716 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,718 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,720 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,723 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,725 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,728 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,730 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,732 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,734 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,736 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-03-03T09:14:34,739 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2025-03-03T09:14:34,740 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,742 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,745 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2025-03-03T09:14:34,746 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:34,748 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:34,756 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:34,758 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-03-03T09:14:34,760 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:34,762 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:34,764 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:34,765 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-03-03T09:14:34,768 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2025-03-03T09:14:34,770 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:34,771 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:34,773 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:34,775 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-03-03T09:14:34,777 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:34,779 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:34,781 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:34,783 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-03-03T09:14:34,786 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:34,787 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:34,789 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:34,791 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-03-03T09:14:34,793 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:34,794 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:34,796 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:34,798 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:34,800 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-03-03T09:14:34,803 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,804 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,806 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,808 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,810 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,812 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-03-03T09:14:34,814 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,820 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,822 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2025-03-03T09:14:34,824 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,825 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,828 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,830 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,831 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,833 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-03-03T09:14:34,835 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2025-03-03T09:14:34,837 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,838 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,840 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,842 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,845 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,847 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-03-03T09:14:34,850 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2025-03-03T09:14:34,852 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,854 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,856 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,858 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,861 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,864 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,866 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,869 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,872 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,875 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:34,876 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:34,879 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:34,881 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:34,883 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-03-03T09:14:34,885 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,887 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,890 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,892 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,895 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-03-03T09:14:34,897 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-03-03T09:14:34,900 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,902 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,905 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,908 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,911 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,914 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-03-03T09:14:34,917 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:34,919 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:34,922 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-03-03T09:14:34,925 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:34,927 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:34,930 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-03-03T09:14:34,933 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,935 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-03-03T09:14:34,938 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-03-03T09:14:34,941 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2025-03-03T09:14:34,943 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-03-03T09:14:34,945 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-03-03T09:14:34,947 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-03-03T09:14:34,949 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-03-03T09:14:34,952 creating build/bdist.linux-armv7l/wheel/colossalai/device 2025-03-03T09:14:34,953 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-03-03T09:14:34,956 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-03-03T09:14:34,958 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-03-03T09:14:34,960 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-03-03T09:14:34,963 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-03-03T09:14:34,966 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2025-03-03T09:14:34,967 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-03-03T09:14:34,970 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-03-03T09:14:34,972 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-03-03T09:14:34,974 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-03-03T09:14:34,976 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-03-03T09:14:34,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2025-03-03T09:14:34,981 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2025-03-03T09:14:34,982 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2025-03-03T09:14:34,985 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2025-03-03T09:14:34,987 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:34,989 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:34,991 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:34,994 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:34,997 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-03-03T09:14:35,000 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:35,002 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:35,004 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-03-03T09:14:35,007 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-03-03T09:14:35,009 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-03-03T09:14:35,012 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2025-03-03T09:14:35,013 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-03-03T09:14:35,015 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-03-03T09:14:35,018 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:35,020 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:35,022 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:35,025 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:35,028 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-03-03T09:14:35,031 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,033 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,035 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,037 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,039 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,041 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,044 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-03-03T09:14:35,046 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:35,048 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:35,050 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:35,054 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:35,057 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-03-03T09:14:35,060 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:35,062 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:35,064 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:35,067 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:35,069 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-03-03T09:14:35,072 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:35,074 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:35,076 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:35,079 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:35,082 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-03-03T09:14:35,084 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:35,086 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:35,088 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-03-03T09:14:35,091 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2025-03-03T09:14:35,092 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-03-03T09:14:35,094 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-03-03T09:14:35,097 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-03-03T09:14:35,100 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,102 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,104 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,106 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,109 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,110 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,113 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,116 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,119 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,121 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,123 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,125 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,128 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,130 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-03-03T09:14:35,133 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,135 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-03-03T09:14:35,138 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2025-03-03T09:14:35,139 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-03-03T09:14:35,142 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-03-03T09:14:35,146 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2025-03-03T09:14:35,147 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-03-03T09:14:35,150 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-03-03T09:14:35,152 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-03-03T09:14:35,155 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-03-03T09:14:35,158 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-03-03T09:14:35,161 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2025-03-03T09:14:35,162 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-03-03T09:14:35,164 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-03-03T09:14:35,166 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-03-03T09:14:35,168 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-03-03T09:14:35,170 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-03-03T09:14:35,172 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-03-03T09:14:35,176 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2025-03-03T09:14:35,178 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2025-03-03T09:14:35,180 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-03-03T09:14:35,182 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-03-03T09:14:35,185 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-03-03T09:14:35,188 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-03-03T09:14:35,191 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2025-03-03T09:14:35,192 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-03-03T09:14:35,194 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-03-03T09:14:35,196 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-03-03T09:14:35,198 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-03-03T09:14:35,200 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2025-03-03T09:14:35,202 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-03-03T09:14:35,204 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-03-03T09:14:35,207 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-03-03T09:14:35,210 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2025-03-03T09:14:35,211 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-03-03T09:14:35,214 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-03-03T09:14:35,216 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-03-03T09:14:35,219 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-03-03T09:14:35,221 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2025-03-03T09:14:35,222 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-03-03T09:14:35,224 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-03-03T09:14:35,226 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:35,228 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:35,230 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:35,231 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:35,233 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:35,236 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-03-03T09:14:35,238 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:35,240 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:35,242 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:35,245 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,246 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,249 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,251 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,254 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,256 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-03-03T09:14:35,258 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-03-03T09:14:35,261 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,263 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,264 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,266 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,268 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,270 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,272 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,274 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,276 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,279 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-03-03T09:14:35,282 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2025-03-03T09:14:35,283 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-03-03T09:14:35,285 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-03-03T09:14:35,288 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:35,290 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:35,291 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-03-03T09:14:35,295 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:35,296 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:35,299 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:35,301 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-03-03T09:14:35,304 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2025-03-03T09:14:35,305 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-03-03T09:14:35,307 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-03-03T09:14:35,310 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,312 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,314 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,315 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,318 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,319 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,322 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,323 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,325 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-03-03T09:14:35,328 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:35,330 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:35,332 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-03-03T09:14:35,336 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2025-03-03T09:14:35,339 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-03-03T09:14:35,343 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-03-03T09:14:35,345 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-03-03T09:14:35,347 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-03-03T09:14:35,350 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-03-03T09:14:35,352 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-03-03T09:14:35,355 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2025-03-03T09:14:35,357 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-03-03T09:14:35,359 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-03-03T09:14:35,362 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2025-03-03T09:14:35,364 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-03-03T09:14:35,366 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-03-03T09:14:35,370 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,372 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,374 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,376 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,379 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,381 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,384 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,387 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-03-03T09:14:35,390 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2025-03-03T09:14:35,392 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-03-03T09:14:35,395 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-03-03T09:14:35,397 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-03-03T09:14:35,400 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2025-03-03T09:14:35,402 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-03-03T09:14:35,404 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-03-03T09:14:35,407 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-03-03T09:14:35,410 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2025-03-03T09:14:35,412 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-03-03T09:14:35,414 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-03-03T09:14:35,417 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-03-03T09:14:35,419 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-03-03T09:14:35,422 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-03-03T09:14:35,426 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2025-03-03T09:14:35,427 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-03-03T09:14:35,429 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-03-03T09:14:35,432 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:35,433 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:35,435 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:35,437 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:35,439 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-03-03T09:14:35,441 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-03-03T09:14:35,443 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-03-03T09:14:35,446 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2025-03-03T09:14:35,447 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-03-03T09:14:35,449 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-03-03T09:14:35,452 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-03-03T09:14:35,454 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-03-03T09:14:35,456 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2025-03-03T09:14:35,458 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:35,459 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:35,461 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-03-03T09:14:35,464 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-03-03T09:14:35,466 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-03-03T09:14:35,468 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2025-03-03T09:14:35,470 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-03-03T09:14:35,472 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-03-03T09:14:35,474 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-03-03T09:14:35,477 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-03-03T09:14:35,480 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-03-03T09:14:35,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2025-03-03T09:14:35,483 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-03-03T09:14:35,485 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-03-03T09:14:35,487 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-03-03T09:14:35,490 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2025-03-03T09:14:35,491 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-03-03T09:14:35,493 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-03-03T09:14:35,495 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-03-03T09:14:35,498 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,499 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,502 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,504 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,505 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,507 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,509 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,511 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,513 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,515 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,517 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,519 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-03-03T09:14:35,522 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2025-03-03T09:14:35,523 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-03-03T09:14:35,525 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-03-03T09:14:35,527 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-03-03T09:14:35,529 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2025-03-03T09:14:35,531 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2025-03-03T09:14:35,532 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,535 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,537 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,538 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,540 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,542 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,544 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,547 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-03-03T09:14:35,549 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:35,550 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:35,552 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-03-03T09:14:35,554 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,556 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,558 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,560 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,562 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-03-03T09:14:35,564 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2025-03-03T09:14:35,566 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-03-03T09:14:35,568 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-03-03T09:14:35,570 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2025-03-03T09:14:35,572 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2025-03-03T09:14:35,574 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-03-03T09:14:35,576 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-03-03T09:14:35,577 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-03-03T09:14:35,580 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,581 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,583 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,585 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,587 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,588 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-03-03T09:14:35,591 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,592 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,594 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,596 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,599 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,601 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,603 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-03-03T09:14:35,606 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:35,607 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:35,609 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-03-03T09:14:35,611 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-03-03T09:14:35,613 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2025-03-03T09:14:35,615 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,617 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,619 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,621 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,623 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,625 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-03-03T09:14:35,627 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-03-03T09:14:35,630 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2025-03-03T09:14:35,631 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,633 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,635 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,637 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,639 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,641 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,643 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,646 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-03-03T09:14:35,648 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2025-03-03T09:14:35,650 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2025-03-03T09:14:35,651 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,654 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,655 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,658 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,660 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,664 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,665 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,667 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,669 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,671 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,673 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,675 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,676 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,678 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,680 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-03-03T09:14:35,682 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,685 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2025-03-03T09:14:35,686 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-03-03T09:14:35,689 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-03-03T09:14:35,691 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-03-03T09:14:35,693 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-03-03T09:14:35,696 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-03-03T09:14:35,698 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-03-03T09:14:35,700 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-03-03T09:14:35,702 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-03-03T09:14:35,705 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2025-03-03T09:14:35,706 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-03-03T09:14:35,708 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-03-03T09:14:35,711 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-03-03T09:14:35,714 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,716 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,718 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,720 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,723 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,725 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-03-03T09:14:35,728 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-03-03T09:14:35,731 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2025-03-03T09:14:35,732 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-03-03T09:14:35,735 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2025-03-03T09:14:35,736 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-03-03T09:14:35,739 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-03-03T09:14:35,742 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-03-03T09:14:35,744 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-03-03T09:14:35,747 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2025-03-03T09:14:35,748 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-03-03T09:14:35,751 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-03-03T09:14:35,753 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-03-03T09:14:35,756 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2025-03-03T09:14:35,757 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-03-03T09:14:35,760 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-03-03T09:14:35,762 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2025-03-03T09:14:35,764 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,766 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,768 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,771 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,774 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,777 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2025-03-03T09:14:35,778 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-03-03T09:14:35,780 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-03-03T09:14:35,783 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-03-03T09:14:35,785 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,789 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2025-03-03T09:14:35,790 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,793 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,796 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,798 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,800 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,802 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,805 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,807 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-03-03T09:14:35,810 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,814 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2025-03-03T09:14:35,815 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-03-03T09:14:35,817 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-03-03T09:14:35,820 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-03-03T09:14:35,823 creating build/bdist.linux-armv7l/wheel/extensions 2025-03-03T09:14:35,825 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2025-03-03T09:14:35,827 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2025-03-03T09:14:35,829 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-03-03T09:14:35,831 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-03-03T09:14:35,833 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2025-03-03T09:14:35,835 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-03-03T09:14:35,837 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-03-03T09:14:35,840 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2025-03-03T09:14:35,842 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2025-03-03T09:14:35,844 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-03-03T09:14:35,846 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-03-03T09:14:35,848 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2025-03-03T09:14:35,850 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-03-03T09:14:35,852 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-03-03T09:14:35,855 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2025-03-03T09:14:35,856 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-03-03T09:14:35,859 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-03-03T09:14:35,861 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-03-03T09:14:35,863 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2025-03-03T09:14:35,865 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-03-03T09:14:35,867 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-03-03T09:14:35,869 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-03-03T09:14:35,871 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-03-03T09:14:35,874 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2025-03-03T09:14:35,876 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-03-03T09:14:35,879 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-03-03T09:14:35,881 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-03-03T09:14:35,883 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2025-03-03T09:14:35,885 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2025-03-03T09:14:35,887 running install_egg_info 2025-03-03T09:14:35,923 running egg_info 2025-03-03T09:14:35,951 writing colossalai.egg-info/PKG-INFO 2025-03-03T09:14:35,956 writing dependency_links to colossalai.egg-info/dependency_links.txt 2025-03-03T09:14:35,958 writing entry points to colossalai.egg-info/entry_points.txt 2025-03-03T09:14:35,960 writing requirements to colossalai.egg-info/requires.txt 2025-03-03T09:14:35,962 writing top-level names to colossalai.egg-info/top_level.txt 2025-03-03T09:14:36,240 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2025-03-03T09:14:36,323 reading manifest template 'MANIFEST.in' 2025-03-03T09:14:37,686 warning: no files found matching '*.tr' under directory 'colossalai' 2025-03-03T09:14:38,407 warning: no files found matching '*.cc' under directory 'colossalai' 2025-03-03T09:14:38,759 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-03-03T09:14:38,904 warning: no files found matching '*.tr' under directory 'extensions' 2025-03-03T09:14:38,958 warning: no files found matching '*.cc' under directory 'extensions' 2025-03-03T09:14:38,986 warning: no files found matching '*.pyi' under directory 'extensions' 2025-03-03T09:14:38,986 adding license file 'LICENSE' 2025-03-03T09:14:39,036 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2025-03-03T09:14:39,039 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.9-py3.11.egg-info 2025-03-03T09:14:39,058 running install_scripts 2025-03-03T09:14:39,083 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.9.dist-info/WHEEL 2025-03-03T09:14:39,085 creating '/tmp/pip-wheel-u637sidc/colossalai-0.4.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-03-03T09:14:39,088 adding 'colossalai/__init__.py' 2025-03-03T09:14:39,090 adding 'colossalai/initialize.py' 2025-03-03T09:14:39,091 adding 'colossalai/version.py' 2025-03-03T09:14:39,093 adding 'colossalai/_C/__init__.py' 2025-03-03T09:14:39,094 adding 'colossalai/_analyzer/__init__.py' 2025-03-03T09:14:39,096 adding 'colossalai/_analyzer/envs.py' 2025-03-03T09:14:39,097 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2025-03-03T09:14:39,100 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2025-03-03T09:14:39,102 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2025-03-03T09:14:39,104 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2025-03-03T09:14:39,106 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2025-03-03T09:14:39,108 adding 'colossalai/_analyzer/fx/__init__.py' 2025-03-03T09:14:39,110 adding 'colossalai/_analyzer/fx/codegen.py' 2025-03-03T09:14:39,112 adding 'colossalai/_analyzer/fx/graph_module.py' 2025-03-03T09:14:39,114 adding 'colossalai/_analyzer/fx/node_util.py' 2025-03-03T09:14:39,115 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2025-03-03T09:14:39,117 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2025-03-03T09:14:39,119 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2025-03-03T09:14:39,120 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2025-03-03T09:14:39,122 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2025-03-03T09:14:39,123 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2025-03-03T09:14:39,124 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2025-03-03T09:14:39,126 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2025-03-03T09:14:39,127 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2025-03-03T09:14:39,129 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2025-03-03T09:14:39,131 adding 'colossalai/accelerator/__init__.py' 2025-03-03T09:14:39,132 adding 'colossalai/accelerator/api.py' 2025-03-03T09:14:39,134 adding 'colossalai/accelerator/base_accelerator.py' 2025-03-03T09:14:39,135 adding 'colossalai/accelerator/cpu_accelerator.py' 2025-03-03T09:14:39,137 adding 'colossalai/accelerator/cuda_accelerator.py' 2025-03-03T09:14:39,139 adding 'colossalai/accelerator/npu_accelerator.py' 2025-03-03T09:14:39,140 adding 'colossalai/amp/__init__.py' 2025-03-03T09:14:39,142 adding 'colossalai/amp/naive_amp/__init__.py' 2025-03-03T09:14:39,143 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2025-03-03T09:14:39,145 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2025-03-03T09:14:39,146 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2025-03-03T09:14:39,147 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2025-03-03T09:14:39,149 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2025-03-03T09:14:39,151 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2025-03-03T09:14:39,152 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2025-03-03T09:14:39,153 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2025-03-03T09:14:39,155 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2025-03-03T09:14:39,156 adding 'colossalai/auto_parallel/__init__.py' 2025-03-03T09:14:39,158 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2025-03-03T09:14:39,159 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2025-03-03T09:14:39,161 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2025-03-03T09:14:39,162 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2025-03-03T09:14:39,165 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2025-03-03T09:14:39,166 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2025-03-03T09:14:39,168 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2025-03-03T09:14:39,169 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2025-03-03T09:14:39,170 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2025-03-03T09:14:39,172 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2025-03-03T09:14:39,174 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2025-03-03T09:14:39,175 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2025-03-03T09:14:39,177 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2025-03-03T09:14:39,178 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2025-03-03T09:14:39,180 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2025-03-03T09:14:39,182 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2025-03-03T09:14:39,183 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2025-03-03T09:14:39,185 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2025-03-03T09:14:39,186 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2025-03-03T09:14:39,188 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2025-03-03T09:14:39,190 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2025-03-03T09:14:39,191 adding 'colossalai/auto_parallel/offload/__init__.py' 2025-03-03T09:14:39,193 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2025-03-03T09:14:39,194 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2025-03-03T09:14:39,195 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2025-03-03T09:14:39,197 adding 'colossalai/auto_parallel/offload/region.py' 2025-03-03T09:14:39,200 adding 'colossalai/auto_parallel/offload/region_manager.py' 2025-03-03T09:14:39,202 adding 'colossalai/auto_parallel/offload/runtime.py' 2025-03-03T09:14:39,205 adding 'colossalai/auto_parallel/offload/solver.py' 2025-03-03T09:14:39,207 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2025-03-03T09:14:39,208 adding 'colossalai/auto_parallel/offload/util.py' 2025-03-03T09:14:39,210 adding 'colossalai/auto_parallel/passes/__init__.py' 2025-03-03T09:14:39,212 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2025-03-03T09:14:39,213 adding 'colossalai/auto_parallel/passes/constants.py' 2025-03-03T09:14:39,214 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2025-03-03T09:14:39,216 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2025-03-03T09:14:39,219 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2025-03-03T09:14:39,220 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2025-03-03T09:14:39,222 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2025-03-03T09:14:39,223 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2025-03-03T09:14:39,225 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2025-03-03T09:14:39,227 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2025-03-03T09:14:39,229 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2025-03-03T09:14:39,231 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2025-03-03T09:14:39,232 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2025-03-03T09:14:39,234 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2025-03-03T09:14:39,235 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2025-03-03T09:14:39,237 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2025-03-03T09:14:39,238 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2025-03-03T09:14:39,239 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2025-03-03T09:14:39,241 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2025-03-03T09:14:39,242 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2025-03-03T09:14:39,244 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2025-03-03T09:14:39,245 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2025-03-03T09:14:39,247 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2025-03-03T09:14:39,249 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2025-03-03T09:14:39,252 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2025-03-03T09:14:39,253 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2025-03-03T09:14:39,255 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2025-03-03T09:14:39,256 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2025-03-03T09:14:39,258 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2025-03-03T09:14:39,259 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2025-03-03T09:14:39,260 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2025-03-03T09:14:39,261 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2025-03-03T09:14:39,263 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2025-03-03T09:14:39,264 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2025-03-03T09:14:39,265 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2025-03-03T09:14:39,267 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2025-03-03T09:14:39,268 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2025-03-03T09:14:39,269 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2025-03-03T09:14:39,271 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2025-03-03T09:14:39,273 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2025-03-03T09:14:39,275 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2025-03-03T09:14:39,277 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2025-03-03T09:14:39,279 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2025-03-03T09:14:39,280 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2025-03-03T09:14:39,282 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2025-03-03T09:14:39,283 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2025-03-03T09:14:39,286 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2025-03-03T09:14:39,288 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2025-03-03T09:14:39,290 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2025-03-03T09:14:39,291 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2025-03-03T09:14:39,293 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2025-03-03T09:14:39,295 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2025-03-03T09:14:39,297 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2025-03-03T09:14:39,299 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2025-03-03T09:14:39,300 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2025-03-03T09:14:39,302 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2025-03-03T09:14:39,303 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2025-03-03T09:14:39,305 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2025-03-03T09:14:39,307 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2025-03-03T09:14:39,308 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2025-03-03T09:14:39,311 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2025-03-03T09:14:39,313 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2025-03-03T09:14:39,314 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2025-03-03T09:14:39,316 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2025-03-03T09:14:39,318 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2025-03-03T09:14:39,319 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2025-03-03T09:14:39,321 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2025-03-03T09:14:39,323 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2025-03-03T09:14:39,325 adding 'colossalai/booster/__init__.py' 2025-03-03T09:14:39,327 adding 'colossalai/booster/accelerator.py' 2025-03-03T09:14:39,329 adding 'colossalai/booster/booster.py' 2025-03-03T09:14:39,331 adding 'colossalai/booster/mixed_precision/__init__.py' 2025-03-03T09:14:39,332 adding 'colossalai/booster/mixed_precision/bf16.py' 2025-03-03T09:14:39,334 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2025-03-03T09:14:39,335 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2025-03-03T09:14:39,336 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2025-03-03T09:14:39,337 adding 'colossalai/booster/mixed_precision/fp8.py' 2025-03-03T09:14:39,338 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2025-03-03T09:14:39,340 adding 'colossalai/booster/plugin/__init__.py' 2025-03-03T09:14:39,342 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2025-03-03T09:14:39,345 adding 'colossalai/booster/plugin/gemini_plugin.py' 2025-03-03T09:14:39,353 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2025-03-03T09:14:39,357 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2025-03-03T09:14:39,360 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2025-03-03T09:14:39,361 adding 'colossalai/booster/plugin/plugin_base.py' 2025-03-03T09:14:39,363 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2025-03-03T09:14:39,364 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2025-03-03T09:14:39,367 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2025-03-03T09:14:39,369 adding 'colossalai/checkpoint_io/__init__.py' 2025-03-03T09:14:39,371 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2025-03-03T09:14:39,373 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2025-03-03T09:14:39,378 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2025-03-03T09:14:39,380 adding 'colossalai/checkpoint_io/index_file.py' 2025-03-03T09:14:39,384 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2025-03-03T09:14:39,390 adding 'colossalai/checkpoint_io/utils.py' 2025-03-03T09:14:39,392 adding 'colossalai/cli/__init__.py' 2025-03-03T09:14:39,393 adding 'colossalai/cli/cli.py' 2025-03-03T09:14:39,395 adding 'colossalai/cli/check/__init__.py' 2025-03-03T09:14:39,397 adding 'colossalai/cli/check/check_installation.py' 2025-03-03T09:14:39,399 adding 'colossalai/cli/launcher/__init__.py' 2025-03-03T09:14:39,400 adding 'colossalai/cli/launcher/hostinfo.py' 2025-03-03T09:14:39,402 adding 'colossalai/cli/launcher/multinode_runner.py' 2025-03-03T09:14:39,404 adding 'colossalai/cli/launcher/run.py' 2025-03-03T09:14:39,405 adding 'colossalai/cluster/__init__.py' 2025-03-03T09:14:39,407 adding 'colossalai/cluster/device_mesh_manager.py' 2025-03-03T09:14:39,408 adding 'colossalai/cluster/dist_coordinator.py' 2025-03-03T09:14:39,410 adding 'colossalai/cluster/process_group_manager.py' 2025-03-03T09:14:39,412 adding 'colossalai/cluster/process_group_mesh.py' 2025-03-03T09:14:39,414 adding 'colossalai/context/__init__.py' 2025-03-03T09:14:39,415 adding 'colossalai/context/config.py' 2025-03-03T09:14:39,416 adding 'colossalai/context/singleton_meta.py' 2025-03-03T09:14:39,418 adding 'colossalai/device/__init__.py' 2025-03-03T09:14:39,420 adding 'colossalai/device/alpha_beta_profiler.py' 2025-03-03T09:14:39,422 adding 'colossalai/device/calc_pipeline_strategy.py' 2025-03-03T09:14:39,425 adding 'colossalai/device/device_mesh.py' 2025-03-03T09:14:39,426 adding 'colossalai/fx/__init__.py' 2025-03-03T09:14:39,428 adding 'colossalai/fx/_compatibility.py' 2025-03-03T09:14:39,430 adding 'colossalai/fx/_meta_regist_12.py' 2025-03-03T09:14:39,432 adding 'colossalai/fx/_meta_regist_13.py' 2025-03-03T09:14:39,433 adding 'colossalai/fx/graph_module.py' 2025-03-03T09:14:39,435 adding 'colossalai/fx/proxy.py' 2025-03-03T09:14:39,436 adding 'colossalai/fx/codegen/__init__.py' 2025-03-03T09:14:39,441 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2025-03-03T09:14:39,443 adding 'colossalai/fx/passes/__init__.py' 2025-03-03T09:14:39,444 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2025-03-03T09:14:39,446 adding 'colossalai/fx/passes/concrete_info_prop.py' 2025-03-03T09:14:39,448 adding 'colossalai/fx/passes/meta_info_prop.py' 2025-03-03T09:14:39,450 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2025-03-03T09:14:39,452 adding 'colossalai/fx/passes/shard_1d_pass.py' 2025-03-03T09:14:39,454 adding 'colossalai/fx/passes/split_module.py' 2025-03-03T09:14:39,456 adding 'colossalai/fx/passes/utils.py' 2025-03-03T09:14:39,457 adding 'colossalai/fx/profiler/__init__.py' 2025-03-03T09:14:39,459 adding 'colossalai/fx/profiler/constants.py' 2025-03-03T09:14:39,460 adding 'colossalai/fx/profiler/dataflow.py' 2025-03-03T09:14:39,462 adding 'colossalai/fx/profiler/memory_utils.py' 2025-03-03T09:14:39,463 adding 'colossalai/fx/profiler/opcount.py' 2025-03-03T09:14:39,466 adding 'colossalai/fx/profiler/profiler.py' 2025-03-03T09:14:39,467 adding 'colossalai/fx/profiler/shard_utils.py' 2025-03-03T09:14:39,469 adding 'colossalai/fx/profiler/tensor.py' 2025-03-03T09:14:39,470 adding 'colossalai/fx/profiler/experimental/__init__.py' 2025-03-03T09:14:39,471 adding 'colossalai/fx/profiler/experimental/constants.py' 2025-03-03T09:14:39,473 adding 'colossalai/fx/profiler/experimental/profiler.py' 2025-03-03T09:14:39,474 adding 'colossalai/fx/profiler/experimental/registry.py' 2025-03-03T09:14:39,475 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2025-03-03T09:14:39,477 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2025-03-03T09:14:39,478 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2025-03-03T09:14:39,479 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2025-03-03T09:14:39,480 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2025-03-03T09:14:39,481 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2025-03-03T09:14:39,483 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2025-03-03T09:14:39,484 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2025-03-03T09:14:39,485 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2025-03-03T09:14:39,486 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2025-03-03T09:14:39,488 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2025-03-03T09:14:39,489 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2025-03-03T09:14:39,491 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2025-03-03T09:14:39,492 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2025-03-03T09:14:39,493 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2025-03-03T09:14:39,495 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2025-03-03T09:14:39,496 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2025-03-03T09:14:39,497 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2025-03-03T09:14:39,499 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2025-03-03T09:14:39,500 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2025-03-03T09:14:39,502 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2025-03-03T09:14:39,503 adding 'colossalai/fx/tracer/__init__.py' 2025-03-03T09:14:39,505 adding 'colossalai/fx/tracer/_meta_trace.py' 2025-03-03T09:14:39,506 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2025-03-03T09:14:39,507 adding 'colossalai/fx/tracer/_tracer_utils.py' 2025-03-03T09:14:39,511 adding 'colossalai/fx/tracer/experimental.py' 2025-03-03T09:14:39,512 adding 'colossalai/fx/tracer/registry.py' 2025-03-03T09:14:39,515 adding 'colossalai/fx/tracer/tracer.py' 2025-03-03T09:14:39,517 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2025-03-03T09:14:39,519 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2025-03-03T09:14:39,520 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2025-03-03T09:14:39,521 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2025-03-03T09:14:39,523 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2025-03-03T09:14:39,524 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2025-03-03T09:14:39,525 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2025-03-03T09:14:39,527 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2025-03-03T09:14:39,528 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2025-03-03T09:14:39,529 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2025-03-03T09:14:39,531 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2025-03-03T09:14:39,532 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2025-03-03T09:14:39,533 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2025-03-03T09:14:39,535 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2025-03-03T09:14:39,536 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2025-03-03T09:14:39,537 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2025-03-03T09:14:39,539 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2025-03-03T09:14:39,540 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2025-03-03T09:14:39,541 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2025-03-03T09:14:39,543 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2025-03-03T09:14:39,544 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2025-03-03T09:14:39,546 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2025-03-03T09:14:39,547 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2025-03-03T09:14:39,548 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2025-03-03T09:14:39,550 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2025-03-03T09:14:39,551 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2025-03-03T09:14:39,552 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2025-03-03T09:14:39,554 adding 'colossalai/inference/__init__.py' 2025-03-03T09:14:39,557 adding 'colossalai/inference/batch_bucket.py' 2025-03-03T09:14:39,560 adding 'colossalai/inference/config.py' 2025-03-03T09:14:39,562 adding 'colossalai/inference/flash_decoding_utils.py' 2025-03-03T09:14:39,563 adding 'colossalai/inference/graph_runner.py' 2025-03-03T09:14:39,565 adding 'colossalai/inference/logit_processors.py' 2025-03-03T09:14:39,566 adding 'colossalai/inference/sampler.py' 2025-03-03T09:14:39,568 adding 'colossalai/inference/struct.py' 2025-03-03T09:14:39,570 adding 'colossalai/inference/utils.py' 2025-03-03T09:14:39,571 adding 'colossalai/inference/core/__init__.py' 2025-03-03T09:14:39,573 adding 'colossalai/inference/core/async_engine.py' 2025-03-03T09:14:39,575 adding 'colossalai/inference/core/base_engine.py' 2025-03-03T09:14:39,577 adding 'colossalai/inference/core/diffusion_engine.py' 2025-03-03T09:14:39,578 adding 'colossalai/inference/core/engine.py' 2025-03-03T09:14:39,582 adding 'colossalai/inference/core/llm_engine.py' 2025-03-03T09:14:39,584 adding 'colossalai/inference/core/plugin.py' 2025-03-03T09:14:39,587 adding 'colossalai/inference/core/request_handler.py' 2025-03-03T09:14:39,589 adding 'colossalai/inference/core/rpc_engine.py' 2025-03-03T09:14:39,590 adding 'colossalai/inference/executor/__init__.py' 2025-03-03T09:14:39,592 adding 'colossalai/inference/executor/rpc_worker.py' 2025-03-03T09:14:39,594 adding 'colossalai/inference/kv_cache/__init__.py' 2025-03-03T09:14:39,595 adding 'colossalai/inference/kv_cache/block_cache.py' 2025-03-03T09:14:39,598 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2025-03-03T09:14:39,600 adding 'colossalai/inference/modeling/__init__.py' 2025-03-03T09:14:39,601 adding 'colossalai/inference/modeling/backends/__init__.py' 2025-03-03T09:14:39,603 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2025-03-03T09:14:39,604 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2025-03-03T09:14:39,606 adding 'colossalai/inference/modeling/layers/__init__.py' 2025-03-03T09:14:39,608 adding 'colossalai/inference/modeling/layers/attention.py' 2025-03-03T09:14:39,610 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2025-03-03T09:14:39,611 adding 'colossalai/inference/modeling/layers/diffusion.py' 2025-03-03T09:14:39,614 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2025-03-03T09:14:39,615 adding 'colossalai/inference/modeling/models/__init__.py' 2025-03-03T09:14:39,618 adding 'colossalai/inference/modeling/models/glide_llama.py' 2025-03-03T09:14:39,620 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2025-03-03T09:14:39,623 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2025-03-03T09:14:39,625 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2025-03-03T09:14:39,626 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2025-03-03T09:14:39,628 adding 'colossalai/inference/modeling/policy/__init__.py' 2025-03-03T09:14:39,629 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2025-03-03T09:14:39,631 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2025-03-03T09:14:39,632 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2025-03-03T09:14:39,634 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2025-03-03T09:14:39,635 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2025-03-03T09:14:39,636 adding 'colossalai/inference/server/__init__.py' 2025-03-03T09:14:39,638 adding 'colossalai/inference/server/api_server.py' 2025-03-03T09:14:39,640 adding 'colossalai/inference/server/chat_service.py' 2025-03-03T09:14:39,641 adding 'colossalai/inference/server/completion_service.py' 2025-03-03T09:14:39,642 adding 'colossalai/inference/server/utils.py' 2025-03-03T09:14:39,644 adding 'colossalai/inference/spec/__init__.py' 2025-03-03T09:14:39,645 adding 'colossalai/inference/spec/drafter.py' 2025-03-03T09:14:39,647 adding 'colossalai/inference/spec/struct.py' 2025-03-03T09:14:39,648 adding 'colossalai/interface/__init__.py' 2025-03-03T09:14:39,650 adding 'colossalai/interface/model.py' 2025-03-03T09:14:39,651 adding 'colossalai/interface/optimizer.py' 2025-03-03T09:14:39,653 adding 'colossalai/interface/pretrained.py' 2025-03-03T09:14:39,654 adding 'colossalai/kernel/__init__.py' 2025-03-03T09:14:39,656 adding 'colossalai/kernel/kernel_loader.py' 2025-03-03T09:14:39,658 adding 'colossalai/kernel/extensions/__init__.py' 2025-03-03T09:14:39,659 adding 'colossalai/kernel/extensions/base_extension.py' 2025-03-03T09:14:39,661 adding 'colossalai/kernel/extensions/cpp_extension.py' 2025-03-03T09:14:39,662 adding 'colossalai/kernel/extensions/cuda_extension.py' 2025-03-03T09:14:39,664 adding 'colossalai/kernel/extensions/triton_extension.py' 2025-03-03T09:14:39,665 adding 'colossalai/kernel/extensions/utils.py' 2025-03-03T09:14:39,667 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2025-03-03T09:14:39,669 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2025-03-03T09:14:39,671 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2025-03-03T09:14:39,673 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2025-03-03T09:14:39,674 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2025-03-03T09:14:39,675 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2025-03-03T09:14:39,678 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2025-03-03T09:14:39,680 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2025-03-03T09:14:39,681 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2025-03-03T09:14:39,682 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2025-03-03T09:14:39,684 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2025-03-03T09:14:39,686 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2025-03-03T09:14:39,688 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2025-03-03T09:14:39,690 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2025-03-03T09:14:39,691 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2025-03-03T09:14:39,693 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2025-03-03T09:14:39,694 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2025-03-03T09:14:39,698 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2025-03-03T09:14:39,700 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2025-03-03T09:14:39,702 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2025-03-03T09:14:39,705 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2025-03-03T09:14:39,707 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2025-03-03T09:14:39,709 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2025-03-03T09:14:39,710 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2025-03-03T09:14:39,712 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2025-03-03T09:14:39,714 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2025-03-03T09:14:39,716 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2025-03-03T09:14:39,717 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2025-03-03T09:14:39,720 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2025-03-03T09:14:39,722 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2025-03-03T09:14:39,724 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2025-03-03T09:14:39,727 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2025-03-03T09:14:39,729 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2025-03-03T09:14:39,730 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2025-03-03T09:14:39,731 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2025-03-03T09:14:39,732 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2025-03-03T09:14:39,735 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2025-03-03T09:14:39,737 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2025-03-03T09:14:39,738 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2025-03-03T09:14:39,740 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2025-03-03T09:14:39,742 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-03-03T09:14:39,743 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-03-03T09:14:39,745 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2025-03-03T09:14:39,747 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-03-03T09:14:39,748 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2025-03-03T09:14:39,750 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-03-03T09:14:39,752 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2025-03-03T09:14:39,754 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2025-03-03T09:14:39,755 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2025-03-03T09:14:39,758 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2025-03-03T09:14:39,759 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2025-03-03T09:14:39,761 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2025-03-03T09:14:39,763 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2025-03-03T09:14:39,765 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2025-03-03T09:14:39,766 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2025-03-03T09:14:39,768 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2025-03-03T09:14:39,770 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-03-03T09:14:39,772 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2025-03-03T09:14:39,774 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2025-03-03T09:14:39,775 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2025-03-03T09:14:39,777 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-03-03T09:14:39,779 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2025-03-03T09:14:39,780 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-03-03T09:14:39,783 adding 'colossalai/kernel/jit/__init__.py' 2025-03-03T09:14:39,784 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2025-03-03T09:14:39,786 adding 'colossalai/kernel/jit/bias_gelu.py' 2025-03-03T09:14:39,787 adding 'colossalai/kernel/jit/option.py' 2025-03-03T09:14:39,789 adding 'colossalai/kernel/triton/__init__.py' 2025-03-03T09:14:39,792 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2025-03-03T09:14:39,795 adding 'colossalai/kernel/triton/flash_decoding.py' 2025-03-03T09:14:39,796 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2025-03-03T09:14:39,798 adding 'colossalai/kernel/triton/kvcache_copy.py' 2025-03-03T09:14:39,800 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2025-03-03T09:14:39,802 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2025-03-03T09:14:39,804 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2025-03-03T09:14:39,813 adding 'colossalai/kernel/triton/rms_layernorm.py' 2025-03-03T09:14:39,815 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2025-03-03T09:14:39,817 adding 'colossalai/kernel/triton/softmax.py' 2025-03-03T09:14:39,818 adding 'colossalai/lazy/__init__.py' 2025-03-03T09:14:39,820 adding 'colossalai/lazy/construction.py' 2025-03-03T09:14:39,823 adding 'colossalai/lazy/lazy_init.py' 2025-03-03T09:14:39,825 adding 'colossalai/lazy/pretrained.py' 2025-03-03T09:14:39,827 adding 'colossalai/legacy/__init__.py' 2025-03-03T09:14:39,828 adding 'colossalai/legacy/constants.py' 2025-03-03T09:14:39,829 adding 'colossalai/legacy/core.py' 2025-03-03T09:14:39,831 adding 'colossalai/legacy/global_variables.py' 2025-03-03T09:14:39,833 adding 'colossalai/legacy/initialize.py' 2025-03-03T09:14:39,835 adding 'colossalai/legacy/amp/__init__.py' 2025-03-03T09:14:39,836 adding 'colossalai/legacy/amp/amp_type.py' 2025-03-03T09:14:39,838 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2025-03-03T09:14:39,839 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2025-03-03T09:14:39,841 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2025-03-03T09:14:39,844 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2025-03-03T09:14:39,845 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2025-03-03T09:14:39,846 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2025-03-03T09:14:39,848 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2025-03-03T09:14:39,851 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2025-03-03T09:14:39,852 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2025-03-03T09:14:39,855 adding 'colossalai/legacy/builder/__init__.py' 2025-03-03T09:14:39,856 adding 'colossalai/legacy/builder/builder.py' 2025-03-03T09:14:39,858 adding 'colossalai/legacy/communication/__init__.py' 2025-03-03T09:14:39,860 adding 'colossalai/legacy/communication/collective.py' 2025-03-03T09:14:39,862 adding 'colossalai/legacy/communication/p2p.py' 2025-03-03T09:14:39,863 adding 'colossalai/legacy/communication/p2p_v2.py' 2025-03-03T09:14:39,865 adding 'colossalai/legacy/communication/ring.py' 2025-03-03T09:14:39,866 adding 'colossalai/legacy/communication/utils.py' 2025-03-03T09:14:39,868 adding 'colossalai/legacy/context/__init__.py' 2025-03-03T09:14:39,870 adding 'colossalai/legacy/context/parallel_context.py' 2025-03-03T09:14:39,871 adding 'colossalai/legacy/context/parallel_mode.py' 2025-03-03T09:14:39,873 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2025-03-03T09:14:39,875 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2025-03-03T09:14:39,876 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2025-03-03T09:14:39,878 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2025-03-03T09:14:39,879 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2025-03-03T09:14:39,881 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2025-03-03T09:14:39,882 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2025-03-03T09:14:39,883 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2025-03-03T09:14:39,885 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2025-03-03T09:14:39,886 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2025-03-03T09:14:39,887 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2025-03-03T09:14:39,889 adding 'colossalai/legacy/context/random/__init__.py' 2025-03-03T09:14:39,890 adding 'colossalai/legacy/context/random/_helper.py' 2025-03-03T09:14:39,891 adding 'colossalai/legacy/context/random/seed_manager.py' 2025-03-03T09:14:39,893 adding 'colossalai/legacy/engine/__init__.py' 2025-03-03T09:14:39,895 adding 'colossalai/legacy/engine/_base_engine.py' 2025-03-03T09:14:39,897 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2025-03-03T09:14:39,899 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2025-03-03T09:14:39,900 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2025-03-03T09:14:39,902 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2025-03-03T09:14:39,903 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2025-03-03T09:14:39,904 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2025-03-03T09:14:39,906 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2025-03-03T09:14:39,907 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2025-03-03T09:14:39,908 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2025-03-03T09:14:39,910 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2025-03-03T09:14:39,911 adding 'colossalai/legacy/engine/schedule/__init__.py' 2025-03-03T09:14:39,913 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2025-03-03T09:14:39,914 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2025-03-03T09:14:39,918 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2025-03-03T09:14:39,920 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2025-03-03T09:14:39,922 adding 'colossalai/legacy/inference/__init__.py' 2025-03-03T09:14:39,923 adding 'colossalai/legacy/inference/async_engine.py' 2025-03-03T09:14:39,924 adding 'colossalai/legacy/inference/async_manager.py' 2025-03-03T09:14:39,926 adding 'colossalai/legacy/inference/manager.py' 2025-03-03T09:14:39,928 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2025-03-03T09:14:39,929 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2025-03-03T09:14:39,931 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2025-03-03T09:14:39,932 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2025-03-03T09:14:39,934 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2025-03-03T09:14:39,935 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2025-03-03T09:14:39,936 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2025-03-03T09:14:39,938 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2025-03-03T09:14:39,939 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2025-03-03T09:14:39,940 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2025-03-03T09:14:39,942 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2025-03-03T09:14:39,944 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2025-03-03T09:14:39,945 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2025-03-03T09:14:39,947 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2025-03-03T09:14:39,949 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2025-03-03T09:14:39,950 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2025-03-03T09:14:39,952 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2025-03-03T09:14:39,954 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2025-03-03T09:14:39,956 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2025-03-03T09:14:39,957 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2025-03-03T09:14:39,960 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2025-03-03T09:14:39,962 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2025-03-03T09:14:39,964 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2025-03-03T09:14:39,965 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2025-03-03T09:14:39,968 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2025-03-03T09:14:39,971 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2025-03-03T09:14:39,973 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2025-03-03T09:14:39,975 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2025-03-03T09:14:39,977 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2025-03-03T09:14:39,978 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2025-03-03T09:14:39,979 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2025-03-03T09:14:39,981 adding 'colossalai/legacy/nn/__init__.py' 2025-03-03T09:14:39,983 adding 'colossalai/legacy/nn/_ops/__init__.py' 2025-03-03T09:14:39,984 adding 'colossalai/legacy/nn/_ops/_utils.py' 2025-03-03T09:14:39,986 adding 'colossalai/legacy/nn/layer/__init__.py' 2025-03-03T09:14:39,987 adding 'colossalai/legacy/nn/layer/base_layer.py' 2025-03-03T09:14:39,989 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2025-03-03T09:14:39,991 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2025-03-03T09:14:39,992 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2025-03-03T09:14:39,994 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2025-03-03T09:14:39,996 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2025-03-03T09:14:39,997 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2025-03-03T09:14:39,999 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2025-03-03T09:14:40,000 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2025-03-03T09:14:40,002 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2025-03-03T09:14:40,006 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2025-03-03T09:14:40,008 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2025-03-03T09:14:40,011 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2025-03-03T09:14:40,013 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2025-03-03T09:14:40,017 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2025-03-03T09:14:40,020 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2025-03-03T09:14:40,023 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2025-03-03T09:14:40,025 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2025-03-03T09:14:40,029 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2025-03-03T09:14:40,032 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2025-03-03T09:14:40,034 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2025-03-03T09:14:40,036 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2025-03-03T09:14:40,040 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2025-03-03T09:14:40,043 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2025-03-03T09:14:40,044 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2025-03-03T09:14:40,046 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2025-03-03T09:14:40,048 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2025-03-03T09:14:40,050 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2025-03-03T09:14:40,052 adding 'colossalai/legacy/nn/layer/utils/common.py' 2025-03-03T09:14:40,054 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2025-03-03T09:14:40,057 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2025-03-03T09:14:40,059 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2025-03-03T09:14:40,061 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2025-03-03T09:14:40,063 adding 'colossalai/legacy/nn/loss/__init__.py' 2025-03-03T09:14:40,065 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2025-03-03T09:14:40,067 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2025-03-03T09:14:40,069 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2025-03-03T09:14:40,071 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2025-03-03T09:14:40,073 adding 'colossalai/legacy/nn/metric/__init__.py' 2025-03-03T09:14:40,074 adding 'colossalai/legacy/nn/metric/_utils.py' 2025-03-03T09:14:40,076 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2025-03-03T09:14:40,078 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2025-03-03T09:14:40,079 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2025-03-03T09:14:40,081 adding 'colossalai/legacy/nn/parallel/__init__.py' 2025-03-03T09:14:40,083 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2025-03-03T09:14:40,085 adding 'colossalai/legacy/nn/parallel/reducer.py' 2025-03-03T09:14:40,087 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2025-03-03T09:14:40,088 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2025-03-03T09:14:40,090 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2025-03-03T09:14:40,091 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2025-03-03T09:14:40,093 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2025-03-03T09:14:40,095 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2025-03-03T09:14:40,097 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2025-03-03T09:14:40,100 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2025-03-03T09:14:40,102 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2025-03-03T09:14:40,104 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2025-03-03T09:14:40,105 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2025-03-03T09:14:40,107 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2025-03-03T09:14:40,109 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2025-03-03T09:14:40,111 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2025-03-03T09:14:40,113 adding 'colossalai/legacy/pipeline/__init__.py' 2025-03-03T09:14:40,115 adding 'colossalai/legacy/pipeline/layer_spec.py' 2025-03-03T09:14:40,117 adding 'colossalai/legacy/pipeline/pipelinable.py' 2025-03-03T09:14:40,119 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2025-03-03T09:14:40,121 adding 'colossalai/legacy/pipeline/utils.py' 2025-03-03T09:14:40,123 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2025-03-03T09:14:40,125 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2025-03-03T09:14:40,126 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2025-03-03T09:14:40,128 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2025-03-03T09:14:40,130 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2025-03-03T09:14:40,137 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2025-03-03T09:14:40,139 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2025-03-03T09:14:40,141 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2025-03-03T09:14:40,143 adding 'colossalai/legacy/registry/__init__.py' 2025-03-03T09:14:40,145 adding 'colossalai/legacy/registry/registry.py' 2025-03-03T09:14:40,147 adding 'colossalai/legacy/tensor/__init__.py' 2025-03-03T09:14:40,149 adding 'colossalai/legacy/tensor/compute_spec.py' 2025-03-03T09:14:40,150 adding 'colossalai/legacy/tensor/const.py' 2025-03-03T09:14:40,152 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2025-03-03T09:14:40,153 adding 'colossalai/legacy/tensor/distspec.py' 2025-03-03T09:14:40,155 adding 'colossalai/legacy/tensor/op_wrapper.py' 2025-03-03T09:14:40,157 adding 'colossalai/legacy/tensor/process_group.py' 2025-03-03T09:14:40,159 adding 'colossalai/legacy/tensor/tensor_spec.py' 2025-03-03T09:14:40,161 adding 'colossalai/legacy/trainer/__init__.py' 2025-03-03T09:14:40,163 adding 'colossalai/legacy/trainer/_trainer.py' 2025-03-03T09:14:40,165 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2025-03-03T09:14:40,167 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2025-03-03T09:14:40,169 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2025-03-03T09:14:40,170 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2025-03-03T09:14:40,172 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2025-03-03T09:14:40,174 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2025-03-03T09:14:40,176 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2025-03-03T09:14:40,179 adding 'colossalai/legacy/utils/__init__.py' 2025-03-03T09:14:40,181 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2025-03-03T09:14:40,183 adding 'colossalai/legacy/utils/checkpointing.py' 2025-03-03T09:14:40,186 adding 'colossalai/legacy/utils/common.py' 2025-03-03T09:14:40,188 adding 'colossalai/legacy/utils/memory.py' 2025-03-03T09:14:40,190 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2025-03-03T09:14:40,192 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2025-03-03T09:14:40,193 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2025-03-03T09:14:40,195 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2025-03-03T09:14:40,197 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2025-03-03T09:14:40,199 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2025-03-03T09:14:40,201 adding 'colossalai/legacy/utils/profiler/__init__.py' 2025-03-03T09:14:40,202 adding 'colossalai/legacy/utils/profiler/extention.py' 2025-03-03T09:14:40,204 adding 'colossalai/legacy/utils/profiler/profiler.py' 2025-03-03T09:14:40,206 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2025-03-03T09:14:40,208 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2025-03-03T09:14:40,210 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2025-03-03T09:14:40,212 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2025-03-03T09:14:40,214 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2025-03-03T09:14:40,216 adding 'colossalai/legacy/zero/__init__.py' 2025-03-03T09:14:40,218 adding 'colossalai/legacy/zero/gemini/__init__.py' 2025-03-03T09:14:40,220 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2025-03-03T09:14:40,222 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2025-03-03T09:14:40,223 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2025-03-03T09:14:40,225 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2025-03-03T09:14:40,226 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2025-03-03T09:14:40,228 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2025-03-03T09:14:40,229 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2025-03-03T09:14:40,231 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2025-03-03T09:14:40,232 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2025-03-03T09:14:40,233 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2025-03-03T09:14:40,235 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2025-03-03T09:14:40,237 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2025-03-03T09:14:40,238 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2025-03-03T09:14:40,239 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2025-03-03T09:14:40,241 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2025-03-03T09:14:40,243 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2025-03-03T09:14:40,244 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2025-03-03T09:14:40,246 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2025-03-03T09:14:40,247 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2025-03-03T09:14:40,248 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2025-03-03T09:14:40,250 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2025-03-03T09:14:40,251 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2025-03-03T09:14:40,253 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2025-03-03T09:14:40,257 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2025-03-03T09:14:40,258 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2025-03-03T09:14:40,259 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2025-03-03T09:14:40,261 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2025-03-03T09:14:40,264 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2025-03-03T09:14:40,266 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2025-03-03T09:14:40,267 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2025-03-03T09:14:40,268 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2025-03-03T09:14:40,270 adding 'colossalai/logging/__init__.py' 2025-03-03T09:14:40,272 adding 'colossalai/logging/logger.py' 2025-03-03T09:14:40,274 adding 'colossalai/moe/__init__.py' 2025-03-03T09:14:40,276 adding 'colossalai/moe/_operation.py' 2025-03-03T09:14:40,278 adding 'colossalai/nn/__init__.py' 2025-03-03T09:14:40,279 adding 'colossalai/nn/init.py' 2025-03-03T09:14:40,281 adding 'colossalai/nn/layer/__init__.py' 2025-03-03T09:14:40,282 adding 'colossalai/nn/layer/layernorm.py' 2025-03-03T09:14:40,284 adding 'colossalai/nn/layer/scaled_softmax.py' 2025-03-03T09:14:40,285 adding 'colossalai/nn/layer/utils.py' 2025-03-03T09:14:40,287 adding 'colossalai/nn/loss/__init__.py' 2025-03-03T09:14:40,288 adding 'colossalai/nn/lr_scheduler/__init__.py' 2025-03-03T09:14:40,290 adding 'colossalai/nn/lr_scheduler/cosine.py' 2025-03-03T09:14:40,291 adding 'colossalai/nn/lr_scheduler/delayed.py' 2025-03-03T09:14:40,292 adding 'colossalai/nn/lr_scheduler/linear.py' 2025-03-03T09:14:40,294 adding 'colossalai/nn/lr_scheduler/multistep.py' 2025-03-03T09:14:40,295 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2025-03-03T09:14:40,296 adding 'colossalai/nn/lr_scheduler/poly.py' 2025-03-03T09:14:40,298 adding 'colossalai/nn/lr_scheduler/torch.py' 2025-03-03T09:14:40,300 adding 'colossalai/nn/optimizer/__init__.py' 2025-03-03T09:14:40,301 adding 'colossalai/nn/optimizer/adafactor.py' 2025-03-03T09:14:40,303 adding 'colossalai/nn/optimizer/came.py' 2025-03-03T09:14:40,304 adding 'colossalai/nn/optimizer/cpu_adam.py' 2025-03-03T09:14:40,307 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2025-03-03T09:14:40,309 adding 'colossalai/nn/optimizer/distributed_came.py' 2025-03-03T09:14:40,311 adding 'colossalai/nn/optimizer/distributed_galore.py' 2025-03-03T09:14:40,313 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2025-03-03T09:14:40,315 adding 'colossalai/nn/optimizer/fused_adam.py' 2025-03-03T09:14:40,316 adding 'colossalai/nn/optimizer/fused_lamb.py' 2025-03-03T09:14:40,318 adding 'colossalai/nn/optimizer/fused_sgd.py' 2025-03-03T09:14:40,320 adding 'colossalai/nn/optimizer/galore.py' 2025-03-03T09:14:40,322 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2025-03-03T09:14:40,323 adding 'colossalai/nn/optimizer/lamb.py' 2025-03-03T09:14:40,325 adding 'colossalai/nn/optimizer/lars.py' 2025-03-03T09:14:40,326 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2025-03-03T09:14:40,328 adding 'colossalai/pipeline/__init__.py' 2025-03-03T09:14:40,331 adding 'colossalai/pipeline/p2p.py' 2025-03-03T09:14:40,333 adding 'colossalai/pipeline/stage_manager.py' 2025-03-03T09:14:40,334 adding 'colossalai/pipeline/weight_grad_store.py' 2025-03-03T09:14:40,336 adding 'colossalai/pipeline/schedule/__init__.py' 2025-03-03T09:14:40,338 adding 'colossalai/pipeline/schedule/_utils.py' 2025-03-03T09:14:40,339 adding 'colossalai/pipeline/schedule/base.py' 2025-03-03T09:14:40,341 adding 'colossalai/pipeline/schedule/generate.py' 2025-03-03T09:14:40,344 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2025-03-03T09:14:40,347 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2025-03-03T09:14:40,349 adding 'colossalai/pipeline/schedule/v_schedule.py' 2025-03-03T09:14:40,354 adding 'colossalai/pipeline/schedule/zero_bubble_pp.py' 2025-03-03T09:14:40,355 adding 'colossalai/quantization/__init__.py' 2025-03-03T09:14:40,358 adding 'colossalai/quantization/bnb.py' 2025-03-03T09:14:40,359 adding 'colossalai/quantization/bnb_config.py' 2025-03-03T09:14:40,363 adding 'colossalai/quantization/fp8.py' 2025-03-03T09:14:40,364 adding 'colossalai/quantization/fp8_config.py' 2025-03-03T09:14:40,366 adding 'colossalai/quantization/fp8_hook.py' 2025-03-03T09:14:40,367 adding 'colossalai/quantization/utils.py' 2025-03-03T09:14:40,369 adding 'colossalai/shardformer/__init__.py' 2025-03-03T09:14:40,370 adding 'colossalai/shardformer/_utils.py' 2025-03-03T09:14:40,372 adding 'colossalai/shardformer/layer/__init__.py' 2025-03-03T09:14:40,376 adding 'colossalai/shardformer/layer/_operation.py' 2025-03-03T09:14:40,383 adding 'colossalai/shardformer/layer/attn.py' 2025-03-03T09:14:40,384 adding 'colossalai/shardformer/layer/dropout.py' 2025-03-03T09:14:40,386 adding 'colossalai/shardformer/layer/embedding.py' 2025-03-03T09:14:40,389 adding 'colossalai/shardformer/layer/linear.py' 2025-03-03T09:14:40,392 adding 'colossalai/shardformer/layer/loss.py' 2025-03-03T09:14:40,393 adding 'colossalai/shardformer/layer/normalization.py' 2025-03-03T09:14:40,395 adding 'colossalai/shardformer/layer/parallel_module.py' 2025-03-03T09:14:40,399 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2025-03-03T09:14:40,401 adding 'colossalai/shardformer/layer/utils.py' 2025-03-03T09:14:40,403 adding 'colossalai/shardformer/modeling/__init__.py' 2025-03-03T09:14:40,407 adding 'colossalai/shardformer/modeling/bert.py' 2025-03-03T09:14:40,409 adding 'colossalai/shardformer/modeling/blip2.py' 2025-03-03T09:14:40,414 adding 'colossalai/shardformer/modeling/bloom.py' 2025-03-03T09:14:40,417 adding 'colossalai/shardformer/modeling/chatglm2.py' 2025-03-03T09:14:40,420 adding 'colossalai/shardformer/modeling/command.py' 2025-03-03T09:14:40,424 adding 'colossalai/shardformer/modeling/deepseek.py' 2025-03-03T09:14:40,426 adding 'colossalai/shardformer/modeling/deepseek_v3.py' 2025-03-03T09:14:40,430 adding 'colossalai/shardformer/modeling/falcon.py' 2025-03-03T09:14:40,434 adding 'colossalai/shardformer/modeling/gpt2.py' 2025-03-03T09:14:40,438 adding 'colossalai/shardformer/modeling/gptj.py' 2025-03-03T09:14:40,439 adding 'colossalai/shardformer/modeling/jit.py' 2025-03-03T09:14:40,442 adding 'colossalai/shardformer/modeling/llama.py' 2025-03-03T09:14:40,445 adding 'colossalai/shardformer/modeling/mistral.py' 2025-03-03T09:14:40,449 adding 'colossalai/shardformer/modeling/mixtral.py' 2025-03-03T09:14:40,454 adding 'colossalai/shardformer/modeling/opt.py' 2025-03-03T09:14:40,457 adding 'colossalai/shardformer/modeling/qwen2.py' 2025-03-03T09:14:40,458 adding 'colossalai/shardformer/modeling/sam.py' 2025-03-03T09:14:40,462 adding 'colossalai/shardformer/modeling/t5.py' 2025-03-03T09:14:40,464 adding 'colossalai/shardformer/modeling/vit.py' 2025-03-03T09:14:40,469 adding 'colossalai/shardformer/modeling/whisper.py' 2025-03-03T09:14:40,471 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2025-03-03T09:14:40,472 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2025-03-03T09:14:40,478 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2025-03-03T09:14:40,480 adding 'colossalai/shardformer/policies/__init__.py' 2025-03-03T09:14:40,482 adding 'colossalai/shardformer/policies/auto_policy.py' 2025-03-03T09:14:40,484 adding 'colossalai/shardformer/policies/base_policy.py' 2025-03-03T09:14:40,486 adding 'colossalai/shardformer/policies/bert.py' 2025-03-03T09:14:40,489 adding 'colossalai/shardformer/policies/blip2.py' 2025-03-03T09:14:40,491 adding 'colossalai/shardformer/policies/bloom.py' 2025-03-03T09:14:40,493 adding 'colossalai/shardformer/policies/chatglm2.py' 2025-03-03T09:14:40,495 adding 'colossalai/shardformer/policies/command.py' 2025-03-03T09:14:40,498 adding 'colossalai/shardformer/policies/deepseek.py' 2025-03-03T09:14:40,499 adding 'colossalai/shardformer/policies/deepseek_v3.py' 2025-03-03T09:14:40,502 adding 'colossalai/shardformer/policies/falcon.py' 2025-03-03T09:14:40,504 adding 'colossalai/shardformer/policies/gpt2.py' 2025-03-03T09:14:40,506 adding 'colossalai/shardformer/policies/gptj.py' 2025-03-03T09:14:40,509 adding 'colossalai/shardformer/policies/llama.py' 2025-03-03T09:14:40,511 adding 'colossalai/shardformer/policies/mistral.py' 2025-03-03T09:14:40,513 adding 'colossalai/shardformer/policies/mixtral.py' 2025-03-03T09:14:40,515 adding 'colossalai/shardformer/policies/opt.py' 2025-03-03T09:14:40,518 adding 'colossalai/shardformer/policies/qwen2.py' 2025-03-03T09:14:40,520 adding 'colossalai/shardformer/policies/sam.py' 2025-03-03T09:14:40,523 adding 'colossalai/shardformer/policies/t5.py' 2025-03-03T09:14:40,525 adding 'colossalai/shardformer/policies/vit.py' 2025-03-03T09:14:40,528 adding 'colossalai/shardformer/policies/whisper.py' 2025-03-03T09:14:40,530 adding 'colossalai/shardformer/shard/__init__.py' 2025-03-03T09:14:40,531 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2025-03-03T09:14:40,533 adding 'colossalai/shardformer/shard/shard_config.py' 2025-03-03T09:14:40,534 adding 'colossalai/shardformer/shard/sharder.py' 2025-03-03T09:14:40,535 adding 'colossalai/shardformer/shard/shardformer.py' 2025-03-03T09:14:40,536 adding 'colossalai/shardformer/shard/utils.py' 2025-03-03T09:14:40,538 adding 'colossalai/tensor/__init__.py' 2025-03-03T09:14:40,539 adding 'colossalai/tensor/colo_parameter.py' 2025-03-03T09:14:40,541 adding 'colossalai/tensor/colo_tensor.py' 2025-03-03T09:14:40,543 adding 'colossalai/tensor/comm_spec.py' 2025-03-03T09:14:40,544 adding 'colossalai/tensor/param_op_hook.py' 2025-03-03T09:14:40,548 adding 'colossalai/tensor/shape_consistency.py' 2025-03-03T09:14:40,550 adding 'colossalai/tensor/sharding_spec.py' 2025-03-03T09:14:40,552 adding 'colossalai/tensor/utils.py' 2025-03-03T09:14:40,554 adding 'colossalai/tensor/d_tensor/__init__.py' 2025-03-03T09:14:40,556 adding 'colossalai/tensor/d_tensor/api.py' 2025-03-03T09:14:40,558 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2025-03-03T09:14:40,559 adding 'colossalai/tensor/d_tensor/layout.py' 2025-03-03T09:14:40,562 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2025-03-03T09:14:40,563 adding 'colossalai/tensor/d_tensor/misc.py' 2025-03-03T09:14:40,565 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2025-03-03T09:14:40,566 adding 'colossalai/tensor/d_tensor/utils.py' 2025-03-03T09:14:40,568 adding 'colossalai/tensor/moe_tensor/__init__.py' 2025-03-03T09:14:40,569 adding 'colossalai/tensor/moe_tensor/api.py' 2025-03-03T09:14:40,571 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2025-03-03T09:14:40,572 adding 'colossalai/tensor/padded_tensor/__init__.py' 2025-03-03T09:14:40,574 adding 'colossalai/tensor/padded_tensor/api.py' 2025-03-03T09:14:40,575 adding 'colossalai/testing/__init__.py' 2025-03-03T09:14:40,577 adding 'colossalai/testing/comparison.py' 2025-03-03T09:14:40,578 adding 'colossalai/testing/pytest_wrapper.py' 2025-03-03T09:14:40,579 adding 'colossalai/testing/random.py' 2025-03-03T09:14:40,581 adding 'colossalai/testing/utils.py' 2025-03-03T09:14:40,583 adding 'colossalai/utils/__init__.py' 2025-03-03T09:14:40,584 adding 'colossalai/utils/common.py' 2025-03-03T09:14:40,586 adding 'colossalai/utils/memory.py' 2025-03-03T09:14:40,587 adding 'colossalai/utils/safetensors.py' 2025-03-03T09:14:40,589 adding 'colossalai/utils/timer.py' 2025-03-03T09:14:40,590 adding 'colossalai/utils/model/__init__.py' 2025-03-03T09:14:40,592 adding 'colossalai/utils/model/utils.py' 2025-03-03T09:14:40,594 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2025-03-03T09:14:40,595 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2025-03-03T09:14:40,597 adding 'colossalai/utils/rank_recorder/__init__.py' 2025-03-03T09:14:40,598 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2025-03-03T09:14:40,600 adding 'colossalai/utils/tensor_detector/__init__.py' 2025-03-03T09:14:40,602 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2025-03-03T09:14:40,603 adding 'colossalai/zero/__init__.py' 2025-03-03T09:14:40,605 adding 'colossalai/zero/wrapper.py' 2025-03-03T09:14:40,607 adding 'colossalai/zero/gemini/__init__.py' 2025-03-03T09:14:40,612 adding 'colossalai/zero/gemini/gemini_ddp.py' 2025-03-03T09:14:40,614 adding 'colossalai/zero/gemini/gemini_hook.py' 2025-03-03T09:14:40,615 adding 'colossalai/zero/gemini/gemini_mgr.py' 2025-03-03T09:14:40,620 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2025-03-03T09:14:40,622 adding 'colossalai/zero/gemini/placement_policy.py' 2025-03-03T09:14:40,623 adding 'colossalai/zero/gemini/utils.py' 2025-03-03T09:14:40,626 adding 'colossalai/zero/gemini/chunk/__init__.py' 2025-03-03T09:14:40,629 adding 'colossalai/zero/gemini/chunk/chunk.py' 2025-03-03T09:14:40,631 adding 'colossalai/zero/gemini/chunk/manager.py' 2025-03-03T09:14:40,633 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2025-03-03T09:14:40,634 adding 'colossalai/zero/gemini/chunk/utils.py' 2025-03-03T09:14:40,636 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2025-03-03T09:14:40,637 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2025-03-03T09:14:40,639 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2025-03-03T09:14:40,640 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2025-03-03T09:14:40,641 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2025-03-03T09:14:40,642 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2025-03-03T09:14:40,644 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2025-03-03T09:14:40,645 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2025-03-03T09:14:40,646 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2025-03-03T09:14:40,648 adding 'colossalai/zero/low_level/__init__.py' 2025-03-03T09:14:40,649 adding 'colossalai/zero/low_level/_utils.py' 2025-03-03T09:14:40,654 adding 'colossalai/zero/low_level/low_level_optim.py' 2025-03-03T09:14:40,656 adding 'colossalai/zero/low_level/zero_hook.py' 2025-03-03T09:14:40,657 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2025-03-03T09:14:40,658 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2025-03-03T09:14:40,660 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2025-03-03T09:14:40,661 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2025-03-03T09:14:40,662 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2025-03-03T09:14:40,665 adding 'extensions/csrc/__init__.py' 2025-03-03T09:14:40,667 adding 'extensions/pybind/__init__.py' 2025-03-03T09:14:40,668 adding 'extensions/pybind/cpu_adam/__init__.py' 2025-03-03T09:14:40,670 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-03-03T09:14:40,671 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-03-03T09:14:40,673 adding 'extensions/pybind/flash_attention/__init__.py' 2025-03-03T09:14:40,674 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-03-03T09:14:40,675 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2025-03-03T09:14:40,676 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-03-03T09:14:40,678 adding 'extensions/pybind/inference/__init__.py' 2025-03-03T09:14:40,679 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2025-03-03T09:14:40,681 adding 'extensions/pybind/layernorm/__init__.py' 2025-03-03T09:14:40,682 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2025-03-03T09:14:40,684 adding 'extensions/pybind/moe/__init__.py' 2025-03-03T09:14:40,686 adding 'extensions/pybind/moe/moe_cuda.py' 2025-03-03T09:14:40,687 adding 'extensions/pybind/optimizer/__init__.py' 2025-03-03T09:14:40,689 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-03-03T09:14:40,690 adding 'extensions/pybind/softmax/__init__.py' 2025-03-03T09:14:40,691 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-03-03T09:14:40,693 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-03-03T09:14:40,695 adding 'colossalai-0.4.9.dist-info/LICENSE' 2025-03-03T09:14:40,699 adding 'colossalai-0.4.9.dist-info/METADATA' 2025-03-03T09:14:40,701 adding 'colossalai-0.4.9.dist-info/WHEEL' 2025-03-03T09:14:40,701 adding 'colossalai-0.4.9.dist-info/entry_points.txt' 2025-03-03T09:14:40,702 adding 'colossalai-0.4.9.dist-info/top_level.txt' 2025-03-03T09:14:40,718 adding 'colossalai-0.4.9.dist-info/RECORD' 2025-03-03T09:14:40,753 removing build/bdist.linux-armv7l/wheel 2025-03-03T09:14:41,117 Building wheel for colossalai (setup.py): finished with status 'done' 2025-03-03T09:14:41,136 Created wheel for colossalai: filename=colossalai-0.4.9-py3-none-any.whl size=1624283 sha256=9d7bd1947747a23afadf843bc0c5b84f78ebbd773c88c8d275dca97ca1ce4ec6 2025-03-03T09:14:41,137 Stored in directory: /tmp/pip-ephem-wheel-cache-70miqlyo/wheels/fc/ea/30/bd408c83e0eddebd0a47475b9bceb90be9548682f0c37631f3 2025-03-03T09:14:41,179 Successfully built colossalai 2025-03-03T09:14:41,221 Removed build tracker: '/tmp/pip-build-tracker-ljn_kcuf'