2025-02-20T04:07:08,540 Created temporary directory: /tmp/pip-build-tracker-1fyfmdge 2025-02-20T04:07:08,541 Initialized build tracking at /tmp/pip-build-tracker-1fyfmdge 2025-02-20T04:07:08,542 Created build tracker: /tmp/pip-build-tracker-1fyfmdge 2025-02-20T04:07:08,542 Entered build tracker: /tmp/pip-build-tracker-1fyfmdge 2025-02-20T04:07:08,543 Created temporary directory: /tmp/pip-wheel-89y5jrcz 2025-02-20T04:07:08,547 Created temporary directory: /tmp/pip-ephem-wheel-cache-8w9dvw66 2025-02-20T04:07:08,591 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-02-20T04:07:08,594 2 location(s) to search for versions of colossalai: 2025-02-20T04:07:08,594 * https://pypi.org/simple/colossalai/ 2025-02-20T04:07:08,594 * https://www.piwheels.org/simple/colossalai/ 2025-02-20T04:07:08,594 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2025-02-20T04:07:08,595 Getting page https://pypi.org/simple/colossalai/ 2025-02-20T04:07:08,597 Found index url https://pypi.org/simple/ 2025-02-20T04:07:08,814 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2025-02-20T04:07:08,821 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2025-02-20T04:07:08,822 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2025-02-20T04:07:08,823 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2025-02-20T04:07:08,824 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2025-02-20T04:07:08,825 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2025-02-20T04:07:08,826 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2025-02-20T04:07:08,827 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2025-02-20T04:07:08,828 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2025-02-20T04:07:08,829 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2025-02-20T04:07:08,830 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2025-02-20T04:07:08,831 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2025-02-20T04:07:08,832 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2025-02-20T04:07:08,833 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2025-02-20T04:07:08,834 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2025-02-20T04:07:08,835 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2025-02-20T04:07:08,836 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2025-02-20T04:07:08,837 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2025-02-20T04:07:08,838 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2025-02-20T04:07:08,839 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2025-02-20T04:07:08,839 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2025-02-20T04:07:08,840 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2025-02-20T04:07:08,841 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2025-02-20T04:07:08,842 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2025-02-20T04:07:08,843 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2025-02-20T04:07:08,844 Found link https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.5 2025-02-20T04:07:08,845 Found link https://files.pythonhosted.org/packages/53/ea/d5a51f58dc88a1aaea451a0a95af6cfec99cd6a7d7c4abdf9e04851bb992/colossalai-0.4.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.6 2025-02-20T04:07:08,846 Found link https://files.pythonhosted.org/packages/7d/c0/51f7e96494ef440e3461fb9365727dcb32dfec843f2f738e9d35cd521deb/colossalai-0.4.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.7 2025-02-20T04:07:08,847 Found link https://files.pythonhosted.org/packages/15/b3/ef0726bd75bd9348e004a0ae1f4944a747a54f269bf8012dabc9ef129195/colossalai-0.4.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.8 2025-02-20T04:07:08,848 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2025-02-20T04:07:08,849 Getting page https://www.piwheels.org/simple/colossalai/ 2025-02-20T04:07:08,850 Found index url https://www.piwheels.org/simple/ 2025-02-20T04:07:09,022 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2025-02-20T04:07:09,030 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.7-py3-none-any.whl#sha256=f8ebf35db2ba7317fd8a9aa6c8786fea97acce4e40f7462775aa9e18fe0480ba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,031 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.6-py3-none-any.whl#sha256=ce3ac15dc7fb8d7f59a20837e206ffc2cfb5a8c4b716a00905cf50687aa8676b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,031 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.5-py3-none-any.whl#sha256=f94d4dad77d236b0cc6ea08c8a0016d2cd518bc546095a9e65c47fe4486cacfb (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,032 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.4-py3-none-any.whl#sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,032 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,033 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,033 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,034 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,034 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,035 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,035 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,036 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,037 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,037 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,038 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,039 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,039 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,039 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,040 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,041 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,041 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,042 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,042 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,043 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,043 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,044 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,045 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2025-02-20T04:07:09,045 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2025-02-20T04:07:09,046 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2025-02-20T04:07:09,068 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2025-02-20T04:07:09,070 Collecting colossalai==0.4.8 2025-02-20T04:07:09,072 Created temporary directory: /tmp/pip-unpack-96x670tj 2025-02-20T04:07:09,212 Downloading colossalai-0.4.8.tar.gz (1.4 MB) 2025-02-20T04:07:11,636 Added colossalai==0.4.8 from https://files.pythonhosted.org/packages/15/b3/ef0726bd75bd9348e004a0ae1f4944a747a54f269bf8012dabc9ef129195/colossalai-0.4.8.tar.gz to build tracker '/tmp/pip-build-tracker-1fyfmdge' 2025-02-20T04:07:11,637 Running setup.py (path:/tmp/pip-wheel-89y5jrcz/colossalai_dcfe0ef6ac2f46b0b334e65631617a1a/setup.py) egg_info for package colossalai 2025-02-20T04:07:11,638 Created temporary directory: /tmp/pip-pip-egg-info-pnhj97ip 2025-02-20T04:07:11,639 Preparing metadata (setup.py): started 2025-02-20T04:07:11,640 Running command python setup.py egg_info 2025-02-20T04:07:12,789 running egg_info 2025-02-20T04:07:12,816 creating /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info 2025-02-20T04:07:12,817 writing /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/PKG-INFO 2025-02-20T04:07:12,822 writing dependency_links to /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/dependency_links.txt 2025-02-20T04:07:12,823 writing entry points to /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/entry_points.txt 2025-02-20T04:07:12,825 writing requirements to /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/requires.txt 2025-02-20T04:07:12,826 writing top-level names to /tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/top_level.txt 2025-02-20T04:07:12,827 writing manifest file '/tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/SOURCES.txt' 2025-02-20T04:07:13,120 reading manifest file '/tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/SOURCES.txt' 2025-02-20T04:07:13,121 reading manifest template 'MANIFEST.in' 2025-02-20T04:07:14,416 warning: no files found matching '*.tr' under directory 'colossalai' 2025-02-20T04:07:15,076 warning: no files found matching '*.cc' under directory 'colossalai' 2025-02-20T04:07:15,425 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-02-20T04:07:15,569 warning: no files found matching '*.tr' under directory 'extensions' 2025-02-20T04:07:15,625 warning: no files found matching '*.cc' under directory 'extensions' 2025-02-20T04:07:15,655 warning: no files found matching '*.pyi' under directory 'extensions' 2025-02-20T04:07:15,655 adding license file 'LICENSE' 2025-02-20T04:07:15,688 writing manifest file '/tmp/pip-pip-egg-info-pnhj97ip/colossalai.egg-info/SOURCES.txt' 2025-02-20T04:07:15,797 Preparing metadata (setup.py): finished with status 'done' 2025-02-20T04:07:15,804 Source in /tmp/pip-wheel-89y5jrcz/colossalai_dcfe0ef6ac2f46b0b334e65631617a1a has version 0.4.8, which satisfies requirement colossalai==0.4.8 from https://files.pythonhosted.org/packages/15/b3/ef0726bd75bd9348e004a0ae1f4944a747a54f269bf8012dabc9ef129195/colossalai-0.4.8.tar.gz 2025-02-20T04:07:15,805 Removed colossalai==0.4.8 from https://files.pythonhosted.org/packages/15/b3/ef0726bd75bd9348e004a0ae1f4944a747a54f269bf8012dabc9ef129195/colossalai-0.4.8.tar.gz from build tracker '/tmp/pip-build-tracker-1fyfmdge' 2025-02-20T04:07:15,818 Created temporary directory: /tmp/pip-unpack-2cuds92i 2025-02-20T04:07:15,819 Created temporary directory: /tmp/pip-unpack-cfork1xi 2025-02-20T04:07:15,820 Building wheels for collected packages: colossalai 2025-02-20T04:07:15,824 Created temporary directory: /tmp/pip-wheel-esgvbr6z 2025-02-20T04:07:15,824 Building wheel for colossalai (setup.py): started 2025-02-20T04:07:15,826 Destination directory: /tmp/pip-wheel-esgvbr6z 2025-02-20T04:07:15,826 Running command python setup.py bdist_wheel 2025-02-20T04:07:16,910 running bdist_wheel 2025-02-20T04:07:17,040 running build 2025-02-20T04:07:17,041 running build_py 2025-02-20T04:07:17,071 creating build/lib/colossalai 2025-02-20T04:07:17,073 copying colossalai/initialize.py -> build/lib/colossalai 2025-02-20T04:07:17,075 copying colossalai/__init__.py -> build/lib/colossalai 2025-02-20T04:07:17,078 copying colossalai/version.py -> build/lib/colossalai 2025-02-20T04:07:17,080 creating build/lib/colossalai/booster 2025-02-20T04:07:17,081 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2025-02-20T04:07:17,083 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2025-02-20T04:07:17,086 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2025-02-20T04:07:17,088 creating build/lib/colossalai/_C 2025-02-20T04:07:17,089 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2025-02-20T04:07:17,091 creating build/lib/colossalai/nn 2025-02-20T04:07:17,093 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2025-02-20T04:07:17,095 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2025-02-20T04:07:17,097 creating build/lib/colossalai/auto_parallel 2025-02-20T04:07:17,098 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2025-02-20T04:07:17,101 creating build/lib/colossalai/amp 2025-02-20T04:07:17,102 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2025-02-20T04:07:17,104 creating build/lib/colossalai/shardformer 2025-02-20T04:07:17,105 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2025-02-20T04:07:17,107 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2025-02-20T04:07:17,109 creating build/lib/colossalai/inference 2025-02-20T04:07:17,110 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,112 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,114 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,116 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,118 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,121 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,123 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,126 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,128 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2025-02-20T04:07:17,132 creating build/lib/colossalai/quantization 2025-02-20T04:07:17,133 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,135 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,138 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,140 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,143 copying colossalai/quantization/fp8_config.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,145 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,148 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2025-02-20T04:07:17,151 creating build/lib/colossalai/interface 2025-02-20T04:07:17,152 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2025-02-20T04:07:17,154 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2025-02-20T04:07:17,157 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2025-02-20T04:07:17,159 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2025-02-20T04:07:17,162 creating build/lib/colossalai/_analyzer 2025-02-20T04:07:17,163 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2025-02-20T04:07:17,165 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2025-02-20T04:07:17,168 creating build/lib/colossalai/moe 2025-02-20T04:07:17,169 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2025-02-20T04:07:17,171 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2025-02-20T04:07:17,174 creating build/lib/colossalai/cluster 2025-02-20T04:07:17,176 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2025-02-20T04:07:17,178 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2025-02-20T04:07:17,180 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2025-02-20T04:07:17,183 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2025-02-20T04:07:17,185 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2025-02-20T04:07:17,188 creating build/lib/colossalai/accelerator 2025-02-20T04:07:17,190 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,193 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,195 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,198 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,200 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,203 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2025-02-20T04:07:17,206 creating build/lib/colossalai/lazy 2025-02-20T04:07:17,207 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2025-02-20T04:07:17,209 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2025-02-20T04:07:17,212 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2025-02-20T04:07:17,215 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2025-02-20T04:07:17,218 creating build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,219 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,222 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,226 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,228 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,231 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,234 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,236 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2025-02-20T04:07:17,240 creating build/lib/colossalai/utils 2025-02-20T04:07:17,241 copying colossalai/utils/safetensors.py -> build/lib/colossalai/utils 2025-02-20T04:07:17,244 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2025-02-20T04:07:17,246 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2025-02-20T04:07:17,248 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2025-02-20T04:07:17,251 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2025-02-20T04:07:17,254 creating build/lib/colossalai/pipeline 2025-02-20T04:07:17,255 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2025-02-20T04:07:17,258 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2025-02-20T04:07:17,261 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2025-02-20T04:07:17,263 copying colossalai/pipeline/weight_grad_store.py -> build/lib/colossalai/pipeline 2025-02-20T04:07:17,266 creating build/lib/colossalai/context 2025-02-20T04:07:17,267 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2025-02-20T04:07:17,269 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2025-02-20T04:07:17,271 copying colossalai/context/config.py -> build/lib/colossalai/context 2025-02-20T04:07:17,274 creating build/lib/colossalai/fx 2025-02-20T04:07:17,276 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,279 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,281 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,284 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,286 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,289 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2025-02-20T04:07:17,291 creating build/lib/colossalai/kernel 2025-02-20T04:07:17,293 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2025-02-20T04:07:17,295 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2025-02-20T04:07:17,297 creating build/lib/colossalai/device 2025-02-20T04:07:17,299 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2025-02-20T04:07:17,302 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2025-02-20T04:07:17,304 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2025-02-20T04:07:17,307 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2025-02-20T04:07:17,311 creating build/lib/colossalai/testing 2025-02-20T04:07:17,312 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2025-02-20T04:07:17,315 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2025-02-20T04:07:17,317 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2025-02-20T04:07:17,319 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2025-02-20T04:07:17,322 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2025-02-20T04:07:17,325 creating build/lib/colossalai/legacy 2025-02-20T04:07:17,326 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2025-02-20T04:07:17,330 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2025-02-20T04:07:17,332 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2025-02-20T04:07:17,334 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2025-02-20T04:07:17,336 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2025-02-20T04:07:17,339 creating build/lib/colossalai/zero 2025-02-20T04:07:17,340 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2025-02-20T04:07:17,342 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2025-02-20T04:07:17,346 creating build/lib/colossalai/cli 2025-02-20T04:07:17,347 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2025-02-20T04:07:17,349 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2025-02-20T04:07:17,352 creating build/lib/colossalai/logging 2025-02-20T04:07:17,353 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2025-02-20T04:07:17,356 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2025-02-20T04:07:17,359 creating build/lib/colossalai/tensor 2025-02-20T04:07:17,361 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,363 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,365 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,368 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,371 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,374 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,377 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,379 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2025-02-20T04:07:17,382 creating build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,384 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,386 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,388 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,390 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,392 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,394 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,397 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2025-02-20T04:07:17,400 creating build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,401 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,405 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,407 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,410 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,413 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,415 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,418 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,421 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,425 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,428 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2025-02-20T04:07:17,431 creating build/lib/colossalai/nn/layer 2025-02-20T04:07:17,432 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2025-02-20T04:07:17,434 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2025-02-20T04:07:17,437 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2025-02-20T04:07:17,439 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2025-02-20T04:07:17,442 creating build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,444 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,447 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,449 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,452 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,455 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,458 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,460 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,463 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,466 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,468 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,471 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,474 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,476 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,479 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,482 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,484 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2025-02-20T04:07:17,487 creating build/lib/colossalai/nn/loss 2025-02-20T04:07:17,489 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2025-02-20T04:07:17,491 creating build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,493 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,495 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,497 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,499 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,502 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,504 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,507 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,509 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2025-02-20T04:07:17,512 creating build/lib/colossalai/auto_parallel/pipeline_shard 2025-02-20T04:07:17,513 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2025-02-20T04:07:17,516 creating build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,517 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,520 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,523 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,525 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,528 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,531 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:17,535 creating build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,537 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,539 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,545 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,548 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,550 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,553 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,555 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,558 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,561 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,563 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2025-02-20T04:07:17,565 creating build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,566 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,569 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,571 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,572 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,574 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:17,577 creating build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,578 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,580 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,582 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,584 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,587 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,589 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2025-02-20T04:07:17,591 creating build/lib/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:17,592 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:17,594 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:17,597 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:17,598 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:17,601 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,602 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,604 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,606 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,608 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,610 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,613 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:17,615 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,617 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,619 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,622 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,624 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,626 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:17,630 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,631 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,633 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,635 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,638 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,639 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,641 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,643 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,645 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,647 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,649 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,651 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,653 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,654 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,656 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,658 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,660 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,662 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,664 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,666 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,669 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,671 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,672 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,675 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,677 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,679 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,681 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,682 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:17,686 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,687 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,689 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,692 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,694 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,697 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,699 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,701 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,704 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,706 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,709 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,712 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,714 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,716 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,718 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,720 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,723 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,725 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,727 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,730 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:17,733 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,734 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,736 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,738 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,739 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,741 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,744 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,746 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,748 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,750 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,752 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,755 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:17,757 creating build/lib/colossalai/amp/naive_amp 2025-02-20T04:07:17,758 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2025-02-20T04:07:17,760 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2025-02-20T04:07:17,763 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:17,764 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:17,766 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:17,768 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:17,770 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:17,773 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:17,774 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:17,776 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:17,778 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:17,780 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:17,783 creating build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,784 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,786 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,788 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,790 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,792 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,794 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2025-02-20T04:07:17,797 creating build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,798 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,801 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,803 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,805 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,807 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,809 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,812 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,814 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,817 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,820 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,823 copying colossalai/shardformer/policies/deepseek_v3.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,827 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,830 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,833 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,835 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,838 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,841 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,844 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,847 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,849 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,852 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,855 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2025-02-20T04:07:17,858 creating build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,859 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,861 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,864 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,866 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,868 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,871 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,874 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,876 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,879 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,882 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,885 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2025-02-20T04:07:17,889 creating build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,890 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,893 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,896 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,898 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,901 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,903 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,906 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,909 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,912 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,915 copying colossalai/shardformer/modeling/deepseek_v3.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,917 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,921 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,924 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,927 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,930 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,933 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,936 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,939 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,942 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,945 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,949 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2025-02-20T04:07:17,951 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:17,953 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:17,955 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:17,958 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:17,961 creating build/lib/colossalai/inference/kv_cache 2025-02-20T04:07:17,970 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2025-02-20T04:07:17,973 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2025-02-20T04:07:18,030 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2025-02-20T04:07:18,960 creating build/lib/colossalai/inference/executor 2025-02-20T04:07:18,965 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2025-02-20T04:07:20,180 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2025-02-20T04:07:20,757 creating build/lib/colossalai/inference/server 2025-02-20T04:07:21,058 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2025-02-20T04:07:21,697 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2025-02-20T04:07:21,701 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2025-02-20T04:07:21,707 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2025-02-20T04:07:21,711 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2025-02-20T04:07:21,716 creating build/lib/colossalai/inference/modeling 2025-02-20T04:07:21,719 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2025-02-20T04:07:21,725 creating build/lib/colossalai/inference/core 2025-02-20T04:07:21,728 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,734 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,739 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,743 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,748 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,752 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,756 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,760 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,764 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2025-02-20T04:07:21,770 creating build/lib/colossalai/inference/spec 2025-02-20T04:07:21,772 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2025-02-20T04:07:21,776 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2025-02-20T04:07:21,780 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2025-02-20T04:07:21,785 creating build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,787 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,790 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,793 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,795 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,799 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,802 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2025-02-20T04:07:21,806 creating build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,808 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,811 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,814 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,816 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,818 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2025-02-20T04:07:21,822 creating build/lib/colossalai/inference/modeling/backends 2025-02-20T04:07:21,824 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2025-02-20T04:07:21,826 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-02-20T04:07:21,830 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2025-02-20T04:07:21,834 creating build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,835 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,839 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,841 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,844 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,846 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,849 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2025-02-20T04:07:21,853 creating build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,854 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,858 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,860 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,863 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,866 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2025-02-20T04:07:21,869 creating build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,871 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,873 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,876 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,879 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,882 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2025-02-20T04:07:21,885 creating build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,887 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,889 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,891 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,893 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,896 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,899 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:21,901 creating build/lib/colossalai/_analyzer/fx/passes 2025-02-20T04:07:21,903 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2025-02-20T04:07:21,905 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2025-02-20T04:07:21,907 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2025-02-20T04:07:21,910 creating build/lib/colossalai/utils/rank_recorder 2025-02-20T04:07:21,911 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2025-02-20T04:07:21,913 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2025-02-20T04:07:21,915 creating build/lib/colossalai/utils/multi_tensor_apply 2025-02-20T04:07:21,916 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-02-20T04:07:21,920 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2025-02-20T04:07:21,922 creating build/lib/colossalai/utils/model 2025-02-20T04:07:21,923 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2025-02-20T04:07:21,925 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2025-02-20T04:07:21,927 creating build/lib/colossalai/utils/tensor_detector 2025-02-20T04:07:21,928 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2025-02-20T04:07:21,930 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2025-02-20T04:07:21,934 creating build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,935 copying colossalai/pipeline/schedule/v_schedule.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,938 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,940 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,943 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,945 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,948 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,950 copying colossalai/pipeline/schedule/zero_bubble_pp.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,953 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2025-02-20T04:07:21,957 creating build/lib/colossalai/fx/codegen 2025-02-20T04:07:22,003 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2025-02-20T04:07:22,010 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2025-02-20T04:07:22,039 creating build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,041 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,048 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,060 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,067 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,071 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:22,082 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:23,666 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2025-02-20T04:07:23,673 creating build/lib/colossalai/fx/passes 2025-02-20T04:07:23,675 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,681 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,686 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,691 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,694 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,699 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,704 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,712 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2025-02-20T04:07:23,718 creating build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,720 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,724 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,729 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,733 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,738 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,746 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,750 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,754 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2025-02-20T04:07:23,761 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2025-02-20T04:07:23,763 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2025-02-20T04:07:23,770 creating build/lib/colossalai/fx/tracer/meta_patch 2025-02-20T04:07:23,772 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2025-02-20T04:07:23,783 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:23,785 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:23,788 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:23,791 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:23,794 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:23,798 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,800 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,807 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,810 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,817 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,820 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:23,833 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,835 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,838 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,841 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,844 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,848 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,852 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,855 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,858 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:23,861 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,864 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,867 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,870 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,873 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,878 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,886 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,889 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,893 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:23,897 creating build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,899 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,905 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,909 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,913 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,917 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2025-02-20T04:07:23,922 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,924 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,929 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,941 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,944 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,948 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,951 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,955 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,963 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,966 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:23,970 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:23,972 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:23,976 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:23,979 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:23,985 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:23,997 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,002 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,005 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,008 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,012 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,014 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,018 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:24,022 creating build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,034 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,046 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,049 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,053 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,057 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,061 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,066 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,073 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,077 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,081 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,090 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2025-02-20T04:07:24,096 creating build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,098 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,103 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,106 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,110 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,113 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,117 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2025-02-20T04:07:24,122 creating build/lib/colossalai/kernel/jit 2025-02-20T04:07:24,125 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2025-02-20T04:07:24,128 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2025-02-20T04:07:24,132 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2025-02-20T04:07:24,136 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2025-02-20T04:07:24,141 creating build/lib/colossalai/kernel/extensions/pybind 2025-02-20T04:07:24,143 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2025-02-20T04:07:24,147 creating build/lib/colossalai/kernel/extensions/csrc 2025-02-20T04:07:24,149 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2025-02-20T04:07:24,153 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:24,155 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:24,159 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:24,166 creating build/lib/colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:24,168 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:24,172 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:24,176 creating build/lib/colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:24,178 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:24,183 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:24,187 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:24,190 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:24,197 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:24,201 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:24,202 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:24,206 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:24,209 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:24,213 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:24,214 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:24,217 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:24,221 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:24,224 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:24,231 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:24,232 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:24,236 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:24,249 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:24,253 creating build/lib/colossalai/legacy/nn 2025-02-20T04:07:24,254 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2025-02-20T04:07:24,258 creating build/lib/colossalai/legacy/amp 2025-02-20T04:07:24,259 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2025-02-20T04:07:24,263 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2025-02-20T04:07:24,266 creating build/lib/colossalai/legacy/inference 2025-02-20T04:07:24,268 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2025-02-20T04:07:24,272 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2025-02-20T04:07:24,281 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2025-02-20T04:07:24,284 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2025-02-20T04:07:24,287 creating build/lib/colossalai/legacy/engine 2025-02-20T04:07:24,289 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2025-02-20T04:07:24,292 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2025-02-20T04:07:24,299 creating build/lib/colossalai/legacy/registry 2025-02-20T04:07:24,301 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2025-02-20T04:07:24,305 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2025-02-20T04:07:24,309 creating build/lib/colossalai/legacy/trainer 2025-02-20T04:07:24,311 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2025-02-20T04:07:24,314 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2025-02-20T04:07:24,317 creating build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,319 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,322 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,325 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,329 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,332 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2025-02-20T04:07:24,342 creating build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,344 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,348 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,352 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,357 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,360 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2025-02-20T04:07:24,364 creating build/lib/colossalai/legacy/context 2025-02-20T04:07:24,369 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2025-02-20T04:07:24,377 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2025-02-20T04:07:24,380 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2025-02-20T04:07:24,384 creating build/lib/colossalai/legacy/builder 2025-02-20T04:07:24,385 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2025-02-20T04:07:24,388 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2025-02-20T04:07:24,391 creating build/lib/colossalai/legacy/zero 2025-02-20T04:07:24,392 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2025-02-20T04:07:24,396 creating build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,397 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,409 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,412 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,415 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,417 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,421 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2025-02-20T04:07:24,425 creating build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,426 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,430 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,433 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,436 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,439 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,449 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,452 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,455 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2025-02-20T04:07:24,459 creating build/lib/colossalai/legacy/nn/layer 2025-02-20T04:07:24,461 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2025-02-20T04:07:24,464 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2025-02-20T04:07:24,467 creating build/lib/colossalai/legacy/nn/parallel 2025-02-20T04:07:24,469 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2025-02-20T04:07:24,473 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2025-02-20T04:07:24,478 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2025-02-20T04:07:24,482 creating build/lib/colossalai/legacy/nn/_ops 2025-02-20T04:07:24,484 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2025-02-20T04:07:24,488 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2025-02-20T04:07:24,492 creating build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,494 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,497 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,500 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,505 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,508 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2025-02-20T04:07:24,514 creating build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,517 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,519 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,522 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,533 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,535 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2025-02-20T04:07:24,541 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:24,543 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:24,546 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:24,551 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:24,562 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:24,565 creating build/lib/colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:24,567 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:24,569 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:24,573 creating build/lib/colossalai/legacy/nn/layer/utils 2025-02-20T04:07:24,575 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-02-20T04:07:24,580 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2025-02-20T04:07:24,583 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:24,584 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:24,587 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:24,592 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:24,595 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:24,601 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,603 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,613 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,616 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,620 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,622 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,626 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:24,629 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:24,632 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:24,636 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:24,642 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:24,646 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:24,649 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:24,657 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:24,660 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:24,663 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:24,666 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:24,670 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:24,671 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:24,674 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:24,678 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:24,681 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:24,685 creating build/lib/colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:24,686 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:24,689 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:24,692 creating build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,694 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,697 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,700 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,703 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,706 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:24,709 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,711 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,714 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,718 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,721 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,724 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,735 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,738 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,742 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,745 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:24,748 creating build/lib/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:24,750 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:24,752 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:24,755 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:24,759 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:24,762 creating build/lib/colossalai/legacy/amp/apex_amp 2025-02-20T04:07:24,763 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-02-20T04:07:24,767 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2025-02-20T04:07:24,770 creating build/lib/colossalai/legacy/amp/torch_amp 2025-02-20T04:07:24,772 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-02-20T04:07:24,775 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-02-20T04:07:24,779 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2025-02-20T04:07:24,782 creating build/lib/colossalai/legacy/inference/pipeline 2025-02-20T04:07:24,784 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2025-02-20T04:07:24,787 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2025-02-20T04:07:24,791 creating build/lib/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:24,793 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:24,796 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:24,800 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:24,803 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:24,808 creating build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,809 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,812 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,815 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,818 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,820 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,824 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,828 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,831 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,834 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:24,838 creating build/lib/colossalai/legacy/inference/hybridengine 2025-02-20T04:07:24,839 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-02-20T04:07:24,842 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2025-02-20T04:07:24,846 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:24,847 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:24,849 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:24,852 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:24,854 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:24,858 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,860 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,864 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,866 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,870 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,873 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:24,876 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:24,877 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:24,880 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:24,883 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:24,885 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:24,887 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:24,891 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:24,896 creating build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,897 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,901 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,903 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,907 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,910 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,913 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,917 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,920 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:24,925 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:24,926 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:24,930 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:24,935 creating build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,938 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,943 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,947 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,950 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,953 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2025-02-20T04:07:24,958 creating build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,960 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,964 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,968 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,971 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,974 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,979 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,982 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2025-02-20T04:07:24,987 creating build/lib/colossalai/legacy/utils/checkpoint 2025-02-20T04:07:24,990 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-02-20T04:07:24,994 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-02-20T04:07:24,997 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2025-02-20T04:07:25,000 creating build/lib/colossalai/legacy/utils/data_sampler 2025-02-20T04:07:25,001 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-02-20T04:07:25,004 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-02-20T04:07:25,007 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2025-02-20T04:07:25,011 creating build/lib/colossalai/legacy/utils/profiler 2025-02-20T04:07:25,012 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2025-02-20T04:07:25,015 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2025-02-20T04:07:25,019 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-02-20T04:07:25,022 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2025-02-20T04:07:25,025 creating build/lib/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:25,027 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:25,030 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:25,032 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:25,036 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:25,039 creating build/lib/colossalai/legacy/pipeline/middleware 2025-02-20T04:07:25,041 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-02-20T04:07:25,044 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2025-02-20T04:07:25,048 creating build/lib/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:25,050 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:25,053 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:25,055 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:25,060 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:25,063 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:25,065 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:25,068 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:25,072 creating build/lib/colossalai/legacy/context/random 2025-02-20T04:07:25,073 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2025-02-20T04:07:25,077 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2025-02-20T04:07:25,079 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2025-02-20T04:07:25,083 creating build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,085 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,089 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,092 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,095 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,099 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,112 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,115 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,119 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,123 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,127 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,130 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:25,134 creating build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,138 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,142 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,145 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,147 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,151 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,154 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,158 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2025-02-20T04:07:25,161 creating build/lib/colossalai/legacy/zero/init_ctx 2025-02-20T04:07:25,163 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-02-20T04:07:25,166 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2025-02-20T04:07:25,170 creating build/lib/colossalai/legacy/zero/sharded_param 2025-02-20T04:07:25,172 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-02-20T04:07:25,175 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-02-20T04:07:25,178 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2025-02-20T04:07:25,181 creating build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,183 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,187 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,190 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,193 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,195 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:25,198 creating build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,199 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,203 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,206 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,210 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,214 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,217 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:25,221 creating build/lib/colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:25,223 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:25,226 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:25,230 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,231 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,234 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,236 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,239 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,242 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:25,245 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:25,246 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:25,249 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:25,252 creating build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,253 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,256 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,259 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,262 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,265 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,268 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,272 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2025-02-20T04:07:25,275 creating build/lib/colossalai/zero/low_level 2025-02-20T04:07:25,277 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2025-02-20T04:07:25,280 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2025-02-20T04:07:25,284 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2025-02-20T04:07:25,287 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2025-02-20T04:07:25,290 creating build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,292 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,294 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,297 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,299 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,302 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,305 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,307 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,309 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,312 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:25,314 creating build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,316 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,319 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,323 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,325 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,327 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2025-02-20T04:07:25,330 creating build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,335 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,338 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,340 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,346 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,348 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:25,351 creating build/lib/colossalai/cli/launcher 2025-02-20T04:07:25,353 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2025-02-20T04:07:25,356 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2025-02-20T04:07:25,359 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2025-02-20T04:07:25,361 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2025-02-20T04:07:25,364 creating build/lib/colossalai/cli/check 2025-02-20T04:07:25,365 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2025-02-20T04:07:25,367 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2025-02-20T04:07:25,370 creating build/lib/colossalai/tensor/moe_tensor 2025-02-20T04:07:25,371 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2025-02-20T04:07:25,373 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2025-02-20T04:07:25,375 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2025-02-20T04:07:25,378 creating build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,379 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,382 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,385 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,387 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,389 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,391 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,394 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,396 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2025-02-20T04:07:25,400 creating build/lib/colossalai/tensor/padded_tensor 2025-02-20T04:07:25,401 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2025-02-20T04:07:25,403 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2025-02-20T04:07:25,406 creating build/lib/extensions/pybind 2025-02-20T04:07:25,408 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2025-02-20T04:07:25,410 creating build/lib/extensions/csrc 2025-02-20T04:07:25,411 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2025-02-20T04:07:25,413 creating build/lib/extensions/pybind/layernorm 2025-02-20T04:07:25,415 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2025-02-20T04:07:25,417 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2025-02-20T04:07:25,419 creating build/lib/extensions/pybind/inference 2025-02-20T04:07:25,420 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2025-02-20T04:07:25,422 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2025-02-20T04:07:25,425 creating build/lib/extensions/pybind/moe 2025-02-20T04:07:25,426 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2025-02-20T04:07:25,428 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2025-02-20T04:07:25,431 creating build/lib/extensions/pybind/optimizer 2025-02-20T04:07:25,433 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2025-02-20T04:07:25,435 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2025-02-20T04:07:25,438 creating build/lib/extensions/pybind/cpu_adam 2025-02-20T04:07:25,439 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2025-02-20T04:07:25,441 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2025-02-20T04:07:25,443 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2025-02-20T04:07:25,446 creating build/lib/extensions/pybind/flash_attention 2025-02-20T04:07:25,447 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2025-02-20T04:07:25,449 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-02-20T04:07:25,451 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2025-02-20T04:07:25,454 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2025-02-20T04:07:25,456 creating build/lib/extensions/pybind/softmax 2025-02-20T04:07:25,457 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-02-20T04:07:25,460 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2025-02-20T04:07:25,462 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2025-02-20T04:07:25,555 creating build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,556 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,559 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,561 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,564 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,566 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:25,569 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,570 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,573 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,575 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,578 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,581 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:25,584 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,586 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,589 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,592 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,595 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,598 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,600 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,603 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,606 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,609 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,612 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,615 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,618 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,621 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,623 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,626 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,629 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,632 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,634 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:25,638 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:25,639 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:25,641 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:25,644 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:25,646 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:25,649 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-02-20T04:07:25,650 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-02-20T04:07:25,653 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:25,654 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:25,656 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:25,659 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:25,660 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:25,663 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:25,667 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:25,671 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:25,674 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:25,677 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:25,684 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:25,687 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:25,833 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-02-20T04:07:25,834 !! 2025-02-20T04:07:25,835 ******************************************************************************** 2025-02-20T04:07:25,836 Please avoid running ``setup.py`` directly. 2025-02-20T04:07:25,836 Instead, use pypa/build, pypa/installer or other 2025-02-20T04:07:25,837 standards-based tools. 2025-02-20T04:07:25,838 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-02-20T04:07:25,839 ******************************************************************************** 2025-02-20T04:07:25,840 !! 2025-02-20T04:07:25,841 self.initialize_options() 2025-02-20T04:07:25,861 installing to build/bdist.linux-armv7l/wheel 2025-02-20T04:07:25,862 running install 2025-02-20T04:07:25,887 running install_lib 2025-02-20T04:07:25,914 creating build/bdist.linux-armv7l/wheel 2025-02-20T04:07:25,916 creating build/bdist.linux-armv7l/wheel/colossalai 2025-02-20T04:07:25,918 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2025-02-20T04:07:25,920 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2025-02-20T04:07:25,921 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,923 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,925 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,926 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,928 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,930 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,932 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2025-02-20T04:07:25,935 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2025-02-20T04:07:25,936 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,938 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,941 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,943 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,945 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,947 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,949 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,952 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,955 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,957 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2025-02-20T04:07:25,959 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-02-20T04:07:25,961 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-02-20T04:07:25,963 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2025-02-20T04:07:25,966 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2025-02-20T04:07:25,967 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2025-02-20T04:07:25,969 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2025-02-20T04:07:25,970 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-02-20T04:07:25,973 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2025-02-20T04:07:25,974 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-02-20T04:07:25,975 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-02-20T04:07:25,978 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-02-20T04:07:25,980 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2025-02-20T04:07:25,982 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2025-02-20T04:07:25,985 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2025-02-20T04:07:25,986 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:25,989 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:25,991 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:25,993 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:25,995 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:25,997 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,000 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,002 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,005 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,007 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,009 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,011 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,013 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,016 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,018 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,020 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2025-02-20T04:07:26,023 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2025-02-20T04:07:26,024 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2025-02-20T04:07:26,026 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2025-02-20T04:07:26,027 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,030 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,031 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,033 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,035 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,037 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,039 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,041 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2025-02-20T04:07:26,044 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-02-20T04:07:26,046 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2025-02-20T04:07:26,047 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2025-02-20T04:07:26,050 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2025-02-20T04:07:26,051 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2025-02-20T04:07:26,054 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,055 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,057 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,059 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,061 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,063 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,066 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2025-02-20T04:07:26,069 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2025-02-20T04:07:26,070 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,072 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,075 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,078 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,080 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,082 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,085 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,087 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,090 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,093 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2025-02-20T04:07:26,096 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,097 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,100 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,102 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,105 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,106 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,109 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,111 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,113 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,116 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,119 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2025-02-20T04:07:26,121 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,124 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2025-02-20T04:07:26,127 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,128 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,131 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,134 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,136 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,139 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2025-02-20T04:07:26,142 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,144 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,146 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,149 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,152 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,154 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,156 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,159 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,161 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,164 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,166 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,169 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,172 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,175 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,178 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,182 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,184 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,186 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,189 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,191 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,194 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,196 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,199 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,202 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2025-02-20T04:07:26,204 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,206 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,209 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,211 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,213 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,215 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,218 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,220 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,222 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,224 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,226 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,229 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,231 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,233 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,235 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,238 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,240 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,242 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,244 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,247 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,249 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,251 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,253 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,255 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2025-02-20T04:07:26,259 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2025-02-20T04:07:26,260 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,263 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,264 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,267 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,270 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,272 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2025-02-20T04:07:26,274 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:26,275 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:26,277 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:26,279 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:26,281 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2025-02-20T04:07:26,283 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,285 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,287 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,289 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,291 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,293 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,295 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,297 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,300 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,302 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,304 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,306 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2025-02-20T04:07:26,309 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2025-02-20T04:07:26,311 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2025-02-20T04:07:26,312 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-02-20T04:07:26,314 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:26,315 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:26,317 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:26,319 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:26,321 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2025-02-20T04:07:26,323 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2025-02-20T04:07:26,327 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:26,328 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:26,330 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:26,331 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:26,334 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2025-02-20T04:07:26,336 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2025-02-20T04:07:26,338 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2025-02-20T04:07:26,340 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2025-02-20T04:07:26,341 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,343 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,345 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,347 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,349 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,351 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2025-02-20T04:07:26,353 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2025-02-20T04:07:26,354 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,357 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,360 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,361 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,363 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,366 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,369 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,371 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,374 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,376 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,379 copying build/lib/colossalai/shardformer/policies/deepseek_v3.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,381 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,383 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,386 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,388 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,391 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,393 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,396 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,406 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,408 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,411 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,413 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2025-02-20T04:07:26,415 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-02-20T04:07:26,418 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2025-02-20T04:07:26,419 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,422 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,424 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,426 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,428 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,431 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,434 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,437 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,439 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,442 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,446 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2025-02-20T04:07:26,449 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2025-02-20T04:07:26,450 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,453 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:26,454 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:26,456 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:26,459 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2025-02-20T04:07:26,461 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,464 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,465 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,468 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,470 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,473 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,476 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,479 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,482 copying build/lib/colossalai/shardformer/modeling/deepseek_v3.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,484 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,487 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,490 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,493 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,495 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,499 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,502 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,505 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,507 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,510 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,514 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2025-02-20T04:07:26,516 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2025-02-20T04:07:26,520 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2025-02-20T04:07:26,521 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,523 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,526 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2025-02-20T04:07:26,528 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-02-20T04:07:26,530 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-02-20T04:07:26,532 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2025-02-20T04:07:26,536 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,539 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,542 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2025-02-20T04:07:26,543 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-02-20T04:07:26,546 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2025-02-20T04:07:26,549 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2025-02-20T04:07:26,550 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-02-20T04:07:26,553 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-02-20T04:07:26,555 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-02-20T04:07:26,558 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-02-20T04:07:26,560 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2025-02-20T04:07:26,562 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,566 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2025-02-20T04:07:26,568 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2025-02-20T04:07:26,570 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,573 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,576 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,578 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,581 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,584 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2025-02-20T04:07:26,587 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2025-02-20T04:07:26,590 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2025-02-20T04:07:26,591 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-02-20T04:07:26,594 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-02-20T04:07:26,596 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-02-20T04:07:26,598 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-02-20T04:07:26,600 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2025-02-20T04:07:26,604 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2025-02-20T04:07:26,606 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-02-20T04:07:26,607 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-02-20T04:07:26,610 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2025-02-20T04:07:26,613 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2025-02-20T04:07:26,614 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,616 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,618 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,620 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,621 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,623 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2025-02-20T04:07:26,626 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2025-02-20T04:07:26,627 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,630 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,633 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,634 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,637 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,639 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,641 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,643 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,645 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2025-02-20T04:07:26,649 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2025-02-20T04:07:26,650 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-02-20T04:07:26,652 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-02-20T04:07:26,654 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2025-02-20T04:07:26,656 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,659 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,661 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,663 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2025-02-20T04:07:26,666 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2025-02-20T04:07:26,667 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,669 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,672 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,673 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,676 copying build/lib/colossalai/quantization/fp8_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,678 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,680 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2025-02-20T04:07:26,683 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2025-02-20T04:07:26,684 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-02-20T04:07:26,686 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-02-20T04:07:26,688 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-02-20T04:07:26,690 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2025-02-20T04:07:26,693 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2025-02-20T04:07:26,694 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-02-20T04:07:26,696 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2025-02-20T04:07:26,697 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-02-20T04:07:26,700 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-02-20T04:07:26,703 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,704 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,706 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,708 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,710 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,713 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,715 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2025-02-20T04:07:26,717 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-02-20T04:07:26,719 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2025-02-20T04:07:26,720 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-02-20T04:07:26,722 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-02-20T04:07:26,724 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2025-02-20T04:07:26,726 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-02-20T04:07:26,729 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2025-02-20T04:07:26,730 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2025-02-20T04:07:26,733 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,734 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,735 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,738 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,740 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,742 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2025-02-20T04:07:26,745 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-02-20T04:07:26,747 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2025-02-20T04:07:26,748 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-02-20T04:07:26,750 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2025-02-20T04:07:26,755 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2025-02-20T04:07:26,756 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-02-20T04:07:26,758 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-02-20T04:07:26,760 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-02-20T04:07:26,762 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-02-20T04:07:26,764 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2025-02-20T04:07:26,767 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2025-02-20T04:07:26,769 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,771 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,773 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,775 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,777 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,780 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2025-02-20T04:07:26,782 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2025-02-20T04:07:26,783 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-02-20T04:07:26,788 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-02-20T04:07:26,791 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-02-20T04:07:26,793 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2025-02-20T04:07:26,796 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2025-02-20T04:07:26,797 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,799 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,802 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,804 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,806 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,811 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,813 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2025-02-20T04:07:26,817 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2025-02-20T04:07:26,818 copying build/lib/colossalai/utils/safetensors.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-02-20T04:07:26,820 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-02-20T04:07:26,822 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2025-02-20T04:07:26,823 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-02-20T04:07:26,825 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2025-02-20T04:07:26,828 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-02-20T04:07:26,830 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2025-02-20T04:07:26,831 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-02-20T04:07:26,833 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2025-02-20T04:07:26,835 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2025-02-20T04:07:26,837 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-02-20T04:07:26,838 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2025-02-20T04:07:26,841 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2025-02-20T04:07:26,842 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-02-20T04:07:26,844 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2025-02-20T04:07:26,846 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-02-20T04:07:26,848 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2025-02-20T04:07:26,851 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2025-02-20T04:07:26,852 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-02-20T04:07:26,855 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-02-20T04:07:26,857 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-02-20T04:07:26,859 copying build/lib/colossalai/pipeline/weight_grad_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2025-02-20T04:07:26,862 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2025-02-20T04:07:26,863 copying build/lib/colossalai/pipeline/schedule/v_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,865 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,867 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,870 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,872 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,875 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,876 copying build/lib/colossalai/pipeline/schedule/zero_bubble_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,879 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2025-02-20T04:07:26,882 creating build/bdist.linux-armv7l/wheel/colossalai/context 2025-02-20T04:07:26,883 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-02-20T04:07:26,885 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-02-20T04:07:26,887 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2025-02-20T04:07:26,890 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2025-02-20T04:07:26,891 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2025-02-20T04:07:26,893 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-02-20T04:07:26,895 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2025-02-20T04:07:26,898 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:26,901 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:26,903 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:26,905 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:26,907 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2025-02-20T04:07:26,909 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,911 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,914 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,916 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2025-02-20T04:07:26,918 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2025-02-20T04:07:26,920 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:26,921 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:26,923 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:26,925 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:26,927 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2025-02-20T04:07:26,929 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,931 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,933 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,935 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,937 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,939 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2025-02-20T04:07:26,941 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,944 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2025-02-20T04:07:26,946 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2025-02-20T04:07:26,948 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,949 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,951 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,953 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,955 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,957 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,960 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,962 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,963 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2025-02-20T04:07:26,966 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,967 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,969 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,971 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,973 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,975 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,977 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,979 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,981 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2025-02-20T04:07:26,983 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,985 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,987 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2025-02-20T04:07:26,990 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2025-02-20T04:07:26,991 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:26,994 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:26,996 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:26,998 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:27,000 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:27,003 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:27,005 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:27,008 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2025-02-20T04:07:27,010 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:27,013 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2025-02-20T04:07:27,015 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2025-02-20T04:07:27,016 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,019 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,021 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,023 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,025 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,028 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2025-02-20T04:07:27,029 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-02-20T04:07:27,031 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-02-20T04:07:27,033 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,034 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,036 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,038 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,040 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,042 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,044 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,046 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,048 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,050 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2025-02-20T04:07:27,052 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-02-20T04:07:27,054 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-02-20T04:07:27,057 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,058 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,060 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,062 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,064 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,065 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,067 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,069 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,071 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,073 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,075 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,077 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2025-02-20T04:07:27,078 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2025-02-20T04:07:27,080 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,082 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,084 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2025-02-20T04:07:27,086 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2025-02-20T04:07:27,087 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-02-20T04:07:27,090 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2025-02-20T04:07:27,091 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,094 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,096 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,098 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,100 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,103 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,105 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,107 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,110 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,112 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,114 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2025-02-20T04:07:27,117 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2025-02-20T04:07:27,118 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:27,121 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:27,123 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2025-02-20T04:07:27,125 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:27,126 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:27,128 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:27,130 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2025-02-20T04:07:27,134 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:27,135 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:27,137 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:27,140 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2025-02-20T04:07:27,142 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2025-02-20T04:07:27,145 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:27,146 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:27,148 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:27,150 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2025-02-20T04:07:27,153 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:27,154 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:27,156 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:27,158 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2025-02-20T04:07:27,160 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:27,161 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:27,163 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:27,165 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2025-02-20T04:07:27,168 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:27,169 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:27,171 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:27,173 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:27,174 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2025-02-20T04:07:27,177 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,178 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,180 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,182 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,184 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,186 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2025-02-20T04:07:27,411 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:27,415 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:27,420 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2025-02-20T04:07:27,423 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,426 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,432 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,435 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,457 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,466 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2025-02-20T04:07:27,470 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2025-02-20T04:07:27,531 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,538 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,664 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,670 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,696 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,709 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2025-02-20T04:07:27,733 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2025-02-20T04:07:27,745 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,771 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,777 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,784 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,801 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,827 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,839 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,869 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,875 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,888 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:27,897 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:27,901 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:27,926 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:27,930 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2025-02-20T04:07:27,935 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,949 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,962 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,975 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:27,990 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-02-20T04:07:27,993 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2025-02-20T04:07:28,031 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,136 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,179 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,205 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,237 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,245 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2025-02-20T04:07:28,870 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:28,876 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:28,900 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2025-02-20T04:07:28,946 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:28,949 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:28,970 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2025-02-20T04:07:28,976 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:28,982 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2025-02-20T04:07:28,989 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2025-02-20T04:07:28,996 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2025-02-20T04:07:28,998 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-02-20T04:07:29,002 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-02-20T04:07:29,007 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-02-20T04:07:29,011 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2025-02-20T04:07:29,016 creating build/bdist.linux-armv7l/wheel/colossalai/device 2025-02-20T04:07:29,018 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-02-20T04:07:29,023 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-02-20T04:07:29,027 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-02-20T04:07:29,031 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2025-02-20T04:07:29,037 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2025-02-20T04:07:29,042 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2025-02-20T04:07:29,046 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-02-20T04:07:29,050 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-02-20T04:07:29,054 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-02-20T04:07:29,058 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-02-20T04:07:29,061 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2025-02-20T04:07:29,065 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2025-02-20T04:07:29,068 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2025-02-20T04:07:29,070 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2025-02-20T04:07:29,074 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2025-02-20T04:07:29,078 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:29,080 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:29,084 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:29,094 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:29,110 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2025-02-20T04:07:29,114 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:29,116 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:29,119 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2025-02-20T04:07:29,123 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-02-20T04:07:29,132 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2025-02-20T04:07:29,136 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2025-02-20T04:07:29,138 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-02-20T04:07:29,141 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2025-02-20T04:07:29,146 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:29,148 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:29,151 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:29,155 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:29,159 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2025-02-20T04:07:29,163 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,166 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,169 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,171 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,174 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,177 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,180 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2025-02-20T04:07:29,185 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:29,186 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:29,191 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:29,196 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:29,200 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2025-02-20T04:07:29,204 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:29,206 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:29,209 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:29,214 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:29,218 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2025-02-20T04:07:29,222 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:29,224 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:29,227 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:29,231 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:29,234 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2025-02-20T04:07:29,241 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:29,242 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:29,245 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2025-02-20T04:07:29,250 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2025-02-20T04:07:29,252 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-02-20T04:07:29,255 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-02-20T04:07:29,258 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2025-02-20T04:07:29,262 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,263 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,267 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,283 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,287 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,289 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,292 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,296 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,300 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,304 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,309 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,312 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,317 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,321 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2025-02-20T04:07:29,325 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,329 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2025-02-20T04:07:29,335 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2025-02-20T04:07:29,338 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-02-20T04:07:29,342 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2025-02-20T04:07:29,353 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2025-02-20T04:07:29,355 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-02-20T04:07:29,359 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-02-20T04:07:29,362 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-02-20T04:07:29,367 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-02-20T04:07:29,373 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2025-02-20T04:07:29,379 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2025-02-20T04:07:29,381 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-02-20T04:07:29,385 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-02-20T04:07:29,388 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-02-20T04:07:29,391 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-02-20T04:07:29,402 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2025-02-20T04:07:29,410 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-02-20T04:07:29,415 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2025-02-20T04:07:29,423 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2025-02-20T04:07:29,425 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-02-20T04:07:29,429 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-02-20T04:07:29,433 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-02-20T04:07:29,437 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2025-02-20T04:07:29,450 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2025-02-20T04:07:29,452 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-02-20T04:07:29,456 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2025-02-20T04:07:29,460 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-02-20T04:07:29,463 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2025-02-20T04:07:29,467 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2025-02-20T04:07:29,469 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-02-20T04:07:29,473 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-02-20T04:07:29,478 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2025-02-20T04:07:29,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2025-02-20T04:07:29,484 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-02-20T04:07:29,488 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-02-20T04:07:29,492 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-02-20T04:07:29,496 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2025-02-20T04:07:29,500 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2025-02-20T04:07:29,503 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-02-20T04:07:29,506 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2025-02-20T04:07:29,515 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:29,518 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:29,520 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:29,523 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:29,527 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:29,531 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2025-02-20T04:07:29,534 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:29,537 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:29,541 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:29,547 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,549 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,554 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,557 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,561 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,567 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2025-02-20T04:07:29,570 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2025-02-20T04:07:29,575 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,577 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,581 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,583 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,586 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,590 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,594 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,597 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,600 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,604 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2025-02-20T04:07:29,609 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2025-02-20T04:07:29,612 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-02-20T04:07:29,615 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2025-02-20T04:07:29,626 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:29,629 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:29,632 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2025-02-20T04:07:29,636 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:29,638 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:29,641 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:29,645 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2025-02-20T04:07:29,649 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2025-02-20T04:07:29,650 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-02-20T04:07:29,653 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2025-02-20T04:07:29,657 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,659 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,662 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,664 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,667 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,670 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,672 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,675 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,679 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2025-02-20T04:07:29,682 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:29,684 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:29,687 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2025-02-20T04:07:29,691 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2025-02-20T04:07:29,694 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-02-20T04:07:29,699 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-02-20T04:07:29,702 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-02-20T04:07:29,706 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-02-20T04:07:29,709 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2025-02-20T04:07:29,713 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-02-20T04:07:29,718 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2025-02-20T04:07:29,720 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-02-20T04:07:29,724 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2025-02-20T04:07:29,729 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2025-02-20T04:07:29,731 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-02-20T04:07:29,735 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2025-02-20T04:07:29,740 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,742 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,745 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,748 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,752 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,755 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,759 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,763 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2025-02-20T04:07:29,767 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2025-02-20T04:07:29,770 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-02-20T04:07:29,774 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-02-20T04:07:29,778 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-02-20T04:07:29,783 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2025-02-20T04:07:29,785 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-02-20T04:07:29,788 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-02-20T04:07:29,791 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2025-02-20T04:07:29,796 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2025-02-20T04:07:29,798 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-02-20T04:07:29,801 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-02-20T04:07:29,805 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2025-02-20T04:07:29,807 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-02-20T04:07:29,811 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2025-02-20T04:07:29,814 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2025-02-20T04:07:29,816 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-02-20T04:07:29,818 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-02-20T04:07:29,822 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:29,823 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:29,830 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:29,832 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:29,834 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2025-02-20T04:07:29,837 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-02-20T04:07:29,845 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2025-02-20T04:07:29,848 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2025-02-20T04:07:29,850 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-02-20T04:07:29,852 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-02-20T04:07:29,858 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-02-20T04:07:29,860 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-02-20T04:07:29,864 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2025-02-20T04:07:29,866 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:29,867 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:29,870 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2025-02-20T04:07:29,874 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-02-20T04:07:29,876 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2025-02-20T04:07:29,888 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2025-02-20T04:07:29,890 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-02-20T04:07:29,894 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-02-20T04:07:29,899 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-02-20T04:07:29,924 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2025-02-20T04:07:29,927 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2025-02-20T04:07:29,931 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2025-02-20T04:07:29,932 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-02-20T04:07:29,935 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-02-20T04:07:29,937 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2025-02-20T04:07:29,941 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2025-02-20T04:07:29,942 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-02-20T04:07:29,944 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-02-20T04:07:29,946 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2025-02-20T04:07:29,951 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,952 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,954 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,956 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,958 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,960 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,962 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,964 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,967 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,970 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,972 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,974 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2025-02-20T04:07:29,977 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2025-02-20T04:07:29,978 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-02-20T04:07:29,980 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2025-02-20T04:07:29,983 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-02-20T04:07:29,986 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2025-02-20T04:07:29,988 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2025-02-20T04:07:29,990 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:29,992 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:29,995 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:29,996 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:29,998 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:30,000 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:30,002 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:30,005 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2025-02-20T04:07:30,007 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:30,009 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:30,011 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2025-02-20T04:07:30,013 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:30,015 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:30,018 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:30,020 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:30,022 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2025-02-20T04:07:30,025 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2025-02-20T04:07:30,026 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-02-20T04:07:30,028 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2025-02-20T04:07:30,030 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2025-02-20T04:07:30,032 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2025-02-20T04:07:30,034 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-02-20T04:07:30,036 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-02-20T04:07:30,038 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2025-02-20T04:07:30,040 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,041 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,043 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,045 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,047 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,049 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2025-02-20T04:07:30,051 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,053 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,055 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,057 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,060 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,062 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,064 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2025-02-20T04:07:30,067 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:30,068 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:30,072 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2025-02-20T04:07:30,074 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-02-20T04:07:30,076 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2025-02-20T04:07:30,078 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,081 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,083 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,085 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,087 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,090 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2025-02-20T04:07:30,092 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2025-02-20T04:07:30,095 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2025-02-20T04:07:30,096 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,098 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,100 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,102 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,105 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,107 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,109 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,111 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2025-02-20T04:07:30,114 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2025-02-20T04:07:30,116 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2025-02-20T04:07:30,118 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,120 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,122 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,126 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,128 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,132 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,134 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,136 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,139 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,141 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,143 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,145 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,147 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,149 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,151 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2025-02-20T04:07:30,153 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,156 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2025-02-20T04:07:30,157 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-02-20T04:07:30,160 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-02-20T04:07:30,163 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-02-20T04:07:30,165 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-02-20T04:07:30,167 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2025-02-20T04:07:30,170 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2025-02-20T04:07:30,172 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-02-20T04:07:30,174 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2025-02-20T04:07:30,178 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2025-02-20T04:07:30,179 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-02-20T04:07:30,181 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-02-20T04:07:30,185 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-02-20T04:07:30,187 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,188 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,191 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,193 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,195 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,198 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2025-02-20T04:07:30,199 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2025-02-20T04:07:30,202 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2025-02-20T04:07:30,203 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-02-20T04:07:30,206 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2025-02-20T04:07:30,207 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-02-20T04:07:30,210 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-02-20T04:07:30,212 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-02-20T04:07:30,214 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2025-02-20T04:07:30,217 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2025-02-20T04:07:30,218 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-02-20T04:07:30,220 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2025-02-20T04:07:30,222 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2025-02-20T04:07:30,225 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2025-02-20T04:07:30,226 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-02-20T04:07:30,228 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2025-02-20T04:07:30,231 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2025-02-20T04:07:30,232 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,234 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,236 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,238 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,241 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,243 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2025-02-20T04:07:30,245 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-02-20T04:07:30,247 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-02-20T04:07:30,249 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2025-02-20T04:07:30,251 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,255 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2025-02-20T04:07:30,256 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,258 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,261 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,262 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,264 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,267 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,269 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,271 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2025-02-20T04:07:30,274 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,277 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2025-02-20T04:07:30,278 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-02-20T04:07:30,279 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2025-02-20T04:07:30,282 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2025-02-20T04:07:30,284 creating build/bdist.linux-armv7l/wheel/extensions 2025-02-20T04:07:30,286 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2025-02-20T04:07:30,288 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2025-02-20T04:07:30,289 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-02-20T04:07:30,291 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2025-02-20T04:07:30,293 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2025-02-20T04:07:30,294 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-02-20T04:07:30,296 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2025-02-20T04:07:30,298 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2025-02-20T04:07:30,300 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2025-02-20T04:07:30,301 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-02-20T04:07:30,303 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2025-02-20T04:07:30,306 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2025-02-20T04:07:30,307 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-02-20T04:07:30,309 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2025-02-20T04:07:30,311 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2025-02-20T04:07:30,312 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-02-20T04:07:30,314 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-02-20T04:07:30,316 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2025-02-20T04:07:30,319 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2025-02-20T04:07:30,320 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-02-20T04:07:30,322 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-02-20T04:07:30,324 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-02-20T04:07:30,326 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2025-02-20T04:07:30,329 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2025-02-20T04:07:30,330 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-02-20T04:07:30,332 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-02-20T04:07:30,333 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2025-02-20T04:07:30,336 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2025-02-20T04:07:30,337 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2025-02-20T04:07:30,338 running install_egg_info 2025-02-20T04:07:30,371 running egg_info 2025-02-20T04:07:30,398 writing colossalai.egg-info/PKG-INFO 2025-02-20T04:07:30,402 writing dependency_links to colossalai.egg-info/dependency_links.txt 2025-02-20T04:07:30,404 writing entry points to colossalai.egg-info/entry_points.txt 2025-02-20T04:07:30,405 writing requirements to colossalai.egg-info/requires.txt 2025-02-20T04:07:30,407 writing top-level names to colossalai.egg-info/top_level.txt 2025-02-20T04:07:30,708 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2025-02-20T04:07:30,802 reading manifest template 'MANIFEST.in' 2025-02-20T04:07:32,142 warning: no files found matching '*.tr' under directory 'colossalai' 2025-02-20T04:07:32,853 warning: no files found matching '*.cc' under directory 'colossalai' 2025-02-20T04:07:33,548 warning: no files found matching '*.pyi' under directory 'colossalai' 2025-02-20T04:07:33,726 warning: no files found matching '*.tr' under directory 'extensions' 2025-02-20T04:07:33,784 warning: no files found matching '*.cc' under directory 'extensions' 2025-02-20T04:07:33,813 warning: no files found matching '*.pyi' under directory 'extensions' 2025-02-20T04:07:33,814 adding license file 'LICENSE' 2025-02-20T04:07:33,864 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2025-02-20T04:07:33,867 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.8-py3.11.egg-info 2025-02-20T04:07:33,882 running install_scripts 2025-02-20T04:07:33,907 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.8.dist-info/WHEEL 2025-02-20T04:07:33,910 creating '/tmp/pip-wheel-esgvbr6z/colossalai-0.4.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-02-20T04:07:33,913 adding 'colossalai/__init__.py' 2025-02-20T04:07:33,914 adding 'colossalai/initialize.py' 2025-02-20T04:07:33,915 adding 'colossalai/version.py' 2025-02-20T04:07:33,917 adding 'colossalai/_C/__init__.py' 2025-02-20T04:07:33,919 adding 'colossalai/_analyzer/__init__.py' 2025-02-20T04:07:33,920 adding 'colossalai/_analyzer/envs.py' 2025-02-20T04:07:33,922 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2025-02-20T04:07:33,924 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2025-02-20T04:07:33,926 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2025-02-20T04:07:33,928 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2025-02-20T04:07:33,930 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2025-02-20T04:07:33,932 adding 'colossalai/_analyzer/fx/__init__.py' 2025-02-20T04:07:33,935 adding 'colossalai/_analyzer/fx/codegen.py' 2025-02-20T04:07:33,937 adding 'colossalai/_analyzer/fx/graph_module.py' 2025-02-20T04:07:33,939 adding 'colossalai/_analyzer/fx/node_util.py' 2025-02-20T04:07:33,941 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2025-02-20T04:07:33,943 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2025-02-20T04:07:33,945 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2025-02-20T04:07:33,947 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2025-02-20T04:07:33,949 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2025-02-20T04:07:33,951 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2025-02-20T04:07:33,953 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2025-02-20T04:07:33,954 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2025-02-20T04:07:33,956 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2025-02-20T04:07:33,959 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2025-02-20T04:07:33,961 adding 'colossalai/accelerator/__init__.py' 2025-02-20T04:07:33,962 adding 'colossalai/accelerator/api.py' 2025-02-20T04:07:33,964 adding 'colossalai/accelerator/base_accelerator.py' 2025-02-20T04:07:33,966 adding 'colossalai/accelerator/cpu_accelerator.py' 2025-02-20T04:07:33,968 adding 'colossalai/accelerator/cuda_accelerator.py' 2025-02-20T04:07:33,970 adding 'colossalai/accelerator/npu_accelerator.py' 2025-02-20T04:07:33,972 adding 'colossalai/amp/__init__.py' 2025-02-20T04:07:33,974 adding 'colossalai/amp/naive_amp/__init__.py' 2025-02-20T04:07:33,976 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2025-02-20T04:07:33,978 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2025-02-20T04:07:33,979 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2025-02-20T04:07:33,981 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2025-02-20T04:07:33,982 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2025-02-20T04:07:33,984 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2025-02-20T04:07:33,986 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2025-02-20T04:07:33,987 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2025-02-20T04:07:33,989 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2025-02-20T04:07:33,991 adding 'colossalai/auto_parallel/__init__.py' 2025-02-20T04:07:33,993 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2025-02-20T04:07:33,994 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2025-02-20T04:07:33,996 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2025-02-20T04:07:33,998 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2025-02-20T04:07:34,000 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2025-02-20T04:07:34,002 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2025-02-20T04:07:34,004 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2025-02-20T04:07:34,005 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2025-02-20T04:07:34,007 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2025-02-20T04:07:34,009 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2025-02-20T04:07:34,011 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2025-02-20T04:07:34,012 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2025-02-20T04:07:34,014 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2025-02-20T04:07:34,016 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2025-02-20T04:07:34,017 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2025-02-20T04:07:34,020 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2025-02-20T04:07:34,022 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2025-02-20T04:07:34,023 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2025-02-20T04:07:34,025 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2025-02-20T04:07:34,027 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2025-02-20T04:07:34,029 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2025-02-20T04:07:34,031 adding 'colossalai/auto_parallel/offload/__init__.py' 2025-02-20T04:07:34,032 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2025-02-20T04:07:34,034 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2025-02-20T04:07:34,036 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2025-02-20T04:07:34,038 adding 'colossalai/auto_parallel/offload/region.py' 2025-02-20T04:07:34,041 adding 'colossalai/auto_parallel/offload/region_manager.py' 2025-02-20T04:07:34,043 adding 'colossalai/auto_parallel/offload/runtime.py' 2025-02-20T04:07:34,045 adding 'colossalai/auto_parallel/offload/solver.py' 2025-02-20T04:07:34,048 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2025-02-20T04:07:34,050 adding 'colossalai/auto_parallel/offload/util.py' 2025-02-20T04:07:34,051 adding 'colossalai/auto_parallel/passes/__init__.py' 2025-02-20T04:07:34,053 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2025-02-20T04:07:34,055 adding 'colossalai/auto_parallel/passes/constants.py' 2025-02-20T04:07:34,056 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2025-02-20T04:07:34,058 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2025-02-20T04:07:34,062 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2025-02-20T04:07:34,063 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2025-02-20T04:07:34,065 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2025-02-20T04:07:34,067 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2025-02-20T04:07:34,069 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2025-02-20T04:07:34,071 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2025-02-20T04:07:34,073 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2025-02-20T04:07:34,076 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2025-02-20T04:07:34,077 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2025-02-20T04:07:34,079 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2025-02-20T04:07:34,081 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2025-02-20T04:07:34,083 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2025-02-20T04:07:34,084 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2025-02-20T04:07:34,086 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2025-02-20T04:07:34,088 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2025-02-20T04:07:34,090 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2025-02-20T04:07:34,091 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2025-02-20T04:07:34,093 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2025-02-20T04:07:34,095 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2025-02-20T04:07:34,099 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2025-02-20T04:07:34,101 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2025-02-20T04:07:34,103 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2025-02-20T04:07:34,104 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2025-02-20T04:07:34,106 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2025-02-20T04:07:34,107 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2025-02-20T04:07:34,109 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2025-02-20T04:07:34,111 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2025-02-20T04:07:34,112 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2025-02-20T04:07:34,114 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2025-02-20T04:07:34,116 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2025-02-20T04:07:34,118 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2025-02-20T04:07:34,119 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2025-02-20T04:07:34,121 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2025-02-20T04:07:34,122 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2025-02-20T04:07:34,125 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2025-02-20T04:07:34,127 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2025-02-20T04:07:34,129 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2025-02-20T04:07:34,131 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2025-02-20T04:07:34,133 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2025-02-20T04:07:34,135 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2025-02-20T04:07:34,136 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2025-02-20T04:07:34,139 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2025-02-20T04:07:34,142 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2025-02-20T04:07:34,144 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2025-02-20T04:07:34,146 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2025-02-20T04:07:34,147 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2025-02-20T04:07:34,150 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2025-02-20T04:07:34,151 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2025-02-20T04:07:34,154 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2025-02-20T04:07:34,156 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2025-02-20T04:07:34,158 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2025-02-20T04:07:34,159 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2025-02-20T04:07:34,161 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2025-02-20T04:07:34,163 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2025-02-20T04:07:34,165 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2025-02-20T04:07:34,167 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2025-02-20T04:07:34,170 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2025-02-20T04:07:34,173 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2025-02-20T04:07:34,175 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2025-02-20T04:07:34,176 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2025-02-20T04:07:34,178 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2025-02-20T04:07:34,180 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2025-02-20T04:07:34,182 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2025-02-20T04:07:34,184 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2025-02-20T04:07:34,186 adding 'colossalai/booster/__init__.py' 2025-02-20T04:07:34,187 adding 'colossalai/booster/accelerator.py' 2025-02-20T04:07:34,190 adding 'colossalai/booster/booster.py' 2025-02-20T04:07:34,192 adding 'colossalai/booster/mixed_precision/__init__.py' 2025-02-20T04:07:34,194 adding 'colossalai/booster/mixed_precision/bf16.py' 2025-02-20T04:07:34,195 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2025-02-20T04:07:34,197 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2025-02-20T04:07:34,199 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2025-02-20T04:07:34,200 adding 'colossalai/booster/mixed_precision/fp8.py' 2025-02-20T04:07:34,202 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2025-02-20T04:07:34,203 adding 'colossalai/booster/plugin/__init__.py' 2025-02-20T04:07:34,205 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2025-02-20T04:07:34,209 adding 'colossalai/booster/plugin/gemini_plugin.py' 2025-02-20T04:07:34,217 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2025-02-20T04:07:34,221 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2025-02-20T04:07:34,224 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2025-02-20T04:07:34,226 adding 'colossalai/booster/plugin/plugin_base.py' 2025-02-20T04:07:34,227 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2025-02-20T04:07:34,229 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2025-02-20T04:07:34,232 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2025-02-20T04:07:34,236 adding 'colossalai/checkpoint_io/__init__.py' 2025-02-20T04:07:34,238 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2025-02-20T04:07:34,241 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2025-02-20T04:07:34,246 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2025-02-20T04:07:34,248 adding 'colossalai/checkpoint_io/index_file.py' 2025-02-20T04:07:34,253 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2025-02-20T04:07:34,259 adding 'colossalai/checkpoint_io/utils.py' 2025-02-20T04:07:34,261 adding 'colossalai/cli/__init__.py' 2025-02-20T04:07:34,262 adding 'colossalai/cli/cli.py' 2025-02-20T04:07:34,264 adding 'colossalai/cli/check/__init__.py' 2025-02-20T04:07:34,266 adding 'colossalai/cli/check/check_installation.py' 2025-02-20T04:07:34,269 adding 'colossalai/cli/launcher/__init__.py' 2025-02-20T04:07:34,270 adding 'colossalai/cli/launcher/hostinfo.py' 2025-02-20T04:07:34,272 adding 'colossalai/cli/launcher/multinode_runner.py' 2025-02-20T04:07:34,274 adding 'colossalai/cli/launcher/run.py' 2025-02-20T04:07:34,276 adding 'colossalai/cluster/__init__.py' 2025-02-20T04:07:34,278 adding 'colossalai/cluster/device_mesh_manager.py' 2025-02-20T04:07:34,280 adding 'colossalai/cluster/dist_coordinator.py' 2025-02-20T04:07:34,281 adding 'colossalai/cluster/process_group_manager.py' 2025-02-20T04:07:34,283 adding 'colossalai/cluster/process_group_mesh.py' 2025-02-20T04:07:34,285 adding 'colossalai/context/__init__.py' 2025-02-20T04:07:34,287 adding 'colossalai/context/config.py' 2025-02-20T04:07:34,289 adding 'colossalai/context/singleton_meta.py' 2025-02-20T04:07:34,290 adding 'colossalai/device/__init__.py' 2025-02-20T04:07:34,293 adding 'colossalai/device/alpha_beta_profiler.py' 2025-02-20T04:07:34,295 adding 'colossalai/device/calc_pipeline_strategy.py' 2025-02-20T04:07:34,298 adding 'colossalai/device/device_mesh.py' 2025-02-20T04:07:34,300 adding 'colossalai/fx/__init__.py' 2025-02-20T04:07:34,302 adding 'colossalai/fx/_compatibility.py' 2025-02-20T04:07:34,304 adding 'colossalai/fx/_meta_regist_12.py' 2025-02-20T04:07:34,311 adding 'colossalai/fx/_meta_regist_13.py' 2025-02-20T04:07:34,313 adding 'colossalai/fx/graph_module.py' 2025-02-20T04:07:34,315 adding 'colossalai/fx/proxy.py' 2025-02-20T04:07:34,316 adding 'colossalai/fx/codegen/__init__.py' 2025-02-20T04:07:34,321 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2025-02-20T04:07:34,323 adding 'colossalai/fx/passes/__init__.py' 2025-02-20T04:07:34,325 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2025-02-20T04:07:34,327 adding 'colossalai/fx/passes/concrete_info_prop.py' 2025-02-20T04:07:34,329 adding 'colossalai/fx/passes/meta_info_prop.py' 2025-02-20T04:07:34,331 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2025-02-20T04:07:34,333 adding 'colossalai/fx/passes/shard_1d_pass.py' 2025-02-20T04:07:34,335 adding 'colossalai/fx/passes/split_module.py' 2025-02-20T04:07:34,337 adding 'colossalai/fx/passes/utils.py' 2025-02-20T04:07:34,338 adding 'colossalai/fx/profiler/__init__.py' 2025-02-20T04:07:34,339 adding 'colossalai/fx/profiler/constants.py' 2025-02-20T04:07:34,341 adding 'colossalai/fx/profiler/dataflow.py' 2025-02-20T04:07:34,342 adding 'colossalai/fx/profiler/memory_utils.py' 2025-02-20T04:07:34,344 adding 'colossalai/fx/profiler/opcount.py' 2025-02-20T04:07:34,346 adding 'colossalai/fx/profiler/profiler.py' 2025-02-20T04:07:34,347 adding 'colossalai/fx/profiler/shard_utils.py' 2025-02-20T04:07:34,349 adding 'colossalai/fx/profiler/tensor.py' 2025-02-20T04:07:34,351 adding 'colossalai/fx/profiler/experimental/__init__.py' 2025-02-20T04:07:34,352 adding 'colossalai/fx/profiler/experimental/constants.py' 2025-02-20T04:07:34,353 adding 'colossalai/fx/profiler/experimental/profiler.py' 2025-02-20T04:07:34,354 adding 'colossalai/fx/profiler/experimental/registry.py' 2025-02-20T04:07:34,356 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2025-02-20T04:07:34,357 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2025-02-20T04:07:34,359 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2025-02-20T04:07:34,360 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2025-02-20T04:07:34,361 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2025-02-20T04:07:34,362 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2025-02-20T04:07:34,364 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2025-02-20T04:07:34,365 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2025-02-20T04:07:34,366 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2025-02-20T04:07:34,367 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2025-02-20T04:07:34,369 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2025-02-20T04:07:34,370 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2025-02-20T04:07:34,372 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2025-02-20T04:07:34,373 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2025-02-20T04:07:34,374 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2025-02-20T04:07:34,375 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2025-02-20T04:07:34,377 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2025-02-20T04:07:34,378 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2025-02-20T04:07:34,379 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2025-02-20T04:07:34,380 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2025-02-20T04:07:34,382 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2025-02-20T04:07:34,383 adding 'colossalai/fx/tracer/__init__.py' 2025-02-20T04:07:34,385 adding 'colossalai/fx/tracer/_meta_trace.py' 2025-02-20T04:07:34,386 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2025-02-20T04:07:34,387 adding 'colossalai/fx/tracer/_tracer_utils.py' 2025-02-20T04:07:34,390 adding 'colossalai/fx/tracer/experimental.py' 2025-02-20T04:07:34,392 adding 'colossalai/fx/tracer/registry.py' 2025-02-20T04:07:34,395 adding 'colossalai/fx/tracer/tracer.py' 2025-02-20T04:07:34,397 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2025-02-20T04:07:34,399 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2025-02-20T04:07:34,400 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2025-02-20T04:07:34,401 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2025-02-20T04:07:34,403 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2025-02-20T04:07:34,404 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2025-02-20T04:07:34,406 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2025-02-20T04:07:34,407 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2025-02-20T04:07:34,408 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2025-02-20T04:07:34,409 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2025-02-20T04:07:34,411 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2025-02-20T04:07:34,413 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2025-02-20T04:07:34,414 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2025-02-20T04:07:34,415 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2025-02-20T04:07:34,416 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2025-02-20T04:07:34,417 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2025-02-20T04:07:34,419 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2025-02-20T04:07:34,420 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2025-02-20T04:07:34,422 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2025-02-20T04:07:34,423 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2025-02-20T04:07:34,424 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2025-02-20T04:07:34,426 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2025-02-20T04:07:34,427 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2025-02-20T04:07:34,428 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2025-02-20T04:07:34,429 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2025-02-20T04:07:34,431 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2025-02-20T04:07:34,432 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2025-02-20T04:07:34,434 adding 'colossalai/inference/__init__.py' 2025-02-20T04:07:34,437 adding 'colossalai/inference/batch_bucket.py' 2025-02-20T04:07:34,440 adding 'colossalai/inference/config.py' 2025-02-20T04:07:34,442 adding 'colossalai/inference/flash_decoding_utils.py' 2025-02-20T04:07:34,443 adding 'colossalai/inference/graph_runner.py' 2025-02-20T04:07:34,445 adding 'colossalai/inference/logit_processors.py' 2025-02-20T04:07:34,446 adding 'colossalai/inference/sampler.py' 2025-02-20T04:07:34,447 adding 'colossalai/inference/struct.py' 2025-02-20T04:07:34,449 adding 'colossalai/inference/utils.py' 2025-02-20T04:07:34,451 adding 'colossalai/inference/core/__init__.py' 2025-02-20T04:07:34,453 adding 'colossalai/inference/core/async_engine.py' 2025-02-20T04:07:34,454 adding 'colossalai/inference/core/base_engine.py' 2025-02-20T04:07:34,456 adding 'colossalai/inference/core/diffusion_engine.py' 2025-02-20T04:07:34,458 adding 'colossalai/inference/core/engine.py' 2025-02-20T04:07:34,462 adding 'colossalai/inference/core/llm_engine.py' 2025-02-20T04:07:34,463 adding 'colossalai/inference/core/plugin.py' 2025-02-20T04:07:34,466 adding 'colossalai/inference/core/request_handler.py' 2025-02-20T04:07:34,468 adding 'colossalai/inference/core/rpc_engine.py' 2025-02-20T04:07:34,470 adding 'colossalai/inference/executor/__init__.py' 2025-02-20T04:07:34,472 adding 'colossalai/inference/executor/rpc_worker.py' 2025-02-20T04:07:34,474 adding 'colossalai/inference/kv_cache/__init__.py' 2025-02-20T04:07:34,475 adding 'colossalai/inference/kv_cache/block_cache.py' 2025-02-20T04:07:34,478 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2025-02-20T04:07:34,480 adding 'colossalai/inference/modeling/__init__.py' 2025-02-20T04:07:34,482 adding 'colossalai/inference/modeling/backends/__init__.py' 2025-02-20T04:07:34,483 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2025-02-20T04:07:34,484 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2025-02-20T04:07:34,486 adding 'colossalai/inference/modeling/layers/__init__.py' 2025-02-20T04:07:34,488 adding 'colossalai/inference/modeling/layers/attention.py' 2025-02-20T04:07:34,489 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2025-02-20T04:07:34,491 adding 'colossalai/inference/modeling/layers/diffusion.py' 2025-02-20T04:07:34,493 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2025-02-20T04:07:34,495 adding 'colossalai/inference/modeling/models/__init__.py' 2025-02-20T04:07:34,497 adding 'colossalai/inference/modeling/models/glide_llama.py' 2025-02-20T04:07:34,499 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2025-02-20T04:07:34,503 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2025-02-20T04:07:34,505 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2025-02-20T04:07:34,506 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2025-02-20T04:07:34,508 adding 'colossalai/inference/modeling/policy/__init__.py' 2025-02-20T04:07:34,509 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2025-02-20T04:07:34,510 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2025-02-20T04:07:34,512 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2025-02-20T04:07:34,513 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2025-02-20T04:07:34,514 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2025-02-20T04:07:34,516 adding 'colossalai/inference/server/__init__.py' 2025-02-20T04:07:34,518 adding 'colossalai/inference/server/api_server.py' 2025-02-20T04:07:34,519 adding 'colossalai/inference/server/chat_service.py' 2025-02-20T04:07:34,521 adding 'colossalai/inference/server/completion_service.py' 2025-02-20T04:07:34,522 adding 'colossalai/inference/server/utils.py' 2025-02-20T04:07:34,523 adding 'colossalai/inference/spec/__init__.py' 2025-02-20T04:07:34,525 adding 'colossalai/inference/spec/drafter.py' 2025-02-20T04:07:34,526 adding 'colossalai/inference/spec/struct.py' 2025-02-20T04:07:34,528 adding 'colossalai/interface/__init__.py' 2025-02-20T04:07:34,529 adding 'colossalai/interface/model.py' 2025-02-20T04:07:34,530 adding 'colossalai/interface/optimizer.py' 2025-02-20T04:07:34,532 adding 'colossalai/interface/pretrained.py' 2025-02-20T04:07:34,533 adding 'colossalai/kernel/__init__.py' 2025-02-20T04:07:34,535 adding 'colossalai/kernel/kernel_loader.py' 2025-02-20T04:07:34,536 adding 'colossalai/kernel/extensions/__init__.py' 2025-02-20T04:07:34,538 adding 'colossalai/kernel/extensions/base_extension.py' 2025-02-20T04:07:34,539 adding 'colossalai/kernel/extensions/cpp_extension.py' 2025-02-20T04:07:34,540 adding 'colossalai/kernel/extensions/cuda_extension.py' 2025-02-20T04:07:34,542 adding 'colossalai/kernel/extensions/triton_extension.py' 2025-02-20T04:07:34,543 adding 'colossalai/kernel/extensions/utils.py' 2025-02-20T04:07:34,545 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2025-02-20T04:07:34,547 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2025-02-20T04:07:34,548 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2025-02-20T04:07:34,550 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2025-02-20T04:07:34,551 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2025-02-20T04:07:34,552 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2025-02-20T04:07:34,555 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2025-02-20T04:07:34,557 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2025-02-20T04:07:34,558 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2025-02-20T04:07:34,560 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2025-02-20T04:07:34,561 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2025-02-20T04:07:34,564 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2025-02-20T04:07:34,565 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2025-02-20T04:07:34,567 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2025-02-20T04:07:34,569 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2025-02-20T04:07:34,570 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2025-02-20T04:07:34,572 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2025-02-20T04:07:34,575 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2025-02-20T04:07:34,578 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2025-02-20T04:07:34,580 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2025-02-20T04:07:34,583 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2025-02-20T04:07:34,586 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2025-02-20T04:07:34,587 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2025-02-20T04:07:34,589 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2025-02-20T04:07:34,591 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2025-02-20T04:07:34,593 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2025-02-20T04:07:34,594 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2025-02-20T04:07:34,596 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2025-02-20T04:07:34,598 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2025-02-20T04:07:34,600 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2025-02-20T04:07:34,602 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2025-02-20T04:07:34,604 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2025-02-20T04:07:34,606 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2025-02-20T04:07:34,608 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2025-02-20T04:07:34,609 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2025-02-20T04:07:34,610 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2025-02-20T04:07:34,613 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2025-02-20T04:07:34,615 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2025-02-20T04:07:34,616 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2025-02-20T04:07:34,619 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2025-02-20T04:07:34,620 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-02-20T04:07:34,622 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-02-20T04:07:34,624 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2025-02-20T04:07:34,625 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-02-20T04:07:34,627 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2025-02-20T04:07:34,628 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-02-20T04:07:34,630 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2025-02-20T04:07:34,632 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2025-02-20T04:07:34,633 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2025-02-20T04:07:34,635 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2025-02-20T04:07:34,637 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2025-02-20T04:07:34,638 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2025-02-20T04:07:34,640 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2025-02-20T04:07:34,641 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2025-02-20T04:07:34,643 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2025-02-20T04:07:34,645 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2025-02-20T04:07:34,646 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-02-20T04:07:34,648 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2025-02-20T04:07:34,650 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2025-02-20T04:07:34,651 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2025-02-20T04:07:34,653 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-02-20T04:07:34,654 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2025-02-20T04:07:34,656 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-02-20T04:07:34,658 adding 'colossalai/kernel/jit/__init__.py' 2025-02-20T04:07:34,659 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2025-02-20T04:07:34,661 adding 'colossalai/kernel/jit/bias_gelu.py' 2025-02-20T04:07:34,663 adding 'colossalai/kernel/jit/option.py' 2025-02-20T04:07:34,665 adding 'colossalai/kernel/triton/__init__.py' 2025-02-20T04:07:34,667 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2025-02-20T04:07:34,670 adding 'colossalai/kernel/triton/flash_decoding.py' 2025-02-20T04:07:34,672 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2025-02-20T04:07:34,674 adding 'colossalai/kernel/triton/kvcache_copy.py' 2025-02-20T04:07:34,676 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2025-02-20T04:07:34,679 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2025-02-20T04:07:34,681 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2025-02-20T04:07:34,683 adding 'colossalai/kernel/triton/rms_layernorm.py' 2025-02-20T04:07:34,685 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2025-02-20T04:07:34,686 adding 'colossalai/kernel/triton/softmax.py' 2025-02-20T04:07:34,688 adding 'colossalai/lazy/__init__.py' 2025-02-20T04:07:34,690 adding 'colossalai/lazy/construction.py' 2025-02-20T04:07:34,693 adding 'colossalai/lazy/lazy_init.py' 2025-02-20T04:07:34,696 adding 'colossalai/lazy/pretrained.py' 2025-02-20T04:07:34,698 adding 'colossalai/legacy/__init__.py' 2025-02-20T04:07:34,699 adding 'colossalai/legacy/constants.py' 2025-02-20T04:07:34,701 adding 'colossalai/legacy/core.py' 2025-02-20T04:07:34,702 adding 'colossalai/legacy/global_variables.py' 2025-02-20T04:07:34,705 adding 'colossalai/legacy/initialize.py' 2025-02-20T04:07:34,707 adding 'colossalai/legacy/amp/__init__.py' 2025-02-20T04:07:34,709 adding 'colossalai/legacy/amp/amp_type.py' 2025-02-20T04:07:34,710 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2025-02-20T04:07:34,712 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2025-02-20T04:07:34,714 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2025-02-20T04:07:34,716 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2025-02-20T04:07:34,718 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2025-02-20T04:07:34,720 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2025-02-20T04:07:34,722 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2025-02-20T04:07:34,725 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2025-02-20T04:07:34,727 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2025-02-20T04:07:34,730 adding 'colossalai/legacy/builder/__init__.py' 2025-02-20T04:07:34,731 adding 'colossalai/legacy/builder/builder.py' 2025-02-20T04:07:34,733 adding 'colossalai/legacy/communication/__init__.py' 2025-02-20T04:07:34,735 adding 'colossalai/legacy/communication/collective.py' 2025-02-20T04:07:34,737 adding 'colossalai/legacy/communication/p2p.py' 2025-02-20T04:07:34,740 adding 'colossalai/legacy/communication/p2p_v2.py' 2025-02-20T04:07:34,741 adding 'colossalai/legacy/communication/ring.py' 2025-02-20T04:07:34,743 adding 'colossalai/legacy/communication/utils.py' 2025-02-20T04:07:34,745 adding 'colossalai/legacy/context/__init__.py' 2025-02-20T04:07:34,748 adding 'colossalai/legacy/context/parallel_context.py' 2025-02-20T04:07:34,750 adding 'colossalai/legacy/context/parallel_mode.py' 2025-02-20T04:07:34,752 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2025-02-20T04:07:34,753 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2025-02-20T04:07:34,755 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2025-02-20T04:07:34,757 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2025-02-20T04:07:34,759 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2025-02-20T04:07:34,761 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2025-02-20T04:07:34,762 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2025-02-20T04:07:34,764 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2025-02-20T04:07:34,765 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2025-02-20T04:07:34,767 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2025-02-20T04:07:34,769 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2025-02-20T04:07:34,770 adding 'colossalai/legacy/context/random/__init__.py' 2025-02-20T04:07:34,772 adding 'colossalai/legacy/context/random/_helper.py' 2025-02-20T04:07:34,774 adding 'colossalai/legacy/context/random/seed_manager.py' 2025-02-20T04:07:34,776 adding 'colossalai/legacy/engine/__init__.py' 2025-02-20T04:07:34,778 adding 'colossalai/legacy/engine/_base_engine.py' 2025-02-20T04:07:34,780 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2025-02-20T04:07:34,782 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2025-02-20T04:07:34,784 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2025-02-20T04:07:34,786 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2025-02-20T04:07:34,787 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2025-02-20T04:07:34,789 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2025-02-20T04:07:34,790 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2025-02-20T04:07:34,792 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2025-02-20T04:07:34,793 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2025-02-20T04:07:34,795 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2025-02-20T04:07:34,797 adding 'colossalai/legacy/engine/schedule/__init__.py' 2025-02-20T04:07:34,799 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2025-02-20T04:07:34,800 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2025-02-20T04:07:34,804 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2025-02-20T04:07:34,807 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2025-02-20T04:07:34,809 adding 'colossalai/legacy/inference/__init__.py' 2025-02-20T04:07:34,811 adding 'colossalai/legacy/inference/async_engine.py' 2025-02-20T04:07:34,812 adding 'colossalai/legacy/inference/async_manager.py' 2025-02-20T04:07:34,815 adding 'colossalai/legacy/inference/manager.py' 2025-02-20T04:07:34,817 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2025-02-20T04:07:34,819 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2025-02-20T04:07:34,821 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2025-02-20T04:07:34,823 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2025-02-20T04:07:34,824 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2025-02-20T04:07:34,826 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2025-02-20T04:07:34,828 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2025-02-20T04:07:34,829 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2025-02-20T04:07:34,831 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2025-02-20T04:07:34,833 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2025-02-20T04:07:34,835 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2025-02-20T04:07:34,837 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2025-02-20T04:07:34,839 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2025-02-20T04:07:34,841 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2025-02-20T04:07:34,843 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2025-02-20T04:07:34,845 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2025-02-20T04:07:34,847 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2025-02-20T04:07:34,849 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2025-02-20T04:07:34,851 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2025-02-20T04:07:34,853 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2025-02-20T04:07:34,856 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2025-02-20T04:07:34,858 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2025-02-20T04:07:34,859 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2025-02-20T04:07:34,861 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2025-02-20T04:07:34,864 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2025-02-20T04:07:34,868 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2025-02-20T04:07:34,870 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2025-02-20T04:07:34,872 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2025-02-20T04:07:34,874 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2025-02-20T04:07:34,876 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2025-02-20T04:07:34,877 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2025-02-20T04:07:34,879 adding 'colossalai/legacy/nn/__init__.py' 2025-02-20T04:07:34,881 adding 'colossalai/legacy/nn/_ops/__init__.py' 2025-02-20T04:07:34,883 adding 'colossalai/legacy/nn/_ops/_utils.py' 2025-02-20T04:07:34,885 adding 'colossalai/legacy/nn/layer/__init__.py' 2025-02-20T04:07:34,887 adding 'colossalai/legacy/nn/layer/base_layer.py' 2025-02-20T04:07:34,889 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2025-02-20T04:07:34,890 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2025-02-20T04:07:34,891 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2025-02-20T04:07:34,893 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2025-02-20T04:07:34,895 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2025-02-20T04:07:34,896 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2025-02-20T04:07:34,898 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2025-02-20T04:07:34,900 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2025-02-20T04:07:34,902 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2025-02-20T04:07:34,906 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2025-02-20T04:07:34,908 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2025-02-20T04:07:34,911 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2025-02-20T04:07:34,913 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2025-02-20T04:07:34,916 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2025-02-20T04:07:34,919 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2025-02-20T04:07:34,922 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2025-02-20T04:07:34,924 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2025-02-20T04:07:34,928 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2025-02-20T04:07:34,930 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2025-02-20T04:07:34,932 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2025-02-20T04:07:34,933 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2025-02-20T04:07:34,937 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2025-02-20T04:07:34,939 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2025-02-20T04:07:34,940 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2025-02-20T04:07:34,941 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2025-02-20T04:07:34,943 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2025-02-20T04:07:34,944 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2025-02-20T04:07:34,946 adding 'colossalai/legacy/nn/layer/utils/common.py' 2025-02-20T04:07:34,947 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2025-02-20T04:07:34,949 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2025-02-20T04:07:34,951 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2025-02-20T04:07:34,952 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2025-02-20T04:07:34,954 adding 'colossalai/legacy/nn/loss/__init__.py' 2025-02-20T04:07:34,956 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2025-02-20T04:07:34,957 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2025-02-20T04:07:34,959 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2025-02-20T04:07:34,960 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2025-02-20T04:07:34,962 adding 'colossalai/legacy/nn/metric/__init__.py' 2025-02-20T04:07:34,963 adding 'colossalai/legacy/nn/metric/_utils.py' 2025-02-20T04:07:34,964 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2025-02-20T04:07:34,965 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2025-02-20T04:07:34,967 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2025-02-20T04:07:34,968 adding 'colossalai/legacy/nn/parallel/__init__.py' 2025-02-20T04:07:34,970 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2025-02-20T04:07:34,971 adding 'colossalai/legacy/nn/parallel/reducer.py' 2025-02-20T04:07:34,973 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2025-02-20T04:07:34,974 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2025-02-20T04:07:34,976 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2025-02-20T04:07:34,977 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2025-02-20T04:07:34,978 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2025-02-20T04:07:34,980 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2025-02-20T04:07:34,981 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2025-02-20T04:07:34,985 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2025-02-20T04:07:34,986 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2025-02-20T04:07:34,988 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2025-02-20T04:07:34,989 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2025-02-20T04:07:34,990 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2025-02-20T04:07:34,992 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2025-02-20T04:07:34,994 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2025-02-20T04:07:34,995 adding 'colossalai/legacy/pipeline/__init__.py' 2025-02-20T04:07:34,997 adding 'colossalai/legacy/pipeline/layer_spec.py' 2025-02-20T04:07:34,998 adding 'colossalai/legacy/pipeline/pipelinable.py' 2025-02-20T04:07:35,000 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2025-02-20T04:07:35,002 adding 'colossalai/legacy/pipeline/utils.py' 2025-02-20T04:07:35,003 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2025-02-20T04:07:35,005 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2025-02-20T04:07:35,006 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2025-02-20T04:07:35,008 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2025-02-20T04:07:35,010 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2025-02-20T04:07:35,016 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2025-02-20T04:07:35,018 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2025-02-20T04:07:35,020 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2025-02-20T04:07:35,022 adding 'colossalai/legacy/registry/__init__.py' 2025-02-20T04:07:35,023 adding 'colossalai/legacy/registry/registry.py' 2025-02-20T04:07:35,024 adding 'colossalai/legacy/tensor/__init__.py' 2025-02-20T04:07:35,026 adding 'colossalai/legacy/tensor/compute_spec.py' 2025-02-20T04:07:35,027 adding 'colossalai/legacy/tensor/const.py' 2025-02-20T04:07:35,028 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2025-02-20T04:07:35,030 adding 'colossalai/legacy/tensor/distspec.py' 2025-02-20T04:07:35,031 adding 'colossalai/legacy/tensor/op_wrapper.py' 2025-02-20T04:07:35,033 adding 'colossalai/legacy/tensor/process_group.py' 2025-02-20T04:07:35,034 adding 'colossalai/legacy/tensor/tensor_spec.py' 2025-02-20T04:07:35,035 adding 'colossalai/legacy/trainer/__init__.py' 2025-02-20T04:07:35,038 adding 'colossalai/legacy/trainer/_trainer.py' 2025-02-20T04:07:35,039 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2025-02-20T04:07:35,041 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2025-02-20T04:07:35,042 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2025-02-20T04:07:35,043 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2025-02-20T04:07:35,045 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2025-02-20T04:07:35,046 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2025-02-20T04:07:35,048 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2025-02-20T04:07:35,050 adding 'colossalai/legacy/utils/__init__.py' 2025-02-20T04:07:35,052 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2025-02-20T04:07:35,054 adding 'colossalai/legacy/utils/checkpointing.py' 2025-02-20T04:07:35,056 adding 'colossalai/legacy/utils/common.py' 2025-02-20T04:07:35,058 adding 'colossalai/legacy/utils/memory.py' 2025-02-20T04:07:35,060 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2025-02-20T04:07:35,061 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2025-02-20T04:07:35,063 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2025-02-20T04:07:35,065 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2025-02-20T04:07:35,066 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2025-02-20T04:07:35,068 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2025-02-20T04:07:35,070 adding 'colossalai/legacy/utils/profiler/__init__.py' 2025-02-20T04:07:35,071 adding 'colossalai/legacy/utils/profiler/extention.py' 2025-02-20T04:07:35,073 adding 'colossalai/legacy/utils/profiler/profiler.py' 2025-02-20T04:07:35,074 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2025-02-20T04:07:35,076 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2025-02-20T04:07:35,078 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2025-02-20T04:07:35,079 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2025-02-20T04:07:35,080 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2025-02-20T04:07:35,082 adding 'colossalai/legacy/zero/__init__.py' 2025-02-20T04:07:35,084 adding 'colossalai/legacy/zero/gemini/__init__.py' 2025-02-20T04:07:35,086 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2025-02-20T04:07:35,087 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2025-02-20T04:07:35,088 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2025-02-20T04:07:35,089 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2025-02-20T04:07:35,091 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2025-02-20T04:07:35,092 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2025-02-20T04:07:35,094 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2025-02-20T04:07:35,095 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2025-02-20T04:07:35,096 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2025-02-20T04:07:35,098 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2025-02-20T04:07:35,099 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2025-02-20T04:07:35,101 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2025-02-20T04:07:35,102 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2025-02-20T04:07:35,103 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2025-02-20T04:07:35,105 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2025-02-20T04:07:35,107 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2025-02-20T04:07:35,108 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2025-02-20T04:07:35,110 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2025-02-20T04:07:35,111 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2025-02-20T04:07:35,112 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2025-02-20T04:07:35,114 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2025-02-20T04:07:35,115 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2025-02-20T04:07:35,117 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2025-02-20T04:07:35,120 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2025-02-20T04:07:35,122 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2025-02-20T04:07:35,123 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2025-02-20T04:07:35,125 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2025-02-20T04:07:35,127 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2025-02-20T04:07:35,129 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2025-02-20T04:07:35,130 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2025-02-20T04:07:35,132 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2025-02-20T04:07:35,134 adding 'colossalai/logging/__init__.py' 2025-02-20T04:07:35,135 adding 'colossalai/logging/logger.py' 2025-02-20T04:07:35,137 adding 'colossalai/moe/__init__.py' 2025-02-20T04:07:35,139 adding 'colossalai/moe/_operation.py' 2025-02-20T04:07:35,141 adding 'colossalai/nn/__init__.py' 2025-02-20T04:07:35,142 adding 'colossalai/nn/init.py' 2025-02-20T04:07:35,144 adding 'colossalai/nn/layer/__init__.py' 2025-02-20T04:07:35,145 adding 'colossalai/nn/layer/layernorm.py' 2025-02-20T04:07:35,147 adding 'colossalai/nn/layer/scaled_softmax.py' 2025-02-20T04:07:35,148 adding 'colossalai/nn/layer/utils.py' 2025-02-20T04:07:35,150 adding 'colossalai/nn/loss/__init__.py' 2025-02-20T04:07:35,152 adding 'colossalai/nn/lr_scheduler/__init__.py' 2025-02-20T04:07:35,154 adding 'colossalai/nn/lr_scheduler/cosine.py' 2025-02-20T04:07:35,155 adding 'colossalai/nn/lr_scheduler/delayed.py' 2025-02-20T04:07:35,156 adding 'colossalai/nn/lr_scheduler/linear.py' 2025-02-20T04:07:35,157 adding 'colossalai/nn/lr_scheduler/multistep.py' 2025-02-20T04:07:35,159 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2025-02-20T04:07:35,160 adding 'colossalai/nn/lr_scheduler/poly.py' 2025-02-20T04:07:35,161 adding 'colossalai/nn/lr_scheduler/torch.py' 2025-02-20T04:07:35,163 adding 'colossalai/nn/optimizer/__init__.py' 2025-02-20T04:07:35,165 adding 'colossalai/nn/optimizer/adafactor.py' 2025-02-20T04:07:35,166 adding 'colossalai/nn/optimizer/came.py' 2025-02-20T04:07:35,168 adding 'colossalai/nn/optimizer/cpu_adam.py' 2025-02-20T04:07:35,171 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2025-02-20T04:07:35,173 adding 'colossalai/nn/optimizer/distributed_came.py' 2025-02-20T04:07:35,175 adding 'colossalai/nn/optimizer/distributed_galore.py' 2025-02-20T04:07:35,177 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2025-02-20T04:07:35,179 adding 'colossalai/nn/optimizer/fused_adam.py' 2025-02-20T04:07:35,182 adding 'colossalai/nn/optimizer/fused_lamb.py' 2025-02-20T04:07:35,184 adding 'colossalai/nn/optimizer/fused_sgd.py' 2025-02-20T04:07:35,186 adding 'colossalai/nn/optimizer/galore.py' 2025-02-20T04:07:35,188 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2025-02-20T04:07:35,190 adding 'colossalai/nn/optimizer/lamb.py' 2025-02-20T04:07:35,191 adding 'colossalai/nn/optimizer/lars.py' 2025-02-20T04:07:35,193 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2025-02-20T04:07:35,194 adding 'colossalai/pipeline/__init__.py' 2025-02-20T04:07:35,198 adding 'colossalai/pipeline/p2p.py' 2025-02-20T04:07:35,199 adding 'colossalai/pipeline/stage_manager.py' 2025-02-20T04:07:35,201 adding 'colossalai/pipeline/weight_grad_store.py' 2025-02-20T04:07:35,202 adding 'colossalai/pipeline/schedule/__init__.py' 2025-02-20T04:07:35,204 adding 'colossalai/pipeline/schedule/_utils.py' 2025-02-20T04:07:35,205 adding 'colossalai/pipeline/schedule/base.py' 2025-02-20T04:07:35,207 adding 'colossalai/pipeline/schedule/generate.py' 2025-02-20T04:07:35,210 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2025-02-20T04:07:35,213 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2025-02-20T04:07:35,215 adding 'colossalai/pipeline/schedule/v_schedule.py' 2025-02-20T04:07:35,220 adding 'colossalai/pipeline/schedule/zero_bubble_pp.py' 2025-02-20T04:07:35,222 adding 'colossalai/quantization/__init__.py' 2025-02-20T04:07:35,224 adding 'colossalai/quantization/bnb.py' 2025-02-20T04:07:35,225 adding 'colossalai/quantization/bnb_config.py' 2025-02-20T04:07:35,229 adding 'colossalai/quantization/fp8.py' 2025-02-20T04:07:35,230 adding 'colossalai/quantization/fp8_config.py' 2025-02-20T04:07:35,231 adding 'colossalai/quantization/fp8_hook.py' 2025-02-20T04:07:35,233 adding 'colossalai/quantization/utils.py' 2025-02-20T04:07:35,235 adding 'colossalai/shardformer/__init__.py' 2025-02-20T04:07:35,236 adding 'colossalai/shardformer/_utils.py' 2025-02-20T04:07:35,238 adding 'colossalai/shardformer/layer/__init__.py' 2025-02-20T04:07:35,242 adding 'colossalai/shardformer/layer/_operation.py' 2025-02-20T04:07:35,248 adding 'colossalai/shardformer/layer/attn.py' 2025-02-20T04:07:35,249 adding 'colossalai/shardformer/layer/dropout.py' 2025-02-20T04:07:35,251 adding 'colossalai/shardformer/layer/embedding.py' 2025-02-20T04:07:35,254 adding 'colossalai/shardformer/layer/linear.py' 2025-02-20T04:07:35,256 adding 'colossalai/shardformer/layer/loss.py' 2025-02-20T04:07:35,258 adding 'colossalai/shardformer/layer/normalization.py' 2025-02-20T04:07:35,260 adding 'colossalai/shardformer/layer/parallel_module.py' 2025-02-20T04:07:35,264 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2025-02-20T04:07:35,267 adding 'colossalai/shardformer/layer/utils.py' 2025-02-20T04:07:35,268 adding 'colossalai/shardformer/modeling/__init__.py' 2025-02-20T04:07:35,273 adding 'colossalai/shardformer/modeling/bert.py' 2025-02-20T04:07:35,274 adding 'colossalai/shardformer/modeling/blip2.py' 2025-02-20T04:07:35,279 adding 'colossalai/shardformer/modeling/bloom.py' 2025-02-20T04:07:35,281 adding 'colossalai/shardformer/modeling/chatglm2.py' 2025-02-20T04:07:35,284 adding 'colossalai/shardformer/modeling/command.py' 2025-02-20T04:07:35,288 adding 'colossalai/shardformer/modeling/deepseek.py' 2025-02-20T04:07:35,291 adding 'colossalai/shardformer/modeling/deepseek_v3.py' 2025-02-20T04:07:35,294 adding 'colossalai/shardformer/modeling/falcon.py' 2025-02-20T04:07:35,298 adding 'colossalai/shardformer/modeling/gpt2.py' 2025-02-20T04:07:35,301 adding 'colossalai/shardformer/modeling/gptj.py' 2025-02-20T04:07:35,303 adding 'colossalai/shardformer/modeling/jit.py' 2025-02-20T04:07:35,306 adding 'colossalai/shardformer/modeling/llama.py' 2025-02-20T04:07:35,308 adding 'colossalai/shardformer/modeling/mistral.py' 2025-02-20T04:07:35,312 adding 'colossalai/shardformer/modeling/mixtral.py' 2025-02-20T04:07:35,316 adding 'colossalai/shardformer/modeling/opt.py' 2025-02-20T04:07:35,320 adding 'colossalai/shardformer/modeling/qwen2.py' 2025-02-20T04:07:35,321 adding 'colossalai/shardformer/modeling/sam.py' 2025-02-20T04:07:35,325 adding 'colossalai/shardformer/modeling/t5.py' 2025-02-20T04:07:35,327 adding 'colossalai/shardformer/modeling/vit.py' 2025-02-20T04:07:35,332 adding 'colossalai/shardformer/modeling/whisper.py' 2025-02-20T04:07:35,334 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2025-02-20T04:07:35,335 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2025-02-20T04:07:35,341 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2025-02-20T04:07:35,343 adding 'colossalai/shardformer/policies/__init__.py' 2025-02-20T04:07:35,344 adding 'colossalai/shardformer/policies/auto_policy.py' 2025-02-20T04:07:35,346 adding 'colossalai/shardformer/policies/base_policy.py' 2025-02-20T04:07:35,349 adding 'colossalai/shardformer/policies/bert.py' 2025-02-20T04:07:35,351 adding 'colossalai/shardformer/policies/blip2.py' 2025-02-20T04:07:35,353 adding 'colossalai/shardformer/policies/bloom.py' 2025-02-20T04:07:35,355 adding 'colossalai/shardformer/policies/chatglm2.py' 2025-02-20T04:07:35,357 adding 'colossalai/shardformer/policies/command.py' 2025-02-20T04:07:35,359 adding 'colossalai/shardformer/policies/deepseek.py' 2025-02-20T04:07:35,361 adding 'colossalai/shardformer/policies/deepseek_v3.py' 2025-02-20T04:07:35,363 adding 'colossalai/shardformer/policies/falcon.py' 2025-02-20T04:07:35,365 adding 'colossalai/shardformer/policies/gpt2.py' 2025-02-20T04:07:35,367 adding 'colossalai/shardformer/policies/gptj.py' 2025-02-20T04:07:35,370 adding 'colossalai/shardformer/policies/llama.py' 2025-02-20T04:07:35,372 adding 'colossalai/shardformer/policies/mistral.py' 2025-02-20T04:07:35,375 adding 'colossalai/shardformer/policies/mixtral.py' 2025-02-20T04:07:35,377 adding 'colossalai/shardformer/policies/opt.py' 2025-02-20T04:07:35,379 adding 'colossalai/shardformer/policies/qwen2.py' 2025-02-20T04:07:35,381 adding 'colossalai/shardformer/policies/sam.py' 2025-02-20T04:07:35,384 adding 'colossalai/shardformer/policies/t5.py' 2025-02-20T04:07:35,386 adding 'colossalai/shardformer/policies/vit.py' 2025-02-20T04:07:35,389 adding 'colossalai/shardformer/policies/whisper.py' 2025-02-20T04:07:35,391 adding 'colossalai/shardformer/shard/__init__.py' 2025-02-20T04:07:35,393 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2025-02-20T04:07:35,394 adding 'colossalai/shardformer/shard/shard_config.py' 2025-02-20T04:07:35,396 adding 'colossalai/shardformer/shard/sharder.py' 2025-02-20T04:07:35,397 adding 'colossalai/shardformer/shard/shardformer.py' 2025-02-20T04:07:35,398 adding 'colossalai/shardformer/shard/utils.py' 2025-02-20T04:07:35,400 adding 'colossalai/tensor/__init__.py' 2025-02-20T04:07:35,402 adding 'colossalai/tensor/colo_parameter.py' 2025-02-20T04:07:35,403 adding 'colossalai/tensor/colo_tensor.py' 2025-02-20T04:07:35,405 adding 'colossalai/tensor/comm_spec.py' 2025-02-20T04:07:35,407 adding 'colossalai/tensor/param_op_hook.py' 2025-02-20T04:07:35,410 adding 'colossalai/tensor/shape_consistency.py' 2025-02-20T04:07:35,413 adding 'colossalai/tensor/sharding_spec.py' 2025-02-20T04:07:35,414 adding 'colossalai/tensor/utils.py' 2025-02-20T04:07:35,416 adding 'colossalai/tensor/d_tensor/__init__.py' 2025-02-20T04:07:35,418 adding 'colossalai/tensor/d_tensor/api.py' 2025-02-20T04:07:35,420 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2025-02-20T04:07:35,421 adding 'colossalai/tensor/d_tensor/layout.py' 2025-02-20T04:07:35,424 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2025-02-20T04:07:35,426 adding 'colossalai/tensor/d_tensor/misc.py' 2025-02-20T04:07:35,427 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2025-02-20T04:07:35,429 adding 'colossalai/tensor/d_tensor/utils.py' 2025-02-20T04:07:35,430 adding 'colossalai/tensor/moe_tensor/__init__.py' 2025-02-20T04:07:35,431 adding 'colossalai/tensor/moe_tensor/api.py' 2025-02-20T04:07:35,433 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2025-02-20T04:07:35,434 adding 'colossalai/tensor/padded_tensor/__init__.py' 2025-02-20T04:07:35,435 adding 'colossalai/tensor/padded_tensor/api.py' 2025-02-20T04:07:35,438 adding 'colossalai/testing/__init__.py' 2025-02-20T04:07:35,439 adding 'colossalai/testing/comparison.py' 2025-02-20T04:07:35,440 adding 'colossalai/testing/pytest_wrapper.py' 2025-02-20T04:07:35,441 adding 'colossalai/testing/random.py' 2025-02-20T04:07:35,443 adding 'colossalai/testing/utils.py' 2025-02-20T04:07:35,445 adding 'colossalai/utils/__init__.py' 2025-02-20T04:07:35,446 adding 'colossalai/utils/common.py' 2025-02-20T04:07:35,447 adding 'colossalai/utils/memory.py' 2025-02-20T04:07:35,449 adding 'colossalai/utils/safetensors.py' 2025-02-20T04:07:35,450 adding 'colossalai/utils/timer.py' 2025-02-20T04:07:35,452 adding 'colossalai/utils/model/__init__.py' 2025-02-20T04:07:35,453 adding 'colossalai/utils/model/utils.py' 2025-02-20T04:07:35,455 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2025-02-20T04:07:35,456 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2025-02-20T04:07:35,458 adding 'colossalai/utils/rank_recorder/__init__.py' 2025-02-20T04:07:35,459 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2025-02-20T04:07:35,461 adding 'colossalai/utils/tensor_detector/__init__.py' 2025-02-20T04:07:35,463 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2025-02-20T04:07:35,464 adding 'colossalai/zero/__init__.py' 2025-02-20T04:07:35,466 adding 'colossalai/zero/wrapper.py' 2025-02-20T04:07:35,468 adding 'colossalai/zero/gemini/__init__.py' 2025-02-20T04:07:35,473 adding 'colossalai/zero/gemini/gemini_ddp.py' 2025-02-20T04:07:35,474 adding 'colossalai/zero/gemini/gemini_hook.py' 2025-02-20T04:07:35,476 adding 'colossalai/zero/gemini/gemini_mgr.py' 2025-02-20T04:07:35,481 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2025-02-20T04:07:35,482 adding 'colossalai/zero/gemini/placement_policy.py' 2025-02-20T04:07:35,484 adding 'colossalai/zero/gemini/utils.py' 2025-02-20T04:07:35,486 adding 'colossalai/zero/gemini/chunk/__init__.py' 2025-02-20T04:07:35,490 adding 'colossalai/zero/gemini/chunk/chunk.py' 2025-02-20T04:07:35,492 adding 'colossalai/zero/gemini/chunk/manager.py' 2025-02-20T04:07:35,494 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2025-02-20T04:07:35,495 adding 'colossalai/zero/gemini/chunk/utils.py' 2025-02-20T04:07:35,497 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2025-02-20T04:07:35,498 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2025-02-20T04:07:35,500 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2025-02-20T04:07:35,501 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2025-02-20T04:07:35,503 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2025-02-20T04:07:35,504 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2025-02-20T04:07:35,505 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2025-02-20T04:07:35,507 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2025-02-20T04:07:35,508 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2025-02-20T04:07:35,510 adding 'colossalai/zero/low_level/__init__.py' 2025-02-20T04:07:35,511 adding 'colossalai/zero/low_level/_utils.py' 2025-02-20T04:07:35,516 adding 'colossalai/zero/low_level/low_level_optim.py' 2025-02-20T04:07:35,518 adding 'colossalai/zero/low_level/zero_hook.py' 2025-02-20T04:07:35,519 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2025-02-20T04:07:35,520 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2025-02-20T04:07:35,522 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2025-02-20T04:07:35,527 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2025-02-20T04:07:35,529 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2025-02-20T04:07:35,531 adding 'extensions/csrc/__init__.py' 2025-02-20T04:07:35,533 adding 'extensions/pybind/__init__.py' 2025-02-20T04:07:35,535 adding 'extensions/pybind/cpu_adam/__init__.py' 2025-02-20T04:07:35,536 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2025-02-20T04:07:35,537 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2025-02-20T04:07:35,539 adding 'extensions/pybind/flash_attention/__init__.py' 2025-02-20T04:07:35,540 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2025-02-20T04:07:35,541 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2025-02-20T04:07:35,543 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2025-02-20T04:07:35,544 adding 'extensions/pybind/inference/__init__.py' 2025-02-20T04:07:35,545 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2025-02-20T04:07:35,547 adding 'extensions/pybind/layernorm/__init__.py' 2025-02-20T04:07:35,548 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2025-02-20T04:07:35,550 adding 'extensions/pybind/moe/__init__.py' 2025-02-20T04:07:35,551 adding 'extensions/pybind/moe/moe_cuda.py' 2025-02-20T04:07:35,553 adding 'extensions/pybind/optimizer/__init__.py' 2025-02-20T04:07:35,554 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2025-02-20T04:07:35,556 adding 'extensions/pybind/softmax/__init__.py' 2025-02-20T04:07:35,557 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2025-02-20T04:07:35,558 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2025-02-20T04:07:35,561 adding 'colossalai-0.4.8.dist-info/LICENSE' 2025-02-20T04:07:35,565 adding 'colossalai-0.4.8.dist-info/METADATA' 2025-02-20T04:07:35,566 adding 'colossalai-0.4.8.dist-info/WHEEL' 2025-02-20T04:07:35,567 adding 'colossalai-0.4.8.dist-info/entry_points.txt' 2025-02-20T04:07:35,568 adding 'colossalai-0.4.8.dist-info/top_level.txt' 2025-02-20T04:07:35,583 adding 'colossalai-0.4.8.dist-info/RECORD' 2025-02-20T04:07:35,613 removing build/bdist.linux-armv7l/wheel 2025-02-20T04:07:35,991 Building wheel for colossalai (setup.py): finished with status 'done' 2025-02-20T04:07:36,010 Created wheel for colossalai: filename=colossalai-0.4.8-py3-none-any.whl size=1623000 sha256=6d7c2647635a1f730bc800fa155d205d6b32b3bf67cf251567751416a518d537 2025-02-20T04:07:36,011 Stored in directory: /tmp/pip-ephem-wheel-cache-8w9dvw66/wheels/f3/d4/c4/758129452376a52e6ca1eb6cb5edf519cb6f70baff5aa4dba2 2025-02-20T04:07:36,054 Successfully built colossalai 2025-02-20T04:07:36,095 Removed build tracker: '/tmp/pip-build-tracker-1fyfmdge'