2024-10-21T04:17:15,223 Disabling truststore because Python version isn't 3.10+ 2024-10-21T04:17:15,718 Created temporary directory: /tmp/pip-build-tracker-av_v366p 2024-10-21T04:17:15,719 Initialized build tracking at /tmp/pip-build-tracker-av_v366p 2024-10-21T04:17:15,719 Created build tracker: /tmp/pip-build-tracker-av_v366p 2024-10-21T04:17:15,720 Entered build tracker: /tmp/pip-build-tracker-av_v366p 2024-10-21T04:17:15,720 Created temporary directory: /tmp/pip-wheel-9w1fv7fj 2024-10-21T04:17:15,726 Created temporary directory: /tmp/pip-ephem-wheel-cache-7mjpdsss 2024-10-21T04:17:15,771 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-10-21T04:17:15,773 2 location(s) to search for versions of colossalai: 2024-10-21T04:17:15,773 * https://pypi.org/simple/colossalai/ 2024-10-21T04:17:15,773 * https://www.piwheels.org/simple/colossalai/ 2024-10-21T04:17:15,774 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-10-21T04:17:15,774 Getting page https://pypi.org/simple/colossalai/ 2024-10-21T04:17:15,776 Found index url https://pypi.org/simple/ 2024-10-21T04:17:15,796 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-10-21T04:17:15,802 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-10-21T04:17:15,802 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-10-21T04:17:15,803 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-10-21T04:17:15,803 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-10-21T04:17:15,804 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-10-21T04:17:15,805 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-10-21T04:17:15,805 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-10-21T04:17:15,806 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-10-21T04:17:15,806 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-10-21T04:17:15,807 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-10-21T04:17:15,807 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-10-21T04:17:15,808 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-10-21T04:17:15,808 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-10-21T04:17:15,809 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-10-21T04:17:15,809 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-10-21T04:17:15,810 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-10-21T04:17:15,811 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-10-21T04:17:15,811 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-10-21T04:17:15,812 Found link https://files.pythonhosted.org/packages/05/4a/cb00a8875cd2469adab4beb93706af50ba39da68066fa41d9f29045fee61/colossalai-0.3.9.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.9 2024-10-21T04:17:15,812 Found link https://files.pythonhosted.org/packages/3a/b1/7026ed4cb7536b1ab401d918d19437baec433e962cce2fa96f4f8fe485dd/colossalai-0.4.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.0 2024-10-21T04:17:15,813 Found link https://files.pythonhosted.org/packages/3c/cd/206593b5c417a436382ca5e93c0188c031830341ee352c35e020ce83f57c/colossalai-0.4.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.1 2024-10-21T04:17:15,813 Found link https://files.pythonhosted.org/packages/0d/98/7adbf8fd663234fee2ea43382b065979c22612f319c322aa0eb675457327/colossalai-0.4.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.2 2024-10-21T04:17:15,814 Found link https://files.pythonhosted.org/packages/96/bd/716f9dbdee5a564da03d55d3d9e65b85c952cb62ed12519a8566adf63005/colossalai-0.4.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.3 2024-10-21T04:17:15,814 Found link https://files.pythonhosted.org/packages/93/17/64f0e6b72626bb060b6951461ffc62e5f34ce3efed2f4e2214fa2967d313/colossalai-0.4.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.4 2024-10-21T04:17:15,815 Found link https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.4.5 2024-10-21T04:17:15,815 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-10-21T04:17:15,816 Getting page https://www.piwheels.org/simple/colossalai/ 2024-10-21T04:17:15,817 Found index url https://www.piwheels.org/simple/ 2024-10-21T04:17:15,868 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-10-21T04:17:15,876 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.4-py3-none-any.whl#sha256=7d8fd2b8d24966631e13d0535ee83e0c38e2e190292b5e5902dec15673818a6d (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,876 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.3-py3-none-any.whl#sha256=115c0c1bbbe23afda2be79a19e1dab17148c834545824e974d5653b545a9e604 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,877 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.2-py3-none-any.whl#sha256=37c71db35629462ee7107007adb59e8a480ef50ec550a31198b6fe08fb8acc84 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,877 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.1-py3-none-any.whl#sha256=5355444b4f627d0b5516a1053a0b99c3eb130a9bdde95abefa4dcd7a881b0119 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,877 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.4.0-py3-none-any.whl#sha256=bca14360afc924008f910785cbb07e07f1f743e3a7182103caa09a4d6c49d3a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,877 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.9-py3-none-any.whl#sha256=670e4e0d607a0803e8f0a7349996228f4cfa411d817bd631c07b1b2064e7af48 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,877 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.8-py3-none-any.whl#sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,878 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,878 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,878 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,878 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,878 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,879 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,879 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,879 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,879 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,879 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,880 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,880 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,880 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,880 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,880 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,881 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,881 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-10-21T04:17:15,881 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-10-21T04:17:15,881 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-10-21T04:17:15,900 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-10-21T04:17:15,902 Collecting colossalai==0.4.5 2024-10-21T04:17:15,904 Created temporary directory: /tmp/pip-unpack-2nfd0rxn 2024-10-21T04:17:15,920 Downloading colossalai-0.4.5.tar.gz (1.3 MB) 2024-10-21T04:17:18,455 Added colossalai==0.4.5 from https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz to build tracker '/tmp/pip-build-tracker-av_v366p' 2024-10-21T04:17:18,458 Running setup.py (path:/tmp/pip-wheel-9w1fv7fj/colossalai_9c1645a4133a4ba9a1866e49055a1ccb/setup.py) egg_info for package colossalai 2024-10-21T04:17:18,458 Created temporary directory: /tmp/pip-pip-egg-info-wpxflaeu 2024-10-21T04:17:18,459 Preparing metadata (setup.py): started 2024-10-21T04:17:18,460 Running command python setup.py egg_info 2024-10-21T04:17:19,738 running egg_info 2024-10-21T04:17:19,740 creating /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info 2024-10-21T04:17:19,768 writing /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/PKG-INFO 2024-10-21T04:17:19,774 writing dependency_links to /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/dependency_links.txt 2024-10-21T04:17:19,775 writing entry points to /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/entry_points.txt 2024-10-21T04:17:19,777 writing requirements to /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/requires.txt 2024-10-21T04:17:19,779 writing top-level names to /tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/top_level.txt 2024-10-21T04:17:19,781 writing manifest file '/tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/SOURCES.txt' 2024-10-21T04:17:20,109 reading manifest file '/tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/SOURCES.txt' 2024-10-21T04:17:20,110 reading manifest template 'MANIFEST.in' 2024-10-21T04:17:21,470 warning: no files found matching '*.tr' under directory 'colossalai' 2024-10-21T04:17:22,110 warning: no files found matching '*.cc' under directory 'colossalai' 2024-10-21T04:17:22,452 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-10-21T04:17:22,592 warning: no files found matching '*.tr' under directory 'extensions' 2024-10-21T04:17:22,646 warning: no files found matching '*.cc' under directory 'extensions' 2024-10-21T04:17:22,673 warning: no files found matching '*.pyi' under directory 'extensions' 2024-10-21T04:17:22,673 adding license file 'LICENSE' 2024-10-21T04:17:22,716 writing manifest file '/tmp/pip-pip-egg-info-wpxflaeu/colossalai.egg-info/SOURCES.txt' 2024-10-21T04:17:22,805 Preparing metadata (setup.py): finished with status 'done' 2024-10-21T04:17:22,813 Source in /tmp/pip-wheel-9w1fv7fj/colossalai_9c1645a4133a4ba9a1866e49055a1ccb has version 0.4.5, which satisfies requirement colossalai==0.4.5 from https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz 2024-10-21T04:17:22,814 Removed colossalai==0.4.5 from https://files.pythonhosted.org/packages/cb/59/6a454c672176686c5932d4de99a457374d852427601f98751b3c96594fa3/colossalai-0.4.5.tar.gz from build tracker '/tmp/pip-build-tracker-av_v366p' 2024-10-21T04:17:22,831 Created temporary directory: /tmp/pip-unpack-93ik5_mc 2024-10-21T04:17:22,832 Created temporary directory: /tmp/pip-unpack-y21fo7by 2024-10-21T04:17:22,832 Building wheels for collected packages: colossalai 2024-10-21T04:17:22,837 Created temporary directory: /tmp/pip-wheel-wc2x3vkk 2024-10-21T04:17:22,837 Building wheel for colossalai (setup.py): started 2024-10-21T04:17:22,838 Destination directory: /tmp/pip-wheel-wc2x3vkk 2024-10-21T04:17:22,838 Running command python setup.py bdist_wheel 2024-10-21T04:17:23,822 running bdist_wheel 2024-10-21T04:17:23,961 running build 2024-10-21T04:17:23,962 running build_py 2024-10-21T04:17:23,992 creating build 2024-10-21T04:17:23,993 creating build/lib 2024-10-21T04:17:23,994 creating build/lib/colossalai 2024-10-21T04:17:23,995 copying colossalai/initialize.py -> build/lib/colossalai 2024-10-21T04:17:23,998 copying colossalai/version.py -> build/lib/colossalai 2024-10-21T04:17:24,000 copying colossalai/__init__.py -> build/lib/colossalai 2024-10-21T04:17:24,002 creating build/lib/extensions 2024-10-21T04:17:24,003 creating build/lib/extensions/csrc 2024-10-21T04:17:24,004 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-10-21T04:17:24,006 creating build/lib/extensions/pybind 2024-10-21T04:17:24,008 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-10-21T04:17:24,010 creating build/lib/extensions/pybind/softmax 2024-10-21T04:17:24,011 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-10-21T04:17:24,013 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-10-21T04:17:24,015 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-10-21T04:17:24,018 creating build/lib/extensions/pybind/layernorm 2024-10-21T04:17:24,020 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-10-21T04:17:24,022 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-10-21T04:17:24,025 creating build/lib/extensions/pybind/optimizer 2024-10-21T04:17:24,026 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-10-21T04:17:24,028 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-10-21T04:17:24,031 creating build/lib/extensions/pybind/cpu_adam 2024-10-21T04:17:24,032 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-10-21T04:17:24,034 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-10-21T04:17:24,037 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-10-21T04:17:24,039 creating build/lib/extensions/pybind/inference 2024-10-21T04:17:24,040 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-10-21T04:17:24,042 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-10-21T04:17:24,045 creating build/lib/extensions/pybind/moe 2024-10-21T04:17:24,046 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-10-21T04:17:24,048 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-10-21T04:17:24,051 creating build/lib/extensions/pybind/flash_attention 2024-10-21T04:17:24,052 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-10-21T04:17:24,054 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-10-21T04:17:24,056 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-10-21T04:17:24,059 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-10-21T04:17:24,061 creating build/lib/colossalai/zero 2024-10-21T04:17:24,063 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-10-21T04:17:24,066 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-10-21T04:17:24,068 creating build/lib/colossalai/_C 2024-10-21T04:17:24,069 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-10-21T04:17:24,072 creating build/lib/colossalai/shardformer 2024-10-21T04:17:24,073 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-10-21T04:17:24,075 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-10-21T04:17:24,077 creating build/lib/colossalai/nn 2024-10-21T04:17:24,078 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-10-21T04:17:24,081 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-10-21T04:17:24,084 creating build/lib/colossalai/kernel 2024-10-21T04:17:24,085 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-10-21T04:17:24,086 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-10-21T04:17:24,088 creating build/lib/colossalai/utils 2024-10-21T04:17:24,089 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-10-21T04:17:24,091 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-10-21T04:17:24,093 copying colossalai/utils/safetensors.py -> build/lib/colossalai/utils 2024-10-21T04:17:24,095 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-10-21T04:17:24,096 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-10-21T04:17:24,099 creating build/lib/colossalai/pipeline 2024-10-21T04:17:24,100 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-10-21T04:17:24,103 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-10-21T04:17:24,105 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-10-21T04:17:24,107 creating build/lib/colossalai/context 2024-10-21T04:17:24,108 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-10-21T04:17:24,110 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-10-21T04:17:24,112 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-10-21T04:17:24,114 creating build/lib/colossalai/device 2024-10-21T04:17:24,115 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-10-21T04:17:24,118 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-10-21T04:17:24,120 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-10-21T04:17:24,121 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-10-21T04:17:24,124 creating build/lib/colossalai/auto_parallel 2024-10-21T04:17:24,125 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-10-21T04:17:24,127 creating build/lib/colossalai/_analyzer 2024-10-21T04:17:24,128 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-10-21T04:17:24,129 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-10-21T04:17:24,132 creating build/lib/colossalai/tensor 2024-10-21T04:17:24,133 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,135 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,136 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,138 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,141 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,143 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,146 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,148 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-10-21T04:17:24,151 creating build/lib/colossalai/legacy 2024-10-21T04:17:24,152 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-10-21T04:17:24,154 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-10-21T04:17:24,156 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-10-21T04:17:24,157 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-10-21T04:17:24,159 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-10-21T04:17:24,161 creating build/lib/colossalai/booster 2024-10-21T04:17:24,162 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-10-21T04:17:24,164 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-10-21T04:17:24,166 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-10-21T04:17:24,168 creating build/lib/colossalai/logging 2024-10-21T04:17:24,169 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-10-21T04:17:24,171 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-10-21T04:17:24,174 creating build/lib/colossalai/cluster 2024-10-21T04:17:24,174 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-10-21T04:17:24,176 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-10-21T04:17:24,178 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-10-21T04:17:24,180 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-10-21T04:17:24,183 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-10-21T04:17:24,185 creating build/lib/colossalai/fx 2024-10-21T04:17:24,186 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,189 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,190 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,192 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,194 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,196 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-10-21T04:17:24,198 creating build/lib/colossalai/cli 2024-10-21T04:17:24,199 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-10-21T04:17:24,201 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-10-21T04:17:24,203 creating build/lib/colossalai/interface 2024-10-21T04:17:24,204 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-10-21T04:17:24,205 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-10-21T04:17:24,207 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-10-21T04:17:24,209 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-10-21T04:17:24,211 creating build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,212 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,214 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,217 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,219 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,221 copying colossalai/checkpoint_io/moe_checkpoint.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,224 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,225 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-10-21T04:17:24,229 creating build/lib/colossalai/testing 2024-10-21T04:17:24,230 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-10-21T04:17:24,231 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-10-21T04:17:24,233 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-10-21T04:17:24,236 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-10-21T04:17:24,237 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-10-21T04:17:24,239 creating build/lib/colossalai/amp 2024-10-21T04:17:24,240 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-10-21T04:17:24,242 creating build/lib/colossalai/accelerator 2024-10-21T04:17:24,243 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,246 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,247 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,249 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,251 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,253 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-10-21T04:17:24,256 creating build/lib/colossalai/inference 2024-10-21T04:17:24,257 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,259 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,261 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,263 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,265 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,267 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,269 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,271 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,273 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-10-21T04:17:24,276 creating build/lib/colossalai/quantization 2024-10-21T04:17:24,277 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,279 copying colossalai/quantization/utils.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,281 copying colossalai/quantization/fp8.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,284 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,286 copying colossalai/quantization/fp8_hook.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,287 copying colossalai/quantization/fp8_config.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,289 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-10-21T04:17:24,291 creating build/lib/colossalai/moe 2024-10-21T04:17:24,292 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-10-21T04:17:24,294 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-10-21T04:17:24,296 creating build/lib/colossalai/lazy 2024-10-21T04:17:24,297 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-10-21T04:17:24,299 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-10-21T04:17:24,302 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-10-21T04:17:24,304 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-10-21T04:17:24,306 creating build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,307 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,310 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,312 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,314 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,316 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,318 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,321 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-10-21T04:17:24,323 creating build/lib/colossalai/zero/low_level 2024-10-21T04:17:24,324 copying colossalai/zero/low_level/zero_hook.py -> build/lib/colossalai/zero/low_level 2024-10-21T04:17:24,326 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-10-21T04:17:24,329 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-10-21T04:17:24,331 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-10-21T04:17:24,334 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,334 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,336 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,338 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,340 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,342 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,344 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,346 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,347 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,349 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:24,351 creating build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,352 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,354 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,357 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,359 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,360 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-10-21T04:17:24,363 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,364 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,366 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,368 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,370 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,371 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:24,374 creating build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,375 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,378 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,381 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,384 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,386 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,388 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,391 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,392 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,395 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,398 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,400 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-10-21T04:17:24,403 creating build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,403 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,406 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,407 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,409 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,411 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,413 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-10-21T04:17:24,416 creating build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,417 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,419 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,422 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,425 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,427 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,429 copying colossalai/shardformer/policies/command.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,432 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,434 copying colossalai/shardformer/policies/deepseek.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,436 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,439 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,441 copying colossalai/shardformer/policies/mixtral.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,443 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,445 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,448 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,450 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,452 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,455 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,458 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,460 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,461 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,464 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-10-21T04:17:24,468 creating build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,469 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,471 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,474 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,477 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,480 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,482 copying colossalai/shardformer/modeling/command.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,485 copying colossalai/shardformer/modeling/deepseek.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,487 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,490 copying colossalai/shardformer/modeling/mixtral.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,493 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,495 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,497 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,500 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,503 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,506 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,509 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,510 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,513 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,515 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,517 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-10-21T04:17:24,521 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:24,522 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:24,524 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:24,527 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:24,530 creating build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,530 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,533 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,535 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,538 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,540 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,542 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,544 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,546 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,548 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,550 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,553 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,556 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,558 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,560 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,562 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,564 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-10-21T04:17:24,566 creating build/lib/colossalai/nn/loss 2024-10-21T04:17:24,567 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-10-21T04:17:24,569 creating build/lib/colossalai/nn/layer 2024-10-21T04:17:24,570 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-10-21T04:17:24,572 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-10-21T04:17:24,574 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-10-21T04:17:24,576 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-10-21T04:17:24,578 creating build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,579 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,581 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,583 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,585 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,587 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,589 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,591 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,592 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-10-21T04:17:24,595 creating build/lib/colossalai/kernel/jit 2024-10-21T04:17:24,596 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-10-21T04:17:24,597 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-10-21T04:17:24,599 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-10-21T04:17:24,601 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-10-21T04:17:24,603 creating build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,604 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,606 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,607 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,610 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,611 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,613 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-10-21T04:17:24,616 creating build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,617 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,619 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,621 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,623 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,625 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,628 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,630 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,631 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,634 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,635 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,638 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-10-21T04:17:24,641 creating build/lib/colossalai/kernel/extensions/csrc 2024-10-21T04:17:24,641 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-10-21T04:17:24,643 creating build/lib/colossalai/kernel/extensions/pybind 2024-10-21T04:17:24,644 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-10-21T04:17:24,646 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:24,647 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:24,649 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:24,651 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:24,653 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:24,653 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:24,655 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:24,658 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:24,658 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:24,661 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:24,663 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:24,664 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:24,665 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:24,667 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:24,669 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:24,670 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:24,672 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:24,674 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:24,675 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:24,677 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:24,679 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:24,680 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:24,682 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:24,684 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:24,686 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:24,688 creating build/lib/colossalai/utils/tensor_detector 2024-10-21T04:17:24,689 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-10-21T04:17:24,691 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-10-21T04:17:24,693 creating build/lib/colossalai/utils/rank_recorder 2024-10-21T04:17:24,694 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-10-21T04:17:24,696 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-10-21T04:17:24,698 creating build/lib/colossalai/utils/model 2024-10-21T04:17:24,699 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-10-21T04:17:24,701 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-10-21T04:17:24,703 creating build/lib/colossalai/utils/multi_tensor_apply 2024-10-21T04:17:24,704 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-10-21T04:17:24,706 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-10-21T04:17:24,708 creating build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,709 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,712 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,715 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,716 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,719 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,720 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-10-21T04:17:24,723 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:24,724 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:24,727 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:24,729 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:24,732 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:24,734 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,735 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,737 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,740 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,742 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,743 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:24,745 creating build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,746 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,749 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,750 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,752 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,755 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,756 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:24,759 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-10-21T04:17:24,760 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-10-21T04:17:24,762 creating build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,763 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,765 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,767 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,769 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,772 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,774 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,776 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,778 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,781 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,782 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-10-21T04:17:24,784 creating build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,785 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,787 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,789 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,791 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,793 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,795 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-10-21T04:17:24,806 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,807 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,810 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,811 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,814 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,815 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,817 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,820 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,822 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,823 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,825 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,827 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:24,829 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,830 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,832 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,834 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,836 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,838 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,840 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:24,844 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,845 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,848 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,850 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,851 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,853 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,855 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,857 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,859 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,860 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,863 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,865 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,866 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,869 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,870 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,872 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,874 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,876 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,878 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,880 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,882 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,884 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,886 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,888 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,890 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,892 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,894 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,896 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:24,899 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,900 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,903 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,906 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,909 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,911 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:24,914 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,915 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,917 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,919 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,921 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,923 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,926 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,928 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,930 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,933 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,935 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,937 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,939 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,941 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,943 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,945 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,947 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,949 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,951 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,953 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:24,957 creating build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,957 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,960 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,961 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,964 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,966 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-10-21T04:17:24,968 creating build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,969 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,972 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,974 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,976 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,978 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-10-21T04:17:24,980 creating build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,981 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,983 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,985 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,987 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,989 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,991 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:24,994 creating build/lib/colossalai/_analyzer/fx/passes 2024-10-21T04:17:24,995 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-10-21T04:17:24,997 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-10-21T04:17:24,999 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-10-21T04:17:25,002 creating build/lib/colossalai/tensor/padded_tensor 2024-10-21T04:17:25,002 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-10-21T04:17:25,004 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-10-21T04:17:25,007 creating build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,007 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,009 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,011 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,013 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,015 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,017 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,020 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,022 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-10-21T04:17:25,024 creating build/lib/colossalai/tensor/moe_tensor 2024-10-21T04:17:25,025 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-10-21T04:17:25,027 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-10-21T04:17:25,029 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-10-21T04:17:25,031 creating build/lib/colossalai/legacy/engine 2024-10-21T04:17:25,031 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-10-21T04:17:25,034 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-10-21T04:17:25,036 creating build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,037 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,039 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,041 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,043 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,045 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,047 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-10-21T04:17:25,050 creating build/lib/colossalai/legacy/zero 2024-10-21T04:17:25,050 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-10-21T04:17:25,053 creating build/lib/colossalai/legacy/nn 2024-10-21T04:17:25,054 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-10-21T04:17:25,056 creating build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,057 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,059 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,061 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,064 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,066 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-10-21T04:17:25,069 creating build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,069 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,071 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,073 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,076 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,078 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-10-21T04:17:25,080 creating build/lib/colossalai/legacy/context 2024-10-21T04:17:25,081 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-10-21T04:17:25,083 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-10-21T04:17:25,085 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-10-21T04:17:25,087 creating build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,088 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,090 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,092 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,093 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,095 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,097 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,099 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,101 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-10-21T04:17:25,103 creating build/lib/colossalai/legacy/amp 2024-10-21T04:17:25,104 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-10-21T04:17:25,106 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-10-21T04:17:25,108 creating build/lib/colossalai/legacy/registry 2024-10-21T04:17:25,109 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-10-21T04:17:25,111 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-10-21T04:17:25,113 creating build/lib/colossalai/legacy/builder 2024-10-21T04:17:25,114 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-10-21T04:17:25,116 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-10-21T04:17:25,118 creating build/lib/colossalai/legacy/trainer 2024-10-21T04:17:25,119 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-10-21T04:17:25,121 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-10-21T04:17:25,123 creating build/lib/colossalai/legacy/inference 2024-10-21T04:17:25,124 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-10-21T04:17:25,127 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-10-21T04:17:25,129 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-10-21T04:17:25,131 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-10-21T04:17:25,133 creating build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,134 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,137 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,138 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,140 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,142 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-10-21T04:17:25,145 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,146 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,147 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,149 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,151 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,153 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,155 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,157 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,158 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:25,161 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:25,162 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:25,164 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:25,166 creating build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,167 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,169 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,171 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,174 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,175 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,178 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:25,180 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:25,181 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:25,184 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:25,186 creating build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,187 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,189 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,191 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,193 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,194 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:25,197 creating build/lib/colossalai/legacy/zero/sharded_param 2024-10-21T04:17:25,198 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-10-21T04:17:25,200 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-10-21T04:17:25,201 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-10-21T04:17:25,204 creating build/lib/colossalai/legacy/zero/init_ctx 2024-10-21T04:17:25,205 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-10-21T04:17:25,207 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-10-21T04:17:25,209 creating build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,210 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,213 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,214 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,216 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,219 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,221 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,223 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-10-21T04:17:25,225 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,226 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,229 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,230 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,232 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,233 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:25,236 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:25,237 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:25,239 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:25,241 creating build/lib/colossalai/legacy/nn/_ops 2024-10-21T04:17:25,242 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-10-21T04:17:25,244 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-10-21T04:17:25,247 creating build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,248 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,250 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,252 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,254 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,257 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-10-21T04:17:25,259 creating build/lib/colossalai/legacy/nn/layer 2024-10-21T04:17:25,260 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-10-21T04:17:25,262 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-10-21T04:17:25,264 creating build/lib/colossalai/legacy/nn/parallel 2024-10-21T04:17:25,265 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-10-21T04:17:25,267 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-10-21T04:17:25,269 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-10-21T04:17:25,271 creating build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,272 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,273 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,275 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,277 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,278 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-10-21T04:17:25,280 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:25,281 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:25,284 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:25,287 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:25,289 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:25,291 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:25,292 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:25,294 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:25,296 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:25,297 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:25,299 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:25,302 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:25,304 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:25,307 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:25,308 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:25,311 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:25,313 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:25,315 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:25,317 creating build/lib/colossalai/legacy/nn/layer/utils 2024-10-21T04:17:25,318 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-10-21T04:17:25,320 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-10-21T04:17:25,322 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:25,323 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:25,326 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:25,330 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:25,332 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:25,335 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,336 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,338 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,340 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,342 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,344 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,346 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:25,348 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:25,349 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:25,351 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:25,354 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:25,355 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:25,358 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:25,361 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:25,363 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:25,366 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,367 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,369 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,371 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,373 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,374 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:25,377 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,378 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,381 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,383 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,385 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,388 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,390 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,393 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,395 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,397 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:25,399 creating build/lib/colossalai/legacy/utils/checkpoint 2024-10-21T04:17:25,400 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-10-21T04:17:25,402 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-10-21T04:17:25,405 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-10-21T04:17:25,407 creating build/lib/colossalai/legacy/utils/data_sampler 2024-10-21T04:17:25,408 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-10-21T04:17:25,410 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-10-21T04:17:25,412 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-10-21T04:17:25,414 creating build/lib/colossalai/legacy/utils/profiler 2024-10-21T04:17:25,415 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-10-21T04:17:25,418 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-10-21T04:17:25,419 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-10-21T04:17:25,421 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-10-21T04:17:25,424 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:25,425 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:25,428 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:25,430 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:25,432 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:25,435 creating build/lib/colossalai/legacy/pipeline/middleware 2024-10-21T04:17:25,436 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-10-21T04:17:25,438 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-10-21T04:17:25,441 creating build/lib/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:25,442 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:25,445 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:25,447 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:25,451 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:25,453 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:25,455 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:25,457 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:25,460 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,461 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,463 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,465 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,467 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,469 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,471 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,473 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,474 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,477 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,479 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,481 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:25,483 creating build/lib/colossalai/legacy/context/random 2024-10-21T04:17:25,485 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-10-21T04:17:25,487 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-10-21T04:17:25,489 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-10-21T04:17:25,491 creating build/lib/colossalai/legacy/amp/apex_amp 2024-10-21T04:17:25,492 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-10-21T04:17:25,494 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-10-21T04:17:25,496 creating build/lib/colossalai/legacy/amp/torch_amp 2024-10-21T04:17:25,497 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-10-21T04:17:25,499 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-10-21T04:17:25,502 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-10-21T04:17:25,504 creating build/lib/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:25,505 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:25,508 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:25,510 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:25,512 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:25,514 creating build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,515 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,518 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,520 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,522 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,524 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,526 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,528 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-10-21T04:17:25,530 creating build/lib/colossalai/legacy/inference/hybridengine 2024-10-21T04:17:25,531 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-10-21T04:17:25,533 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-10-21T04:17:25,536 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,537 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,540 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,542 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,544 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,546 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,548 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,550 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,552 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,553 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:25,556 creating build/lib/colossalai/legacy/inference/pipeline 2024-10-21T04:17:25,557 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-10-21T04:17:25,559 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-10-21T04:17:25,562 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:25,563 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:25,565 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:25,567 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:25,570 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:25,572 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:25,573 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:25,575 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:25,578 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:25,579 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:25,582 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:25,584 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:25,586 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:25,587 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:25,589 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:25,592 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:25,594 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:25,597 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,598 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,601 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,603 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,606 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,608 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:25,611 creating build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,611 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,615 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,617 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,619 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,621 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,624 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,628 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,630 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,632 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,634 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-10-21T04:17:25,637 creating build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,639 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,641 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,642 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,644 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,646 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,648 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,651 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-10-21T04:17:25,654 creating build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,656 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,658 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,660 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,662 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,664 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,667 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,668 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-10-21T04:17:25,672 creating build/lib/colossalai/fx/codegen 2024-10-21T04:17:25,673 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-10-21T04:17:25,676 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-10-21T04:17:25,679 creating build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,680 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,682 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,684 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,686 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,688 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,690 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,692 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,694 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-10-21T04:17:25,698 creating build/lib/colossalai/fx/passes 2024-10-21T04:17:25,699 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,701 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,703 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,706 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,708 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,710 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,713 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,715 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-10-21T04:17:25,718 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-10-21T04:17:25,718 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-10-21T04:17:25,721 creating build/lib/colossalai/fx/tracer/meta_patch 2024-10-21T04:17:25,722 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-10-21T04:17:25,724 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,725 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,727 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,729 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,731 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,733 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:25,736 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:25,737 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:25,739 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:25,741 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:25,743 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:25,746 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,747 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,748 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,750 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,752 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,754 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,756 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,758 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,760 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:25,763 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,764 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,766 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,768 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,770 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,772 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,775 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,776 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,778 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:25,780 creating build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,782 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,784 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,786 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,787 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,789 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-10-21T04:17:25,793 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,794 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,796 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,798 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,799 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,802 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,804 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,806 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,807 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,809 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,811 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,813 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:25,816 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,817 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,819 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,821 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,823 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,825 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,827 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,829 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,830 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,832 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:25,835 creating build/lib/colossalai/cli/launcher 2024-10-21T04:17:25,836 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-10-21T04:17:25,838 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-10-21T04:17:25,840 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-10-21T04:17:25,842 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-10-21T04:17:25,844 creating build/lib/colossalai/cli/check 2024-10-21T04:17:25,845 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-10-21T04:17:25,848 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-10-21T04:17:25,850 creating build/lib/colossalai/amp/naive_amp 2024-10-21T04:17:25,851 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-10-21T04:17:25,853 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-10-21T04:17:25,855 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:25,856 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:25,858 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:25,860 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:25,862 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:25,865 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:25,866 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:25,868 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:25,870 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:25,871 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:25,874 creating build/lib/colossalai/inference/core 2024-10-21T04:17:25,875 copying colossalai/inference/core/llm_engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,878 copying colossalai/inference/core/base_engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,880 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,883 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,885 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,887 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,890 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,892 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,894 copying colossalai/inference/core/diffusion_engine.py -> build/lib/colossalai/inference/core 2024-10-21T04:17:25,896 creating build/lib/colossalai/inference/executor 2024-10-21T04:17:25,897 copying colossalai/inference/executor/rpc_worker.py -> build/lib/colossalai/inference/executor 2024-10-21T04:17:25,900 copying colossalai/inference/executor/__init__.py -> build/lib/colossalai/inference/executor 2024-10-21T04:17:25,902 creating build/lib/colossalai/inference/server 2024-10-21T04:17:25,903 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-10-21T04:17:25,905 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-10-21T04:17:25,907 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-10-21T04:17:25,909 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-10-21T04:17:25,911 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-10-21T04:17:25,913 creating build/lib/colossalai/inference/spec 2024-10-21T04:17:25,914 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-10-21T04:17:25,916 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-10-21T04:17:25,917 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-10-21T04:17:25,920 creating build/lib/colossalai/inference/kv_cache 2024-10-21T04:17:25,921 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-10-21T04:17:25,923 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-10-21T04:17:25,925 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-10-21T04:17:25,927 creating build/lib/colossalai/inference/modeling 2024-10-21T04:17:25,928 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-10-21T04:17:25,931 creating build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,931 copying colossalai/inference/modeling/policy/stablediffusion3.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,934 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,936 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,938 copying colossalai/inference/modeling/policy/pixart_alpha.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,940 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,941 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-10-21T04:17:25,944 creating build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,945 copying colossalai/inference/modeling/models/stablediffusion3.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,947 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,950 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,953 copying colossalai/inference/modeling/models/pixart_alpha.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,955 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,956 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-10-21T04:17:25,959 creating build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,960 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,962 copying colossalai/inference/modeling/layers/diffusion.py -> build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,964 copying colossalai/inference/modeling/layers/distrifusion.py -> build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,966 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,969 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-10-21T04:17:25,971 creating build/lib/colossalai/inference/modeling/backends 2024-10-21T04:17:25,972 copying colossalai/inference/modeling/backends/pre_attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-10-21T04:17:25,974 copying colossalai/inference/modeling/backends/attention_backend.py -> build/lib/colossalai/inference/modeling/backends 2024-10-21T04:17:25,976 copying colossalai/inference/modeling/backends/__init__.py -> build/lib/colossalai/inference/modeling/backends 2024-10-21T04:17:26,071 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,072 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,075 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,077 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,080 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,082 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,084 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-10-21T04:17:26,085 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,086 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,088 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,091 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,091 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,094 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,097 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,098 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,100 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,102 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,106 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,108 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,111 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,114 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,116 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,119 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,122 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,124 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,126 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,129 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,131 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,134 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,137 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,140 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,142 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,145 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,146 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,148 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,150 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,152 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,154 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-10-21T04:17:26,155 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-10-21T04:17:26,158 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,158 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,161 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,163 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,165 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,167 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,170 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,172 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,176 copying colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:26,179 copying colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:26,183 copying colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:26,186 copying colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:26,312 /home/piwheels/.local/lib/python3.9/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-10-21T04:17:26,312 !! 2024-10-21T04:17:26,312 ******************************************************************************** 2024-10-21T04:17:26,312 Please avoid running ``setup.py`` directly. 2024-10-21T04:17:26,313 Instead, use pypa/build, pypa/installer or other 2024-10-21T04:17:26,313 standards-based tools. 2024-10-21T04:17:26,313 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-10-21T04:17:26,313 ******************************************************************************** 2024-10-21T04:17:26,313 !! 2024-10-21T04:17:26,314 self.initialize_options() 2024-10-21T04:17:26,338 installing to build/bdist.linux-armv7l/wheel 2024-10-21T04:17:26,339 running install 2024-10-21T04:17:26,363 running install_lib 2024-10-21T04:17:26,391 creating build/bdist.linux-armv7l 2024-10-21T04:17:26,391 creating build/bdist.linux-armv7l/wheel 2024-10-21T04:17:26,393 creating build/bdist.linux-armv7l/wheel/extensions 2024-10-21T04:17:26,395 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-10-21T04:17:26,395 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/csrc 2024-10-21T04:17:26,398 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-10-21T04:17:26,399 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-10-21T04:17:26,400 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-10-21T04:17:26,402 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-10-21T04:17:26,404 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/softmax 2024-10-21T04:17:26,406 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-10-21T04:17:26,407 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-10-21T04:17:26,409 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/layernorm 2024-10-21T04:17:26,411 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-10-21T04:17:26,412 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-10-21T04:17:26,414 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/optimizer 2024-10-21T04:17:26,416 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-10-21T04:17:26,417 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-10-21T04:17:26,419 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-10-21T04:17:26,421 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/cpu_adam 2024-10-21T04:17:26,423 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind 2024-10-21T04:17:26,425 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-10-21T04:17:26,425 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-10-21T04:17:26,427 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/inference 2024-10-21T04:17:26,429 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-10-21T04:17:26,431 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-10-21T04:17:26,432 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/moe 2024-10-21T04:17:26,435 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-10-21T04:17:26,436 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-10-21T04:17:26,438 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-10-21T04:17:26,440 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-10-21T04:17:26,442 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./extensions/pybind/flash_attention 2024-10-21T04:17:26,445 creating build/bdist.linux-armv7l/wheel/colossalai 2024-10-21T04:17:26,445 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-10-21T04:17:26,448 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-10-21T04:17:26,449 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-10-21T04:17:26,452 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-10-21T04:17:26,454 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,455 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,457 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,459 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,461 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,464 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,466 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,468 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,470 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,471 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/memory_tracer 2024-10-21T04:17:26,473 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,476 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,478 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,480 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,482 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,485 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-10-21T04:17:26,486 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-10-21T04:17:26,488 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-10-21T04:17:26,490 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-10-21T04:17:26,492 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-10-21T04:17:26,494 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini/chunk 2024-10-21T04:17:26,497 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,500 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/gemini 2024-10-21T04:17:26,502 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero 2024-10-21T04:17:26,504 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-10-21T04:17:26,505 copying build/lib/colossalai/zero/low_level/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-10-21T04:17:26,506 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-10-21T04:17:26,509 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-10-21T04:17:26,511 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level 2024-10-21T04:17:26,514 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,515 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,516 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,518 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,520 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,522 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/./colossalai/zero/low_level/bookkeeping 2024-10-21T04:17:26,525 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-10-21T04:17:26,525 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_C 2024-10-21T04:17:26,527 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-10-21T04:17:26,529 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-10-21T04:17:26,530 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,533 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,536 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,539 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,541 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,544 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,546 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,548 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,551 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,554 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,557 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/layer 2024-10-21T04:17:26,559 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-10-21T04:17:26,560 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,562 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,565 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,566 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,568 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,570 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/shard 2024-10-21T04:17:26,572 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-10-21T04:17:26,574 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer 2024-10-21T04:17:26,576 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-10-21T04:17:26,577 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,579 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,582 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,585 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,587 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,590 copying build/lib/colossalai/shardformer/policies/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,593 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,596 copying build/lib/colossalai/shardformer/policies/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,598 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,601 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,603 copying build/lib/colossalai/shardformer/policies/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,605 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,608 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,610 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,613 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,615 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,618 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,621 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,623 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,625 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,627 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/policies 2024-10-21T04:17:26,631 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-10-21T04:17:26,631 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,635 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,638 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,641 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,644 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,646 copying build/lib/colossalai/shardformer/modeling/command.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,649 copying build/lib/colossalai/shardformer/modeling/deepseek.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,652 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,654 copying build/lib/colossalai/shardformer/modeling/mixtral.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,658 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,659 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,662 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,665 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,669 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,672 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,675 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,677 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,680 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:26,681 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:26,683 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:26,687 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling/chatglm2_6b 2024-10-21T04:17:26,688 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,690 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,693 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/./colossalai/shardformer/modeling 2024-10-21T04:17:26,696 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-10-21T04:17:26,697 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-10-21T04:17:26,700 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-10-21T04:17:26,701 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,704 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,706 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,708 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,711 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,713 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,715 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,717 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,719 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,722 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,724 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,727 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,729 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,731 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,733 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,735 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/optimizer 2024-10-21T04:17:26,738 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-10-21T04:17:26,739 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/loss 2024-10-21T04:17:26,741 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-10-21T04:17:26,742 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-10-21T04:17:26,744 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-10-21T04:17:26,746 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-10-21T04:17:26,748 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/layer 2024-10-21T04:17:26,750 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-10-21T04:17:26,751 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,753 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,755 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,757 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,759 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,762 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,764 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,766 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn/lr_scheduler 2024-10-21T04:17:26,768 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/nn 2024-10-21T04:17:26,770 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-10-21T04:17:26,771 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-10-21T04:17:26,773 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-10-21T04:17:26,774 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-10-21T04:17:26,776 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-10-21T04:17:26,778 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-10-21T04:17:26,780 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/jit 2024-10-21T04:17:26,782 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-10-21T04:17:26,783 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,785 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,787 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,790 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-10-21T04:17:26,791 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,792 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,795 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,797 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,799 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,801 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/funcs 2024-10-21T04:17:26,804 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-10-21T04:17:26,806 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,807 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,809 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/arm 2024-10-21T04:17:26,812 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,813 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,816 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/x86 2024-10-21T04:17:26,819 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,820 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,822 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,824 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,827 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,830 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,831 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,833 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,835 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,838 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-10-21T04:17:26,839 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,842 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,845 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,847 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,850 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,853 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,855 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,857 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,860 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-10-21T04:17:26,861 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-10-21T04:17:26,863 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,866 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,868 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,871 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,873 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,876 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/kernel/cuda 2024-10-21T04:17:26,879 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,879 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,881 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,883 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,885 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,887 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc/common 2024-10-21T04:17:26,889 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/csrc 2024-10-21T04:17:26,891 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,893 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,896 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions 2024-10-21T04:17:26,898 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-10-21T04:17:26,899 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,900 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,902 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,904 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,906 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,908 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/softmax 2024-10-21T04:17:26,910 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:26,911 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:26,913 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:26,915 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/layernorm 2024-10-21T04:17:26,917 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:26,918 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:26,920 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:26,922 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/optimizer 2024-10-21T04:17:26,925 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:26,926 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:26,928 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:26,930 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/cpu_adam 2024-10-21T04:17:26,932 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind 2024-10-21T04:17:26,934 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:26,935 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:26,937 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:26,940 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/inference 2024-10-21T04:17:26,943 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:26,944 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:26,946 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe.cpp -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:26,948 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/moe 2024-10-21T04:17:26,950 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:26,951 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:26,953 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:26,955 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:26,957 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/extensions/pybind/flash_attention 2024-10-21T04:17:26,958 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel 2024-10-21T04:17:26,961 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-10-21T04:17:26,961 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,964 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,966 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,969 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,971 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,974 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,976 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,978 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,980 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,982 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,984 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/./colossalai/kernel/triton 2024-10-21T04:17:26,987 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-10-21T04:17:26,988 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-10-21T04:17:26,990 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-10-21T04:17:26,992 copying build/lib/colossalai/utils/safetensors.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-10-21T04:17:26,994 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-10-21T04:17:26,995 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-10-21T04:17:26,997 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/tensor_detector 2024-10-21T04:17:26,999 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-10-21T04:17:27,001 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils 2024-10-21T04:17:27,003 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-10-21T04:17:27,004 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-10-21T04:17:27,006 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/rank_recorder 2024-10-21T04:17:27,008 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-10-21T04:17:27,009 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-10-21T04:17:27,012 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/model 2024-10-21T04:17:27,014 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-10-21T04:17:27,015 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-10-21T04:17:27,017 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/utils/multi_tensor_apply 2024-10-21T04:17:27,020 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-10-21T04:17:27,021 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-10-21T04:17:27,022 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,025 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,027 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,029 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,032 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,034 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline/schedule 2024-10-21T04:17:27,036 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-10-21T04:17:27,039 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-10-21T04:17:27,041 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/pipeline 2024-10-21T04:17:27,043 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-10-21T04:17:27,044 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-10-21T04:17:27,046 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-10-21T04:17:27,048 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/context 2024-10-21T04:17:27,050 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-10-21T04:17:27,051 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-10-21T04:17:27,054 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-10-21T04:17:27,056 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-10-21T04:17:27,058 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/device 2024-10-21T04:17:27,061 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-10-21T04:17:27,062 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:27,063 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:27,066 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,067 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,070 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,072 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,074 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,076 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,078 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,081 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,082 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,084 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,086 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,087 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler/meta_registry 2024-10-21T04:17:27,089 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:27,091 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:27,093 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/meta_profiler 2024-10-21T04:17:27,096 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,097 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,099 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,102 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,104 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,105 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,107 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,110 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,112 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,114 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,116 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/utils 2024-10-21T04:17:27,118 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,121 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,121 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,124 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,126 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,128 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,129 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,131 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,133 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,135 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,137 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,140 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,142 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,145 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,147 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,149 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,151 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,154 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,156 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,158 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,160 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,162 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,164 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,166 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,169 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-10-21T04:17:27,171 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,173 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,175 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,177 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,179 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,181 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,183 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,185 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,187 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,190 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,193 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,196 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,199 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,202 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,204 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,207 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,209 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,212 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,214 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,216 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,219 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,222 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,224 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,226 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/node_handler 2024-10-21T04:17:27,229 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard 2024-10-21T04:17:27,231 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,232 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,235 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,238 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,241 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,245 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/tensor_shard/solver 2024-10-21T04:17:27,247 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,248 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,251 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,254 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,256 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,259 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,261 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/checkpoint 2024-10-21T04:17:27,264 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-10-21T04:17:27,265 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/pipeline_shard 2024-10-21T04:17:27,268 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-10-21T04:17:27,269 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,272 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,274 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,277 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,280 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,283 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,285 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,288 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,291 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,293 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/offload 2024-10-21T04:17:27,295 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-10-21T04:17:27,296 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,298 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,300 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,302 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,304 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,306 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel/passes 2024-10-21T04:17:27,309 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/auto_parallel 2024-10-21T04:17:27,313 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-10-21T04:17:27,315 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-10-21T04:17:27,318 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,319 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,323 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,326 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,328 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,330 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,332 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/tracer 2024-10-21T04:17:27,335 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-10-21T04:17:27,337 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-10-21T04:17:27,339 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-10-21T04:17:27,341 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-10-21T04:17:27,344 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-10-21T04:17:27,345 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-10-21T04:17:27,348 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-10-21T04:17:27,350 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx/passes 2024-10-21T04:17:27,353 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/fx 2024-10-21T04:17:27,354 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-10-21T04:17:27,357 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,358 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,361 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,363 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,365 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,367 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer/_subclasses 2024-10-21T04:17:27,369 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/./colossalai/_analyzer 2024-10-21T04:17:27,372 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-10-21T04:17:27,373 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-10-21T04:17:27,374 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-10-21T04:17:27,376 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/padded_tensor 2024-10-21T04:17:27,378 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,380 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-10-21T04:17:27,381 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,383 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,385 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,387 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,389 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,392 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,394 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,397 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/d_tensor 2024-10-21T04:17:27,399 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,400 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,403 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,406 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,408 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,411 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,413 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor 2024-10-21T04:17:27,415 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-10-21T04:17:27,416 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-10-21T04:17:27,418 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-10-21T04:17:27,420 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/tensor/moe_tensor 2024-10-21T04:17:27,422 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-10-21T04:17:27,423 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-10-21T04:17:27,426 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-10-21T04:17:27,427 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-10-21T04:17:27,430 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-10-21T04:17:27,431 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-10-21T04:17:27,434 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-10-21T04:17:27,436 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-10-21T04:17:27,438 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-10-21T04:17:27,440 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/schedule 2024-10-21T04:17:27,442 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,443 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,445 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,447 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,449 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,451 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,453 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,455 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,457 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_handler 2024-10-21T04:17:27,458 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine 2024-10-21T04:17:27,460 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:27,461 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:27,464 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/engine/gradient_accumulation 2024-10-21T04:17:27,466 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-10-21T04:17:27,467 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,470 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,472 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,474 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,477 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,479 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/communication 2024-10-21T04:17:27,482 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-10-21T04:17:27,483 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,484 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,486 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,488 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,491 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,493 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,495 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_model 2024-10-21T04:17:27,497 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:27,498 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:27,501 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_optim 2024-10-21T04:17:27,503 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,503 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,505 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,507 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,509 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,511 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/shard_utils 2024-10-21T04:17:27,513 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-10-21T04:17:27,514 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-10-21T04:17:27,516 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-10-21T04:17:27,517 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/sharded_param 2024-10-21T04:17:27,519 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-10-21T04:17:27,520 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-10-21T04:17:27,523 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/init_ctx 2024-10-21T04:17:27,525 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-10-21T04:17:27,526 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,529 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,530 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,532 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,534 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,536 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,537 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/ophooks 2024-10-21T04:17:27,540 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,541 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,543 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,546 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,548 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:27,549 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:27,550 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini/paramhooks 2024-10-21T04:17:27,552 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,554 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero/gemini 2024-10-21T04:17:27,556 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/zero 2024-10-21T04:17:27,558 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-10-21T04:17:27,559 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-10-21T04:17:27,560 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-10-21T04:17:27,562 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/_ops 2024-10-21T04:17:27,565 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-10-21T04:17:27,566 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-10-21T04:17:27,568 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-10-21T04:17:27,570 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-10-21T04:17:27,572 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-10-21T04:17:27,575 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/loss 2024-10-21T04:17:27,577 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-10-21T04:17:27,578 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:27,579 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:27,582 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:27,585 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:27,587 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2d 2024-10-21T04:17:27,590 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:27,590 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:27,592 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/wrapper 2024-10-21T04:17:27,594 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-10-21T04:17:27,596 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:27,597 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:27,599 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:27,602 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:27,603 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_1d 2024-10-21T04:17:27,606 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:27,607 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:27,609 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:27,612 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:27,613 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_sequence 2024-10-21T04:17:27,616 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-10-21T04:17:27,617 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-10-21T04:17:27,619 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/utils 2024-10-21T04:17:27,621 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:27,622 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:27,625 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:27,628 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:27,630 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_2p5d 2024-10-21T04:17:27,632 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer 2024-10-21T04:17:27,635 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,635 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,638 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,640 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,641 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,643 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,645 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/colossalai_layer 2024-10-21T04:17:27,647 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:27,648 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:27,651 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/vanilla 2024-10-21T04:17:27,653 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:27,654 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:27,657 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:27,660 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:27,661 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/layer/parallel_3d 2024-10-21T04:17:27,664 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-10-21T04:17:27,665 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-10-21T04:17:27,667 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-10-21T04:17:27,669 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,670 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,672 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,674 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,676 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,677 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers 2024-10-21T04:17:27,680 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,681 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,682 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,685 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,687 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,689 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,691 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,694 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,695 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,698 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel/layers/cache_embedding 2024-10-21T04:17:27,700 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/parallel 2024-10-21T04:17:27,702 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-10-21T04:17:27,703 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-10-21T04:17:27,705 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-10-21T04:17:27,707 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-10-21T04:17:27,708 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-10-21T04:17:27,710 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn/metric 2024-10-21T04:17:27,712 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/nn 2024-10-21T04:17:27,713 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-10-21T04:17:27,716 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-10-21T04:17:27,717 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-10-21T04:17:27,719 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-10-21T04:17:27,722 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-10-21T04:17:27,722 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-10-21T04:17:27,725 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-10-21T04:17:27,727 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/checkpoint 2024-10-21T04:17:27,728 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-10-21T04:17:27,730 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-10-21T04:17:27,733 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-10-21T04:17:27,734 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-10-21T04:17:27,736 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-10-21T04:17:27,738 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/data_sampler 2024-10-21T04:17:27,740 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-10-21T04:17:27,741 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-10-21T04:17:27,743 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:27,744 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:27,746 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:27,748 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:27,750 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler/legacy 2024-10-21T04:17:27,752 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-10-21T04:17:27,754 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-10-21T04:17:27,755 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils/profiler 2024-10-21T04:17:27,758 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/utils 2024-10-21T04:17:27,760 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-10-21T04:17:27,761 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-10-21T04:17:27,762 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-10-21T04:17:27,765 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-10-21T04:17:27,767 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-10-21T04:17:27,768 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-10-21T04:17:27,771 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:27,772 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:27,774 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware/adaptor 2024-10-21T04:17:27,776 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/middleware 2024-10-21T04:17:27,778 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-10-21T04:17:27,780 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline 2024-10-21T04:17:27,782 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-10-21T04:17:27,783 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-10-21T04:17:27,785 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-10-21T04:17:27,787 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-10-21T04:17:27,791 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/pipeline/rpc 2024-10-21T04:17:27,793 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-10-21T04:17:27,795 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-10-21T04:17:27,795 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-10-21T04:17:27,799 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,800 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,802 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,804 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,806 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,809 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,810 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,812 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,814 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,816 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,818 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,821 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/process_group_initializer 2024-10-21T04:17:27,823 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-10-21T04:17:27,825 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context 2024-10-21T04:17:27,827 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-10-21T04:17:27,828 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-10-21T04:17:27,830 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-10-21T04:17:27,832 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/context/random 2024-10-21T04:17:27,834 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-10-21T04:17:27,835 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,837 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,839 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,841 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,843 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,845 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,847 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,849 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/tensor 2024-10-21T04:17:27,851 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-10-21T04:17:27,852 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-10-21T04:17:27,853 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-10-21T04:17:27,855 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/apex_amp 2024-10-21T04:17:27,857 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-10-21T04:17:27,858 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-10-21T04:17:27,860 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-10-21T04:17:27,863 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/torch_amp 2024-10-21T04:17:27,865 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-10-21T04:17:27,867 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-10-21T04:17:27,868 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-10-21T04:17:27,870 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-10-21T04:17:27,873 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-10-21T04:17:27,874 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp/naive_amp 2024-10-21T04:17:27,876 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/amp 2024-10-21T04:17:27,878 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-10-21T04:17:27,879 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-10-21T04:17:27,882 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/registry 2024-10-21T04:17:27,884 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-10-21T04:17:27,885 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-10-21T04:17:27,886 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/builder 2024-10-21T04:17:27,889 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-10-21T04:17:27,889 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-10-21T04:17:27,893 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,893 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,896 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,898 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,900 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,902 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,904 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,906 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer/hooks 2024-10-21T04:17:27,907 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/trainer 2024-10-21T04:17:27,909 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-10-21T04:17:27,912 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-10-21T04:17:27,913 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-10-21T04:17:27,914 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-10-21T04:17:27,916 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine 2024-10-21T04:17:27,918 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:27,919 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:27,921 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/polices 2024-10-21T04:17:27,923 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:27,924 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:27,927 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:27,929 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/hybridengine/modeling 2024-10-21T04:17:27,931 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,932 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,935 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,937 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,939 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,941 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,943 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,944 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,946 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,948 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/dynamic_batching 2024-10-21T04:17:27,950 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-10-21T04:17:27,951 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-10-21T04:17:27,953 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/pipeline 2024-10-21T04:17:27,955 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-10-21T04:17:27,957 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-10-21T04:17:27,959 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-10-21T04:17:27,961 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference 2024-10-21T04:17:27,964 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:27,965 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:27,967 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:27,972 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:27,975 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel 2024-10-21T04:17:27,977 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:27,978 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:27,980 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:27,982 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:27,985 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/policies 2024-10-21T04:17:27,987 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:27,988 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:27,990 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:27,993 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:27,996 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:27,997 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy/inference/tensor_parallel/modeling 2024-10-21T04:17:28,000 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/./colossalai/legacy 2024-10-21T04:17:28,003 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-10-21T04:17:28,004 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-10-21T04:17:28,007 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-10-21T04:17:28,010 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-10-21T04:17:28,011 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,015 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,018 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,021 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,023 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,027 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,032 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,035 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,037 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,039 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/plugin 2024-10-21T04:17:28,043 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-10-21T04:17:28,044 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,047 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,049 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,051 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,053 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,055 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,058 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster/mixed_precision 2024-10-21T04:17:28,060 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/booster 2024-10-21T04:17:28,063 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-10-21T04:17:28,065 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-10-21T04:17:28,067 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/logging 2024-10-21T04:17:28,070 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-10-21T04:17:28,071 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-10-21T04:17:28,074 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-10-21T04:17:28,077 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-10-21T04:17:28,080 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-10-21T04:17:28,083 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cluster 2024-10-21T04:17:28,086 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-10-21T04:17:28,088 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-10-21T04:17:28,089 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,092 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-10-21T04:17:28,094 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,096 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,098 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,100 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,102 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,104 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-10-21T04:17:28,106 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:28,107 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:28,109 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:28,111 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:28,113 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-10-21T04:17:28,115 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/bias_addition_patch 2024-10-21T04:17:28,116 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,118 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,120 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,122 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,125 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-10-21T04:17:28,127 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,128 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,130 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,131 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,133 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,135 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,137 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,140 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,141 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_module 2024-10-21T04:17:28,143 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch 2024-10-21T04:17:28,145 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,146 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,148 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,150 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,153 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,154 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,156 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,158 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,160 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer/meta_patch/patched_function 2024-10-21T04:17:28,162 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,163 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/tracer 2024-10-21T04:17:28,166 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-10-21T04:17:28,167 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-10-21T04:17:28,170 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/codegen 2024-10-21T04:17:28,172 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,174 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,176 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-10-21T04:17:28,177 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,179 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,181 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,183 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-10-21T04:17:28,184 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-10-21T04:17:28,186 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,187 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,189 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,191 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,192 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,194 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,196 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,198 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,200 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,201 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,203 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,205 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_module 2024-10-21T04:17:28,206 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-10-21T04:17:28,208 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-10-21T04:17:28,210 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,211 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,213 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,215 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,218 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,219 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,221 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,223 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,225 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,226 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental/profiler_function 2024-10-21T04:17:28,228 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-10-21T04:17:28,229 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler/experimental 2024-10-21T04:17:28,231 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,233 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,236 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,237 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,239 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/profiler 2024-10-21T04:17:28,242 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,243 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,246 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-10-21T04:17:28,247 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,250 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,252 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,254 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,257 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,259 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,261 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,264 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx/passes 2024-10-21T04:17:28,265 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,267 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/./colossalai/fx 2024-10-21T04:17:28,270 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-10-21T04:17:28,271 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-10-21T04:17:28,273 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-10-21T04:17:28,274 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-10-21T04:17:28,276 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-10-21T04:17:28,278 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-10-21T04:17:28,280 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/launcher 2024-10-21T04:17:28,282 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-10-21T04:17:28,283 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-10-21T04:17:28,286 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli/check 2024-10-21T04:17:28,287 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/cli 2024-10-21T04:17:28,289 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-10-21T04:17:28,291 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-10-21T04:17:28,292 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-10-21T04:17:28,293 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-10-21T04:17:28,296 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-10-21T04:17:28,297 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/interface 2024-10-21T04:17:28,299 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-10-21T04:17:28,300 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,302 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,305 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,308 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,310 copying build/lib/colossalai/checkpoint_io/moe_checkpoint.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,313 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,314 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/./colossalai/checkpoint_io 2024-10-21T04:17:28,318 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-10-21T04:17:28,319 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-10-21T04:17:28,321 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-10-21T04:17:28,323 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-10-21T04:17:28,325 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-10-21T04:17:28,327 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/testing 2024-10-21T04:17:28,329 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-10-21T04:17:28,330 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-10-21T04:17:28,331 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-10-21T04:17:28,334 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:28,335 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:28,337 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:28,339 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:28,341 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/grad_scaler 2024-10-21T04:17:28,343 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:28,344 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:28,346 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:28,348 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:28,350 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp/mixed_precision_mixin 2024-10-21T04:17:28,351 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp/naive_amp 2024-10-21T04:17:28,353 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/amp 2024-10-21T04:17:28,354 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai 2024-10-21T04:17:28,356 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-10-21T04:17:28,357 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,359 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,361 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,364 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,366 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,368 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./colossalai/accelerator 2024-10-21T04:17:28,371 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-10-21T04:17:28,373 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-10-21T04:17:28,374 copying build/lib/colossalai/inference/core/llm_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,377 copying build/lib/colossalai/inference/core/base_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,379 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,381 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,383 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,386 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,388 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,390 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,392 copying build/lib/colossalai/inference/core/diffusion_engine.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/core 2024-10-21T04:17:28,394 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,397 creating build/bdist.linux-armv7l/wheel/colossalai/inference/executor 2024-10-21T04:17:28,398 copying build/lib/colossalai/inference/executor/rpc_worker.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-10-21T04:17:28,400 copying build/lib/colossalai/inference/executor/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/executor 2024-10-21T04:17:28,402 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-10-21T04:17:28,403 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-10-21T04:17:28,405 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-10-21T04:17:28,406 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-10-21T04:17:28,409 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-10-21T04:17:28,410 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/server 2024-10-21T04:17:28,411 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,414 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,416 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-10-21T04:17:28,417 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-10-21T04:17:28,419 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-10-21T04:17:28,421 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/spec 2024-10-21T04:17:28,423 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,425 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,428 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,429 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,432 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-10-21T04:17:28,433 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-10-21T04:17:28,436 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-10-21T04:17:28,438 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/kv_cache 2024-10-21T04:17:28,440 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,443 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-10-21T04:17:28,444 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-10-21T04:17:28,445 copying build/lib/colossalai/inference/modeling/policy/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,447 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,449 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,451 copying build/lib/colossalai/inference/modeling/policy/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,453 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,455 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/policy 2024-10-21T04:17:28,457 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-10-21T04:17:28,458 copying build/lib/colossalai/inference/modeling/models/stablediffusion3.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,460 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,462 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,465 copying build/lib/colossalai/inference/modeling/models/pixart_alpha.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,467 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,468 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/models 2024-10-21T04:17:28,471 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-10-21T04:17:28,472 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-10-21T04:17:28,474 copying build/lib/colossalai/inference/modeling/layers/diffusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-10-21T04:17:28,475 copying build/lib/colossalai/inference/modeling/layers/distrifusion.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-10-21T04:17:28,478 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-10-21T04:17:28,481 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/layers 2024-10-21T04:17:28,483 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/backends 2024-10-21T04:17:28,483 copying build/lib/colossalai/inference/modeling/backends/pre_attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-10-21T04:17:28,486 copying build/lib/colossalai/inference/modeling/backends/attention_backend.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-10-21T04:17:28,488 copying build/lib/colossalai/inference/modeling/backends/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling/backends 2024-10-21T04:17:28,489 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference/modeling 2024-10-21T04:17:28,491 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/./colossalai/inference 2024-10-21T04:17:28,493 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-10-21T04:17:28,494 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,497 copying build/lib/colossalai/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,499 copying build/lib/colossalai/quantization/fp8.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,501 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,503 copying build/lib/colossalai/quantization/fp8_hook.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,505 copying build/lib/colossalai/quantization/fp8_config.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,506 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/quantization 2024-10-21T04:17:28,509 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-10-21T04:17:28,509 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-10-21T04:17:28,512 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/moe 2024-10-21T04:17:28,514 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-10-21T04:17:28,514 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-10-21T04:17:28,517 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-10-21T04:17:28,519 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-10-21T04:17:28,521 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/./colossalai/lazy 2024-10-21T04:17:28,523 running install_egg_info 2024-10-21T04:17:28,556 running egg_info 2024-10-21T04:17:28,583 writing colossalai.egg-info/PKG-INFO 2024-10-21T04:17:28,588 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-10-21T04:17:28,590 writing entry points to colossalai.egg-info/entry_points.txt 2024-10-21T04:17:28,591 writing requirements to colossalai.egg-info/requires.txt 2024-10-21T04:17:28,593 writing top-level names to colossalai.egg-info/top_level.txt 2024-10-21T04:17:28,872 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-10-21T04:17:28,963 reading manifest template 'MANIFEST.in' 2024-10-21T04:17:30,267 warning: no files found matching '*.tr' under directory 'colossalai' 2024-10-21T04:17:30,909 warning: no files found matching '*.cc' under directory 'colossalai' 2024-10-21T04:17:31,245 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-10-21T04:17:31,382 warning: no files found matching '*.tr' under directory 'extensions' 2024-10-21T04:17:31,437 warning: no files found matching '*.cc' under directory 'extensions' 2024-10-21T04:17:31,466 warning: no files found matching '*.pyi' under directory 'extensions' 2024-10-21T04:17:31,466 adding license file 'LICENSE' 2024-10-21T04:17:31,534 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-10-21T04:17:31,537 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/./colossalai-0.4.5-py3.9.egg-info 2024-10-21T04:17:31,550 running install_scripts 2024-10-21T04:17:31,578 creating build/bdist.linux-armv7l/wheel/colossalai-0.4.5.dist-info/WHEEL 2024-10-21T04:17:31,580 creating '/tmp/pip-wheel-wc2x3vkk/colossalai-0.4.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-10-21T04:17:31,583 adding 'colossalai/__init__.py' 2024-10-21T04:17:31,584 adding 'colossalai/initialize.py' 2024-10-21T04:17:31,586 adding 'colossalai/version.py' 2024-10-21T04:17:31,587 adding 'colossalai/_C/__init__.py' 2024-10-21T04:17:31,589 adding 'colossalai/_analyzer/__init__.py' 2024-10-21T04:17:31,590 adding 'colossalai/_analyzer/envs.py' 2024-10-21T04:17:31,591 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-10-21T04:17:31,594 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-10-21T04:17:31,595 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-10-21T04:17:31,598 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-10-21T04:17:31,600 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-10-21T04:17:31,601 adding 'colossalai/_analyzer/fx/__init__.py' 2024-10-21T04:17:31,604 adding 'colossalai/_analyzer/fx/codegen.py' 2024-10-21T04:17:31,606 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-10-21T04:17:31,608 adding 'colossalai/_analyzer/fx/node_util.py' 2024-10-21T04:17:31,609 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-10-21T04:17:31,611 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-10-21T04:17:31,613 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-10-21T04:17:31,615 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-10-21T04:17:31,616 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-10-21T04:17:31,618 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-10-21T04:17:31,619 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-10-21T04:17:31,620 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-10-21T04:17:31,622 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-10-21T04:17:31,624 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-10-21T04:17:31,626 adding 'colossalai/accelerator/__init__.py' 2024-10-21T04:17:31,627 adding 'colossalai/accelerator/api.py' 2024-10-21T04:17:31,629 adding 'colossalai/accelerator/base_accelerator.py' 2024-10-21T04:17:31,630 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-10-21T04:17:31,632 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-10-21T04:17:31,634 adding 'colossalai/accelerator/npu_accelerator.py' 2024-10-21T04:17:31,635 adding 'colossalai/amp/__init__.py' 2024-10-21T04:17:31,637 adding 'colossalai/amp/naive_amp/__init__.py' 2024-10-21T04:17:31,639 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-10-21T04:17:31,641 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-10-21T04:17:31,642 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-10-21T04:17:31,643 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-10-21T04:17:31,645 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-10-21T04:17:31,647 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-10-21T04:17:31,648 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-10-21T04:17:31,649 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-10-21T04:17:31,650 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-10-21T04:17:31,652 adding 'colossalai/auto_parallel/__init__.py' 2024-10-21T04:17:31,654 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-10-21T04:17:31,655 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-10-21T04:17:31,657 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-10-21T04:17:31,658 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-10-21T04:17:31,660 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-10-21T04:17:31,662 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-10-21T04:17:31,663 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-10-21T04:17:31,665 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-10-21T04:17:31,666 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-10-21T04:17:31,667 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-10-21T04:17:31,669 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-10-21T04:17:31,671 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-10-21T04:17:31,672 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-10-21T04:17:31,674 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-10-21T04:17:31,675 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-10-21T04:17:31,678 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-10-21T04:17:31,679 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-10-21T04:17:31,681 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-10-21T04:17:31,682 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-10-21T04:17:31,684 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-10-21T04:17:31,685 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-10-21T04:17:31,687 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-10-21T04:17:31,688 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-10-21T04:17:31,690 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-10-21T04:17:31,691 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-10-21T04:17:31,692 adding 'colossalai/auto_parallel/offload/region.py' 2024-10-21T04:17:31,695 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-10-21T04:17:31,697 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-10-21T04:17:31,699 adding 'colossalai/auto_parallel/offload/solver.py' 2024-10-21T04:17:31,702 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-10-21T04:17:31,703 adding 'colossalai/auto_parallel/offload/util.py' 2024-10-21T04:17:31,705 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-10-21T04:17:31,706 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-10-21T04:17:31,707 adding 'colossalai/auto_parallel/passes/constants.py' 2024-10-21T04:17:31,709 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-10-21T04:17:31,711 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-10-21T04:17:31,714 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-10-21T04:17:31,716 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-10-21T04:17:31,717 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-10-21T04:17:31,719 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-10-21T04:17:31,721 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-10-21T04:17:31,722 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-10-21T04:17:31,724 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-10-21T04:17:31,726 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-10-21T04:17:31,728 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-10-21T04:17:31,729 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-10-21T04:17:31,730 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-10-21T04:17:31,732 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-10-21T04:17:31,733 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-10-21T04:17:31,735 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-10-21T04:17:31,736 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-10-21T04:17:31,738 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-10-21T04:17:31,739 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-10-21T04:17:31,741 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-10-21T04:17:31,743 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-10-21T04:17:31,745 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-10-21T04:17:31,748 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-10-21T04:17:31,749 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-10-21T04:17:31,750 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-10-21T04:17:31,752 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-10-21T04:17:31,753 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-10-21T04:17:31,754 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-10-21T04:17:31,755 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-10-21T04:17:31,756 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-10-21T04:17:31,758 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-10-21T04:17:31,759 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-10-21T04:17:31,760 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-10-21T04:17:31,762 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-10-21T04:17:31,763 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-10-21T04:17:31,764 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-10-21T04:17:31,766 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-10-21T04:17:31,768 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-10-21T04:17:31,770 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-10-21T04:17:31,772 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-10-21T04:17:31,773 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-10-21T04:17:31,775 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-10-21T04:17:31,776 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-10-21T04:17:31,778 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-10-21T04:17:31,781 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-10-21T04:17:31,783 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-10-21T04:17:31,784 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-10-21T04:17:31,786 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-10-21T04:17:31,788 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-10-21T04:17:31,789 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-10-21T04:17:31,791 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-10-21T04:17:31,793 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-10-21T04:17:31,795 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-10-21T04:17:31,796 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-10-21T04:17:31,797 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-10-21T04:17:31,799 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-10-21T04:17:31,801 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-10-21T04:17:31,802 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-10-21T04:17:31,805 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-10-21T04:17:31,807 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-10-21T04:17:31,809 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-10-21T04:17:31,810 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-10-21T04:17:31,812 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-10-21T04:17:31,813 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-10-21T04:17:31,815 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-10-21T04:17:31,817 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-10-21T04:17:31,818 adding 'colossalai/booster/__init__.py' 2024-10-21T04:17:31,819 adding 'colossalai/booster/accelerator.py' 2024-10-21T04:17:31,822 adding 'colossalai/booster/booster.py' 2024-10-21T04:17:31,824 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-10-21T04:17:31,825 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-10-21T04:17:31,826 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-10-21T04:17:31,827 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-10-21T04:17:31,829 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-10-21T04:17:31,830 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-10-21T04:17:31,831 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-10-21T04:17:31,833 adding 'colossalai/booster/plugin/__init__.py' 2024-10-21T04:17:31,835 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-10-21T04:17:31,838 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-10-21T04:17:31,845 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-10-21T04:17:31,849 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-10-21T04:17:31,852 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-10-21T04:17:31,853 adding 'colossalai/booster/plugin/plugin_base.py' 2024-10-21T04:17:31,855 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-10-21T04:17:31,857 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-10-21T04:17:31,859 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-10-21T04:17:31,861 adding 'colossalai/checkpoint_io/__init__.py' 2024-10-21T04:17:31,863 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-10-21T04:17:31,865 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-10-21T04:17:31,869 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-10-21T04:17:31,871 adding 'colossalai/checkpoint_io/index_file.py' 2024-10-21T04:17:31,875 adding 'colossalai/checkpoint_io/moe_checkpoint.py' 2024-10-21T04:17:31,879 adding 'colossalai/checkpoint_io/utils.py' 2024-10-21T04:17:31,881 adding 'colossalai/cli/__init__.py' 2024-10-21T04:17:31,882 adding 'colossalai/cli/cli.py' 2024-10-21T04:17:31,884 adding 'colossalai/cli/check/__init__.py' 2024-10-21T04:17:31,885 adding 'colossalai/cli/check/check_installation.py' 2024-10-21T04:17:31,887 adding 'colossalai/cli/launcher/__init__.py' 2024-10-21T04:17:31,889 adding 'colossalai/cli/launcher/hostinfo.py' 2024-10-21T04:17:31,890 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-10-21T04:17:31,892 adding 'colossalai/cli/launcher/run.py' 2024-10-21T04:17:31,894 adding 'colossalai/cluster/__init__.py' 2024-10-21T04:17:31,895 adding 'colossalai/cluster/device_mesh_manager.py' 2024-10-21T04:17:31,897 adding 'colossalai/cluster/dist_coordinator.py' 2024-10-21T04:17:31,899 adding 'colossalai/cluster/process_group_manager.py' 2024-10-21T04:17:31,900 adding 'colossalai/cluster/process_group_mesh.py' 2024-10-21T04:17:31,902 adding 'colossalai/context/__init__.py' 2024-10-21T04:17:31,903 adding 'colossalai/context/config.py' 2024-10-21T04:17:31,905 adding 'colossalai/context/singleton_meta.py' 2024-10-21T04:17:31,906 adding 'colossalai/device/__init__.py' 2024-10-21T04:17:31,909 adding 'colossalai/device/alpha_beta_profiler.py' 2024-10-21T04:17:31,910 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-10-21T04:17:31,913 adding 'colossalai/device/device_mesh.py' 2024-10-21T04:17:31,915 adding 'colossalai/fx/__init__.py' 2024-10-21T04:17:31,916 adding 'colossalai/fx/_compatibility.py' 2024-10-21T04:17:31,919 adding 'colossalai/fx/_meta_regist_12.py' 2024-10-21T04:17:31,920 adding 'colossalai/fx/_meta_regist_13.py' 2024-10-21T04:17:31,922 adding 'colossalai/fx/graph_module.py' 2024-10-21T04:17:31,923 adding 'colossalai/fx/proxy.py' 2024-10-21T04:17:31,925 adding 'colossalai/fx/codegen/__init__.py' 2024-10-21T04:17:31,929 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-10-21T04:17:31,931 adding 'colossalai/fx/passes/__init__.py' 2024-10-21T04:17:31,934 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-10-21T04:17:31,936 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-10-21T04:17:31,938 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-10-21T04:17:31,940 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-10-21T04:17:31,942 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-10-21T04:17:31,944 adding 'colossalai/fx/passes/split_module.py' 2024-10-21T04:17:31,946 adding 'colossalai/fx/passes/utils.py' 2024-10-21T04:17:31,947 adding 'colossalai/fx/profiler/__init__.py' 2024-10-21T04:17:31,949 adding 'colossalai/fx/profiler/constants.py' 2024-10-21T04:17:31,950 adding 'colossalai/fx/profiler/dataflow.py' 2024-10-21T04:17:31,952 adding 'colossalai/fx/profiler/memory_utils.py' 2024-10-21T04:17:31,954 adding 'colossalai/fx/profiler/opcount.py' 2024-10-21T04:17:31,956 adding 'colossalai/fx/profiler/profiler.py' 2024-10-21T04:17:31,957 adding 'colossalai/fx/profiler/shard_utils.py' 2024-10-21T04:17:31,959 adding 'colossalai/fx/profiler/tensor.py' 2024-10-21T04:17:31,961 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-10-21T04:17:31,962 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-10-21T04:17:31,963 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-10-21T04:17:31,967 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-10-21T04:17:31,968 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-10-21T04:17:31,970 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-10-21T04:17:31,971 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-10-21T04:17:31,973 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-10-21T04:17:31,974 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-10-21T04:17:31,975 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-10-21T04:17:31,977 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-10-21T04:17:31,978 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-10-21T04:17:31,979 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-10-21T04:17:31,980 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-10-21T04:17:31,982 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-10-21T04:17:31,983 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-10-21T04:17:31,984 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-10-21T04:17:31,986 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-10-21T04:17:31,987 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-10-21T04:17:31,988 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-10-21T04:17:31,989 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-10-21T04:17:31,991 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-10-21T04:17:31,992 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-10-21T04:17:31,993 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-10-21T04:17:31,995 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-10-21T04:17:31,997 adding 'colossalai/fx/tracer/__init__.py' 2024-10-21T04:17:31,998 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-10-21T04:17:31,999 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-10-21T04:17:32,001 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-10-21T04:17:32,004 adding 'colossalai/fx/tracer/experimental.py' 2024-10-21T04:17:32,005 adding 'colossalai/fx/tracer/registry.py' 2024-10-21T04:17:32,008 adding 'colossalai/fx/tracer/tracer.py' 2024-10-21T04:17:32,010 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-10-21T04:17:32,012 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-10-21T04:17:32,013 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-10-21T04:17:32,015 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-10-21T04:17:32,016 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-10-21T04:17:32,017 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-10-21T04:17:32,019 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-10-21T04:17:32,021 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-10-21T04:17:32,022 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-10-21T04:17:32,023 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-10-21T04:17:32,025 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-10-21T04:17:32,026 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-10-21T04:17:32,027 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-10-21T04:17:32,029 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-10-21T04:17:32,030 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-10-21T04:17:32,031 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-10-21T04:17:32,033 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-10-21T04:17:32,034 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-10-21T04:17:32,036 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-10-21T04:17:32,037 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-10-21T04:17:32,038 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-10-21T04:17:32,040 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-10-21T04:17:32,041 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-10-21T04:17:32,042 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-10-21T04:17:32,043 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-10-21T04:17:32,045 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-10-21T04:17:32,046 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-10-21T04:17:32,048 adding 'colossalai/inference/__init__.py' 2024-10-21T04:17:32,051 adding 'colossalai/inference/batch_bucket.py' 2024-10-21T04:17:32,054 adding 'colossalai/inference/config.py' 2024-10-21T04:17:32,055 adding 'colossalai/inference/flash_decoding_utils.py' 2024-10-21T04:17:32,057 adding 'colossalai/inference/graph_runner.py' 2024-10-21T04:17:32,059 adding 'colossalai/inference/logit_processors.py' 2024-10-21T04:17:32,060 adding 'colossalai/inference/sampler.py' 2024-10-21T04:17:32,062 adding 'colossalai/inference/struct.py' 2024-10-21T04:17:32,063 adding 'colossalai/inference/utils.py' 2024-10-21T04:17:32,065 adding 'colossalai/inference/core/__init__.py' 2024-10-21T04:17:32,067 adding 'colossalai/inference/core/async_engine.py' 2024-10-21T04:17:32,068 adding 'colossalai/inference/core/base_engine.py' 2024-10-21T04:17:32,070 adding 'colossalai/inference/core/diffusion_engine.py' 2024-10-21T04:17:32,071 adding 'colossalai/inference/core/engine.py' 2024-10-21T04:17:32,076 adding 'colossalai/inference/core/llm_engine.py' 2024-10-21T04:17:32,077 adding 'colossalai/inference/core/plugin.py' 2024-10-21T04:17:32,080 adding 'colossalai/inference/core/request_handler.py' 2024-10-21T04:17:32,082 adding 'colossalai/inference/core/rpc_engine.py' 2024-10-21T04:17:32,083 adding 'colossalai/inference/executor/__init__.py' 2024-10-21T04:17:32,086 adding 'colossalai/inference/executor/rpc_worker.py' 2024-10-21T04:17:32,087 adding 'colossalai/inference/kv_cache/__init__.py' 2024-10-21T04:17:32,089 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-10-21T04:17:32,092 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-10-21T04:17:32,094 adding 'colossalai/inference/modeling/__init__.py' 2024-10-21T04:17:32,095 adding 'colossalai/inference/modeling/backends/__init__.py' 2024-10-21T04:17:32,097 adding 'colossalai/inference/modeling/backends/attention_backend.py' 2024-10-21T04:17:32,098 adding 'colossalai/inference/modeling/backends/pre_attention_backend.py' 2024-10-21T04:17:32,100 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-10-21T04:17:32,101 adding 'colossalai/inference/modeling/layers/attention.py' 2024-10-21T04:17:32,103 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-10-21T04:17:32,104 adding 'colossalai/inference/modeling/layers/diffusion.py' 2024-10-21T04:17:32,107 adding 'colossalai/inference/modeling/layers/distrifusion.py' 2024-10-21T04:17:32,109 adding 'colossalai/inference/modeling/models/__init__.py' 2024-10-21T04:17:32,111 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-10-21T04:17:32,113 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-10-21T04:17:32,117 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-10-21T04:17:32,119 adding 'colossalai/inference/modeling/models/pixart_alpha.py' 2024-10-21T04:17:32,120 adding 'colossalai/inference/modeling/models/stablediffusion3.py' 2024-10-21T04:17:32,122 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-10-21T04:17:32,123 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-10-21T04:17:32,125 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-10-21T04:17:32,126 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-10-21T04:17:32,127 adding 'colossalai/inference/modeling/policy/pixart_alpha.py' 2024-10-21T04:17:32,129 adding 'colossalai/inference/modeling/policy/stablediffusion3.py' 2024-10-21T04:17:32,130 adding 'colossalai/inference/server/__init__.py' 2024-10-21T04:17:32,132 adding 'colossalai/inference/server/api_server.py' 2024-10-21T04:17:32,134 adding 'colossalai/inference/server/chat_service.py' 2024-10-21T04:17:32,135 adding 'colossalai/inference/server/completion_service.py' 2024-10-21T04:17:32,136 adding 'colossalai/inference/server/utils.py' 2024-10-21T04:17:32,138 adding 'colossalai/inference/spec/__init__.py' 2024-10-21T04:17:32,139 adding 'colossalai/inference/spec/drafter.py' 2024-10-21T04:17:32,140 adding 'colossalai/inference/spec/struct.py' 2024-10-21T04:17:32,142 adding 'colossalai/interface/__init__.py' 2024-10-21T04:17:32,143 adding 'colossalai/interface/model.py' 2024-10-21T04:17:32,145 adding 'colossalai/interface/optimizer.py' 2024-10-21T04:17:32,146 adding 'colossalai/interface/pretrained.py' 2024-10-21T04:17:32,147 adding 'colossalai/kernel/__init__.py' 2024-10-21T04:17:32,149 adding 'colossalai/kernel/kernel_loader.py' 2024-10-21T04:17:32,151 adding 'colossalai/kernel/extensions/__init__.py' 2024-10-21T04:17:32,152 adding 'colossalai/kernel/extensions/base_extension.py' 2024-10-21T04:17:32,153 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-10-21T04:17:32,155 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-10-21T04:17:32,156 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-10-21T04:17:32,158 adding 'colossalai/kernel/extensions/utils.py' 2024-10-21T04:17:32,160 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-10-21T04:17:32,161 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-10-21T04:17:32,163 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-10-21T04:17:32,164 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-10-21T04:17:32,166 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-10-21T04:17:32,167 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-10-21T04:17:32,169 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-10-21T04:17:32,171 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-10-21T04:17:32,173 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-10-21T04:17:32,174 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-10-21T04:17:32,176 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-10-21T04:17:32,178 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-10-21T04:17:32,180 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-10-21T04:17:32,182 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-10-21T04:17:32,184 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-10-21T04:17:32,185 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-10-21T04:17:32,187 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-10-21T04:17:32,191 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-10-21T04:17:32,193 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-10-21T04:17:32,195 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-10-21T04:17:32,198 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-10-21T04:17:32,201 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-10-21T04:17:32,202 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-10-21T04:17:32,204 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-10-21T04:17:32,206 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-10-21T04:17:32,208 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-10-21T04:17:32,210 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-10-21T04:17:32,211 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-10-21T04:17:32,213 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-10-21T04:17:32,216 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-10-21T04:17:32,218 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-10-21T04:17:32,220 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-10-21T04:17:32,222 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-10-21T04:17:32,223 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-10-21T04:17:32,225 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-10-21T04:17:32,226 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-10-21T04:17:32,229 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-10-21T04:17:32,230 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-10-21T04:17:32,232 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-10-21T04:17:32,234 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-10-21T04:17:32,235 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-10-21T04:17:32,236 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-10-21T04:17:32,238 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-10-21T04:17:32,239 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-10-21T04:17:32,241 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-10-21T04:17:32,242 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-10-21T04:17:32,243 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-10-21T04:17:32,245 adding 'colossalai/kernel/extensions/pybind/inference/inference.cpp' 2024-10-21T04:17:32,246 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-10-21T04:17:32,248 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-10-21T04:17:32,249 adding 'colossalai/kernel/extensions/pybind/layernorm/layer_norm.cpp' 2024-10-21T04:17:32,250 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-10-21T04:17:32,252 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-10-21T04:17:32,253 adding 'colossalai/kernel/extensions/pybind/moe/moe.cpp' 2024-10-21T04:17:32,255 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-10-21T04:17:32,257 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-10-21T04:17:32,258 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-10-21T04:17:32,259 adding 'colossalai/kernel/extensions/pybind/optimizer/optimizer.cpp' 2024-10-21T04:17:32,261 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-10-21T04:17:32,262 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax.cpp' 2024-10-21T04:17:32,264 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-10-21T04:17:32,265 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triang_masked_softmax.cpp' 2024-10-21T04:17:32,266 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-10-21T04:17:32,268 adding 'colossalai/kernel/jit/__init__.py' 2024-10-21T04:17:32,269 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-10-21T04:17:32,270 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-10-21T04:17:32,271 adding 'colossalai/kernel/jit/option.py' 2024-10-21T04:17:32,273 adding 'colossalai/kernel/triton/__init__.py' 2024-10-21T04:17:32,276 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-10-21T04:17:32,279 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-10-21T04:17:32,280 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-10-21T04:17:32,282 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-10-21T04:17:32,284 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-10-21T04:17:32,286 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-10-21T04:17:32,288 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-10-21T04:17:32,289 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-10-21T04:17:32,290 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-10-21T04:17:32,292 adding 'colossalai/kernel/triton/softmax.py' 2024-10-21T04:17:32,294 adding 'colossalai/lazy/__init__.py' 2024-10-21T04:17:32,295 adding 'colossalai/lazy/construction.py' 2024-10-21T04:17:32,299 adding 'colossalai/lazy/lazy_init.py' 2024-10-21T04:17:32,301 adding 'colossalai/lazy/pretrained.py' 2024-10-21T04:17:32,303 adding 'colossalai/legacy/__init__.py' 2024-10-21T04:17:32,304 adding 'colossalai/legacy/constants.py' 2024-10-21T04:17:32,305 adding 'colossalai/legacy/core.py' 2024-10-21T04:17:32,307 adding 'colossalai/legacy/global_variables.py' 2024-10-21T04:17:32,309 adding 'colossalai/legacy/initialize.py' 2024-10-21T04:17:32,311 adding 'colossalai/legacy/amp/__init__.py' 2024-10-21T04:17:32,312 adding 'colossalai/legacy/amp/amp_type.py' 2024-10-21T04:17:32,314 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-10-21T04:17:32,315 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-10-21T04:17:32,317 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-10-21T04:17:32,319 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-10-21T04:17:32,321 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-10-21T04:17:32,322 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-10-21T04:17:32,324 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-10-21T04:17:32,328 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-10-21T04:17:32,329 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-10-21T04:17:32,331 adding 'colossalai/legacy/builder/__init__.py' 2024-10-21T04:17:32,332 adding 'colossalai/legacy/builder/builder.py' 2024-10-21T04:17:32,334 adding 'colossalai/legacy/communication/__init__.py' 2024-10-21T04:17:32,335 adding 'colossalai/legacy/communication/collective.py' 2024-10-21T04:17:32,338 adding 'colossalai/legacy/communication/p2p.py' 2024-10-21T04:17:32,339 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-10-21T04:17:32,341 adding 'colossalai/legacy/communication/ring.py' 2024-10-21T04:17:32,342 adding 'colossalai/legacy/communication/utils.py' 2024-10-21T04:17:32,344 adding 'colossalai/legacy/context/__init__.py' 2024-10-21T04:17:32,347 adding 'colossalai/legacy/context/parallel_context.py' 2024-10-21T04:17:32,348 adding 'colossalai/legacy/context/parallel_mode.py' 2024-10-21T04:17:32,350 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-10-21T04:17:32,351 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-10-21T04:17:32,353 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-10-21T04:17:32,355 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-10-21T04:17:32,356 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-10-21T04:17:32,358 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-10-21T04:17:32,359 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-10-21T04:17:32,361 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-10-21T04:17:32,362 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-10-21T04:17:32,363 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-10-21T04:17:32,365 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-10-21T04:17:32,367 adding 'colossalai/legacy/context/random/__init__.py' 2024-10-21T04:17:32,368 adding 'colossalai/legacy/context/random/_helper.py' 2024-10-21T04:17:32,369 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-10-21T04:17:32,371 adding 'colossalai/legacy/engine/__init__.py' 2024-10-21T04:17:32,373 adding 'colossalai/legacy/engine/_base_engine.py' 2024-10-21T04:17:32,374 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-10-21T04:17:32,376 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-10-21T04:17:32,378 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-10-21T04:17:32,380 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-10-21T04:17:32,381 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-10-21T04:17:32,382 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-10-21T04:17:32,383 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-10-21T04:17:32,385 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-10-21T04:17:32,386 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-10-21T04:17:32,387 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-10-21T04:17:32,389 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-10-21T04:17:32,391 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-10-21T04:17:32,392 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-10-21T04:17:32,396 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-10-21T04:17:32,398 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-10-21T04:17:32,400 adding 'colossalai/legacy/inference/__init__.py' 2024-10-21T04:17:32,401 adding 'colossalai/legacy/inference/async_engine.py' 2024-10-21T04:17:32,403 adding 'colossalai/legacy/inference/async_manager.py' 2024-10-21T04:17:32,405 adding 'colossalai/legacy/inference/manager.py' 2024-10-21T04:17:32,407 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-10-21T04:17:32,408 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-10-21T04:17:32,410 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-10-21T04:17:32,411 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-10-21T04:17:32,413 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-10-21T04:17:32,415 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-10-21T04:17:32,416 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-10-21T04:17:32,417 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-10-21T04:17:32,419 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-10-21T04:17:32,420 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-10-21T04:17:32,422 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-10-21T04:17:32,424 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-10-21T04:17:32,425 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-10-21T04:17:32,427 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-10-21T04:17:32,429 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-10-21T04:17:32,431 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-10-21T04:17:32,432 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-10-21T04:17:32,434 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-10-21T04:17:32,436 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-10-21T04:17:32,437 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-10-21T04:17:32,440 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-10-21T04:17:32,441 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-10-21T04:17:32,443 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-10-21T04:17:32,444 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-10-21T04:17:32,447 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-10-21T04:17:32,450 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-10-21T04:17:32,453 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-10-21T04:17:32,454 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-10-21T04:17:32,456 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-10-21T04:17:32,457 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-10-21T04:17:32,459 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-10-21T04:17:32,460 adding 'colossalai/legacy/nn/__init__.py' 2024-10-21T04:17:32,462 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-10-21T04:17:32,463 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-10-21T04:17:32,465 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-10-21T04:17:32,467 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-10-21T04:17:32,469 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-10-21T04:17:32,470 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-10-21T04:17:32,471 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-10-21T04:17:32,473 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-10-21T04:17:32,474 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-10-21T04:17:32,475 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-10-21T04:17:32,477 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-10-21T04:17:32,479 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-10-21T04:17:32,480 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-10-21T04:17:32,484 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-10-21T04:17:32,486 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-10-21T04:17:32,489 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-10-21T04:17:32,490 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-10-21T04:17:32,494 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-10-21T04:17:32,496 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-10-21T04:17:32,499 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-10-21T04:17:32,501 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-10-21T04:17:32,505 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-10-21T04:17:32,507 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-10-21T04:17:32,509 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-10-21T04:17:32,510 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-10-21T04:17:32,514 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-10-21T04:17:32,516 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-10-21T04:17:32,518 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-10-21T04:17:32,519 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-10-21T04:17:32,521 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-10-21T04:17:32,523 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-10-21T04:17:32,524 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-10-21T04:17:32,525 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-10-21T04:17:32,527 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-10-21T04:17:32,529 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-10-21T04:17:32,531 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-10-21T04:17:32,532 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-10-21T04:17:32,534 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-10-21T04:17:32,535 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-10-21T04:17:32,537 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-10-21T04:17:32,539 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-10-21T04:17:32,540 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-10-21T04:17:32,541 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-10-21T04:17:32,543 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-10-21T04:17:32,544 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-10-21T04:17:32,545 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-10-21T04:17:32,547 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-10-21T04:17:32,548 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-10-21T04:17:32,550 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-10-21T04:17:32,551 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-10-21T04:17:32,553 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-10-21T04:17:32,554 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-10-21T04:17:32,555 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-10-21T04:17:32,556 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-10-21T04:17:32,558 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-10-21T04:17:32,559 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-10-21T04:17:32,563 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-10-21T04:17:32,565 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-10-21T04:17:32,566 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-10-21T04:17:32,567 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-10-21T04:17:32,569 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-10-21T04:17:32,570 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-10-21T04:17:32,572 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-10-21T04:17:32,574 adding 'colossalai/legacy/pipeline/__init__.py' 2024-10-21T04:17:32,575 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-10-21T04:17:32,577 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-10-21T04:17:32,578 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-10-21T04:17:32,580 adding 'colossalai/legacy/pipeline/utils.py' 2024-10-21T04:17:32,582 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-10-21T04:17:32,583 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-10-21T04:17:32,585 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-10-21T04:17:32,587 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-10-21T04:17:32,588 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-10-21T04:17:32,594 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-10-21T04:17:32,597 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-10-21T04:17:32,598 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-10-21T04:17:32,600 adding 'colossalai/legacy/registry/__init__.py' 2024-10-21T04:17:32,601 adding 'colossalai/legacy/registry/registry.py' 2024-10-21T04:17:32,603 adding 'colossalai/legacy/tensor/__init__.py' 2024-10-21T04:17:32,605 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-10-21T04:17:32,606 adding 'colossalai/legacy/tensor/const.py' 2024-10-21T04:17:32,607 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-10-21T04:17:32,609 adding 'colossalai/legacy/tensor/distspec.py' 2024-10-21T04:17:32,610 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-10-21T04:17:32,612 adding 'colossalai/legacy/tensor/process_group.py' 2024-10-21T04:17:32,613 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-10-21T04:17:32,615 adding 'colossalai/legacy/trainer/__init__.py' 2024-10-21T04:17:32,617 adding 'colossalai/legacy/trainer/_trainer.py' 2024-10-21T04:17:32,619 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-10-21T04:17:32,620 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-10-21T04:17:32,621 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-10-21T04:17:32,622 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-10-21T04:17:32,624 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-10-21T04:17:32,626 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-10-21T04:17:32,628 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-10-21T04:17:32,630 adding 'colossalai/legacy/utils/__init__.py' 2024-10-21T04:17:32,632 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-10-21T04:17:32,634 adding 'colossalai/legacy/utils/checkpointing.py' 2024-10-21T04:17:32,636 adding 'colossalai/legacy/utils/common.py' 2024-10-21T04:17:32,638 adding 'colossalai/legacy/utils/memory.py' 2024-10-21T04:17:32,639 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-10-21T04:17:32,641 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-10-21T04:17:32,642 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-10-21T04:17:32,644 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-10-21T04:17:32,645 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-10-21T04:17:32,646 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-10-21T04:17:32,648 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-10-21T04:17:32,649 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-10-21T04:17:32,651 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-10-21T04:17:32,652 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-10-21T04:17:32,654 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-10-21T04:17:32,656 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-10-21T04:17:32,657 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-10-21T04:17:32,659 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-10-21T04:17:32,661 adding 'colossalai/legacy/zero/__init__.py' 2024-10-21T04:17:32,663 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-10-21T04:17:32,665 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-10-21T04:17:32,666 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-10-21T04:17:32,668 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-10-21T04:17:32,669 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-10-21T04:17:32,671 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-10-21T04:17:32,672 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-10-21T04:17:32,674 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-10-21T04:17:32,675 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-10-21T04:17:32,676 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-10-21T04:17:32,678 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-10-21T04:17:32,679 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-10-21T04:17:32,681 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-10-21T04:17:32,682 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-10-21T04:17:32,684 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-10-21T04:17:32,685 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-10-21T04:17:32,687 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-10-21T04:17:32,689 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-10-21T04:17:32,690 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-10-21T04:17:32,691 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-10-21T04:17:32,692 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-10-21T04:17:32,694 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-10-21T04:17:32,695 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-10-21T04:17:32,697 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-10-21T04:17:32,701 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-10-21T04:17:32,702 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-10-21T04:17:32,704 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-10-21T04:17:32,705 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-10-21T04:17:32,708 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-10-21T04:17:32,710 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-10-21T04:17:32,711 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-10-21T04:17:32,712 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-10-21T04:17:32,714 adding 'colossalai/logging/__init__.py' 2024-10-21T04:17:32,716 adding 'colossalai/logging/logger.py' 2024-10-21T04:17:32,717 adding 'colossalai/moe/__init__.py' 2024-10-21T04:17:32,719 adding 'colossalai/moe/_operation.py' 2024-10-21T04:17:32,721 adding 'colossalai/nn/__init__.py' 2024-10-21T04:17:32,722 adding 'colossalai/nn/init.py' 2024-10-21T04:17:32,724 adding 'colossalai/nn/layer/__init__.py' 2024-10-21T04:17:32,725 adding 'colossalai/nn/layer/layernorm.py' 2024-10-21T04:17:32,727 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-10-21T04:17:32,728 adding 'colossalai/nn/layer/utils.py' 2024-10-21T04:17:32,730 adding 'colossalai/nn/loss/__init__.py' 2024-10-21T04:17:32,731 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-10-21T04:17:32,733 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-10-21T04:17:32,734 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-10-21T04:17:32,736 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-10-21T04:17:32,737 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-10-21T04:17:32,738 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-10-21T04:17:32,740 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-10-21T04:17:32,741 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-10-21T04:17:32,743 adding 'colossalai/nn/optimizer/__init__.py' 2024-10-21T04:17:32,745 adding 'colossalai/nn/optimizer/adafactor.py' 2024-10-21T04:17:32,746 adding 'colossalai/nn/optimizer/came.py' 2024-10-21T04:17:32,748 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-10-21T04:17:32,751 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-10-21T04:17:32,753 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-10-21T04:17:32,756 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-10-21T04:17:32,757 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-10-21T04:17:32,759 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-10-21T04:17:32,761 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-10-21T04:17:32,762 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-10-21T04:17:32,764 adding 'colossalai/nn/optimizer/galore.py' 2024-10-21T04:17:32,766 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-10-21T04:17:32,768 adding 'colossalai/nn/optimizer/lamb.py' 2024-10-21T04:17:32,769 adding 'colossalai/nn/optimizer/lars.py' 2024-10-21T04:17:32,771 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-10-21T04:17:32,773 adding 'colossalai/pipeline/__init__.py' 2024-10-21T04:17:32,776 adding 'colossalai/pipeline/p2p.py' 2024-10-21T04:17:32,778 adding 'colossalai/pipeline/stage_manager.py' 2024-10-21T04:17:32,779 adding 'colossalai/pipeline/schedule/__init__.py' 2024-10-21T04:17:32,781 adding 'colossalai/pipeline/schedule/_utils.py' 2024-10-21T04:17:32,782 adding 'colossalai/pipeline/schedule/base.py' 2024-10-21T04:17:32,785 adding 'colossalai/pipeline/schedule/generate.py' 2024-10-21T04:17:32,788 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-10-21T04:17:32,790 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-10-21T04:17:32,792 adding 'colossalai/quantization/__init__.py' 2024-10-21T04:17:32,794 adding 'colossalai/quantization/bnb.py' 2024-10-21T04:17:32,796 adding 'colossalai/quantization/bnb_config.py' 2024-10-21T04:17:32,800 adding 'colossalai/quantization/fp8.py' 2024-10-21T04:17:32,801 adding 'colossalai/quantization/fp8_config.py' 2024-10-21T04:17:32,802 adding 'colossalai/quantization/fp8_hook.py' 2024-10-21T04:17:32,804 adding 'colossalai/quantization/utils.py' 2024-10-21T04:17:32,806 adding 'colossalai/shardformer/__init__.py' 2024-10-21T04:17:32,807 adding 'colossalai/shardformer/_utils.py' 2024-10-21T04:17:32,809 adding 'colossalai/shardformer/layer/__init__.py' 2024-10-21T04:17:32,812 adding 'colossalai/shardformer/layer/_operation.py' 2024-10-21T04:17:32,818 adding 'colossalai/shardformer/layer/attn.py' 2024-10-21T04:17:32,820 adding 'colossalai/shardformer/layer/dropout.py' 2024-10-21T04:17:32,822 adding 'colossalai/shardformer/layer/embedding.py' 2024-10-21T04:17:32,825 adding 'colossalai/shardformer/layer/linear.py' 2024-10-21T04:17:32,827 adding 'colossalai/shardformer/layer/loss.py' 2024-10-21T04:17:32,829 adding 'colossalai/shardformer/layer/normalization.py' 2024-10-21T04:17:32,831 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-10-21T04:17:32,834 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-10-21T04:17:32,837 adding 'colossalai/shardformer/layer/utils.py' 2024-10-21T04:17:32,839 adding 'colossalai/shardformer/modeling/__init__.py' 2024-10-21T04:17:32,843 adding 'colossalai/shardformer/modeling/bert.py' 2024-10-21T04:17:32,845 adding 'colossalai/shardformer/modeling/blip2.py' 2024-10-21T04:17:32,849 adding 'colossalai/shardformer/modeling/bloom.py' 2024-10-21T04:17:32,852 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-10-21T04:17:32,856 adding 'colossalai/shardformer/modeling/command.py' 2024-10-21T04:17:32,860 adding 'colossalai/shardformer/modeling/deepseek.py' 2024-10-21T04:17:32,863 adding 'colossalai/shardformer/modeling/falcon.py' 2024-10-21T04:17:32,867 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-10-21T04:17:32,871 adding 'colossalai/shardformer/modeling/gptj.py' 2024-10-21T04:17:32,873 adding 'colossalai/shardformer/modeling/jit.py' 2024-10-21T04:17:32,876 adding 'colossalai/shardformer/modeling/llama.py' 2024-10-21T04:17:32,879 adding 'colossalai/shardformer/modeling/mistral.py' 2024-10-21T04:17:32,883 adding 'colossalai/shardformer/modeling/mixtral.py' 2024-10-21T04:17:32,888 adding 'colossalai/shardformer/modeling/opt.py' 2024-10-21T04:17:32,891 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-10-21T04:17:32,893 adding 'colossalai/shardformer/modeling/sam.py' 2024-10-21T04:17:32,896 adding 'colossalai/shardformer/modeling/t5.py' 2024-10-21T04:17:32,899 adding 'colossalai/shardformer/modeling/vit.py' 2024-10-21T04:17:32,904 adding 'colossalai/shardformer/modeling/whisper.py' 2024-10-21T04:17:32,906 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-10-21T04:17:32,908 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-10-21T04:17:32,913 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-10-21T04:17:32,916 adding 'colossalai/shardformer/policies/__init__.py' 2024-10-21T04:17:32,918 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-10-21T04:17:32,919 adding 'colossalai/shardformer/policies/base_policy.py' 2024-10-21T04:17:32,922 adding 'colossalai/shardformer/policies/bert.py' 2024-10-21T04:17:32,924 adding 'colossalai/shardformer/policies/blip2.py' 2024-10-21T04:17:32,926 adding 'colossalai/shardformer/policies/bloom.py' 2024-10-21T04:17:32,928 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-10-21T04:17:32,930 adding 'colossalai/shardformer/policies/command.py' 2024-10-21T04:17:32,932 adding 'colossalai/shardformer/policies/deepseek.py' 2024-10-21T04:17:32,934 adding 'colossalai/shardformer/policies/falcon.py' 2024-10-21T04:17:32,936 adding 'colossalai/shardformer/policies/gpt2.py' 2024-10-21T04:17:32,938 adding 'colossalai/shardformer/policies/gptj.py' 2024-10-21T04:17:32,940 adding 'colossalai/shardformer/policies/llama.py' 2024-10-21T04:17:32,942 adding 'colossalai/shardformer/policies/mistral.py' 2024-10-21T04:17:32,944 adding 'colossalai/shardformer/policies/mixtral.py' 2024-10-21T04:17:32,946 adding 'colossalai/shardformer/policies/opt.py' 2024-10-21T04:17:32,949 adding 'colossalai/shardformer/policies/qwen2.py' 2024-10-21T04:17:32,950 adding 'colossalai/shardformer/policies/sam.py' 2024-10-21T04:17:32,953 adding 'colossalai/shardformer/policies/t5.py' 2024-10-21T04:17:32,954 adding 'colossalai/shardformer/policies/vit.py' 2024-10-21T04:17:32,957 adding 'colossalai/shardformer/policies/whisper.py' 2024-10-21T04:17:32,959 adding 'colossalai/shardformer/shard/__init__.py' 2024-10-21T04:17:32,960 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-10-21T04:17:32,962 adding 'colossalai/shardformer/shard/shard_config.py' 2024-10-21T04:17:32,963 adding 'colossalai/shardformer/shard/sharder.py' 2024-10-21T04:17:32,965 adding 'colossalai/shardformer/shard/shardformer.py' 2024-10-21T04:17:32,966 adding 'colossalai/shardformer/shard/utils.py' 2024-10-21T04:17:32,968 adding 'colossalai/tensor/__init__.py' 2024-10-21T04:17:32,969 adding 'colossalai/tensor/colo_parameter.py' 2024-10-21T04:17:32,971 adding 'colossalai/tensor/colo_tensor.py' 2024-10-21T04:17:32,973 adding 'colossalai/tensor/comm_spec.py' 2024-10-21T04:17:32,975 adding 'colossalai/tensor/param_op_hook.py' 2024-10-21T04:17:32,978 adding 'colossalai/tensor/shape_consistency.py' 2024-10-21T04:17:32,980 adding 'colossalai/tensor/sharding_spec.py' 2024-10-21T04:17:32,982 adding 'colossalai/tensor/utils.py' 2024-10-21T04:17:32,984 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-10-21T04:17:32,986 adding 'colossalai/tensor/d_tensor/api.py' 2024-10-21T04:17:32,988 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-10-21T04:17:32,989 adding 'colossalai/tensor/d_tensor/layout.py' 2024-10-21T04:17:32,992 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-10-21T04:17:32,994 adding 'colossalai/tensor/d_tensor/misc.py' 2024-10-21T04:17:32,996 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-10-21T04:17:32,997 adding 'colossalai/tensor/d_tensor/utils.py' 2024-10-21T04:17:32,999 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-10-21T04:17:33,000 adding 'colossalai/tensor/moe_tensor/api.py' 2024-10-21T04:17:33,001 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-10-21T04:17:33,003 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-10-21T04:17:33,004 adding 'colossalai/tensor/padded_tensor/api.py' 2024-10-21T04:17:33,006 adding 'colossalai/testing/__init__.py' 2024-10-21T04:17:33,008 adding 'colossalai/testing/comparison.py' 2024-10-21T04:17:33,009 adding 'colossalai/testing/pytest_wrapper.py' 2024-10-21T04:17:33,010 adding 'colossalai/testing/random.py' 2024-10-21T04:17:33,012 adding 'colossalai/testing/utils.py' 2024-10-21T04:17:33,014 adding 'colossalai/utils/__init__.py' 2024-10-21T04:17:33,015 adding 'colossalai/utils/common.py' 2024-10-21T04:17:33,016 adding 'colossalai/utils/memory.py' 2024-10-21T04:17:33,018 adding 'colossalai/utils/safetensors.py' 2024-10-21T04:17:33,019 adding 'colossalai/utils/timer.py' 2024-10-21T04:17:33,021 adding 'colossalai/utils/model/__init__.py' 2024-10-21T04:17:33,022 adding 'colossalai/utils/model/utils.py' 2024-10-21T04:17:33,024 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-10-21T04:17:33,025 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-10-21T04:17:33,027 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-10-21T04:17:33,028 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-10-21T04:17:33,030 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-10-21T04:17:33,032 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-10-21T04:17:33,033 adding 'colossalai/zero/__init__.py' 2024-10-21T04:17:33,035 adding 'colossalai/zero/wrapper.py' 2024-10-21T04:17:33,037 adding 'colossalai/zero/gemini/__init__.py' 2024-10-21T04:17:33,041 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-10-21T04:17:33,043 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-10-21T04:17:33,045 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-10-21T04:17:33,049 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-10-21T04:17:33,051 adding 'colossalai/zero/gemini/placement_policy.py' 2024-10-21T04:17:33,053 adding 'colossalai/zero/gemini/utils.py' 2024-10-21T04:17:33,055 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-10-21T04:17:33,058 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-10-21T04:17:33,060 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-10-21T04:17:33,062 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-10-21T04:17:33,063 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-10-21T04:17:33,065 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-10-21T04:17:33,067 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-10-21T04:17:33,068 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-10-21T04:17:33,069 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-10-21T04:17:33,071 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-10-21T04:17:33,072 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-10-21T04:17:33,073 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-10-21T04:17:33,075 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-10-21T04:17:33,076 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-10-21T04:17:33,078 adding 'colossalai/zero/low_level/__init__.py' 2024-10-21T04:17:33,079 adding 'colossalai/zero/low_level/_utils.py' 2024-10-21T04:17:33,084 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-10-21T04:17:33,086 adding 'colossalai/zero/low_level/zero_hook.py' 2024-10-21T04:17:33,087 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-10-21T04:17:33,089 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-10-21T04:17:33,090 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-10-21T04:17:33,092 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-10-21T04:17:33,093 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-10-21T04:17:33,096 adding 'extensions/csrc/__init__.py' 2024-10-21T04:17:33,098 adding 'extensions/pybind/__init__.py' 2024-10-21T04:17:33,100 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-10-21T04:17:33,101 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-10-21T04:17:33,102 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-10-21T04:17:33,104 adding 'extensions/pybind/flash_attention/__init__.py' 2024-10-21T04:17:33,105 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-10-21T04:17:33,106 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-10-21T04:17:33,107 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-10-21T04:17:33,109 adding 'extensions/pybind/inference/__init__.py' 2024-10-21T04:17:33,110 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-10-21T04:17:33,112 adding 'extensions/pybind/layernorm/__init__.py' 2024-10-21T04:17:33,113 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-10-21T04:17:33,115 adding 'extensions/pybind/moe/__init__.py' 2024-10-21T04:17:33,116 adding 'extensions/pybind/moe/moe_cuda.py' 2024-10-21T04:17:33,118 adding 'extensions/pybind/optimizer/__init__.py' 2024-10-21T04:17:33,119 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-10-21T04:17:33,120 adding 'extensions/pybind/softmax/__init__.py' 2024-10-21T04:17:33,121 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-10-21T04:17:33,123 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-10-21T04:17:33,125 adding 'colossalai-0.4.5.dist-info/LICENSE' 2024-10-21T04:17:33,129 adding 'colossalai-0.4.5.dist-info/METADATA' 2024-10-21T04:17:33,131 adding 'colossalai-0.4.5.dist-info/WHEEL' 2024-10-21T04:17:33,131 adding 'colossalai-0.4.5.dist-info/entry_points.txt' 2024-10-21T04:17:33,132 adding 'colossalai-0.4.5.dist-info/top_level.txt' 2024-10-21T04:17:33,148 adding 'colossalai-0.4.5.dist-info/RECORD' 2024-10-21T04:17:33,178 removing build/bdist.linux-armv7l/wheel 2024-10-21T04:17:33,516 Building wheel for colossalai (setup.py): finished with status 'done' 2024-10-21T04:17:33,534 Created wheel for colossalai: filename=colossalai-0.4.5-py3-none-any.whl size=1585717 sha256=f94d4dad77d236b0cc6ea08c8a0016d2cd518bc546095a9e65c47fe4486cacfb 2024-10-21T04:17:33,535 Stored in directory: /tmp/pip-ephem-wheel-cache-7mjpdsss/wheels/05/a3/b6/ca77318ade3903f48c4b39e4fe6136442a61bb4e8b25049ddc 2024-10-21T04:17:33,577 Successfully built colossalai 2024-10-21T04:17:33,625 Removed build tracker: '/tmp/pip-build-tracker-av_v366p'