2024-05-31T11:58:38,125 Created temporary directory: /tmp/pip-build-tracker-oeldu7cw 2024-05-31T11:58:38,131 Initialized build tracking at /tmp/pip-build-tracker-oeldu7cw 2024-05-31T11:58:38,133 Created build tracker: /tmp/pip-build-tracker-oeldu7cw 2024-05-31T11:58:38,135 Entered build tracker: /tmp/pip-build-tracker-oeldu7cw 2024-05-31T11:58:38,138 Created temporary directory: /tmp/pip-wheel-7r0zvs2w 2024-05-31T11:58:38,143 Created temporary directory: /tmp/pip-ephem-wheel-cache-up5smtjt 2024-05-31T11:58:38,193 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-05-31T11:58:38,197 2 location(s) to search for versions of colossalai: 2024-05-31T11:58:38,197 * https://pypi.org/simple/colossalai/ 2024-05-31T11:58:38,197 * https://www.piwheels.org/simple/colossalai/ 2024-05-31T11:58:38,198 Fetching project page and analyzing links: https://pypi.org/simple/colossalai/ 2024-05-31T11:58:38,199 Getting page https://pypi.org/simple/colossalai/ 2024-05-31T11:58:38,201 Found index url https://pypi.org/simple/ 2024-05-31T11:58:38,423 Fetched page https://pypi.org/simple/colossalai/ as application/vnd.pypi.simple.v1+json 2024-05-31T11:58:38,429 Found link https://files.pythonhosted.org/packages/9c/c7/427dd2ed3769c6beb05cefdc18f8fad634673ed1472d5409afbdb768c7c3/colossalai-0.2.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.0 2024-05-31T11:58:38,433 Found link https://files.pythonhosted.org/packages/b1/70/cc6165ba3ce239c4b0c53c8ea6cabbfb31aa4b66dc580e85ff16d787384d/colossalai-0.2.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.1 2024-05-31T11:58:38,435 Found link https://files.pythonhosted.org/packages/87/d0/d82b49b722315654f6773eb458b929dba9949044a6b7cd087027c2391169/colossalai-0.2.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.2 2024-05-31T11:58:38,438 Found link https://files.pythonhosted.org/packages/c9/bb/9ec93ed622207b589fe4b1eddad9da74174eedc40ac306bff77ba823db92/colossalai-0.2.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.3 2024-05-31T11:58:38,441 Found link https://files.pythonhosted.org/packages/2c/26/4c38cbad383dfae44b9ececdea8f71d1be32c0ce80aadf883f915dd4d2fb/colossalai-0.2.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.4 2024-05-31T11:58:38,444 Found link https://files.pythonhosted.org/packages/15/05/38488d4a76c1c010da8d07e07ba14b15191d0e7398057a683f34e3c54dfe/colossalai-0.2.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.5 2024-05-31T11:58:38,446 Found link https://files.pythonhosted.org/packages/5a/a3/edf03a61814ca761d3133fae4bad80473c0f04693ef4af083787e71b6ac9/colossalai-0.2.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.6 2024-05-31T11:58:38,450 Found link https://files.pythonhosted.org/packages/25/7c/99446b8f26ba3a8706553868aa230dd9e9e153f024961967c6d916ddc943/colossalai-0.2.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.7 2024-05-31T11:58:38,452 Found link https://files.pythonhosted.org/packages/8a/35/c33a150a97c33973318108778a559a9d550f4dc89757d40f23f3260e5af8/colossalai-0.2.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.2.8 2024-05-31T11:58:38,455 Found link https://files.pythonhosted.org/packages/ef/89/290c2fc3752a3ec9008f83cf6e8cae9c856026559c8a64683b00b1501a4f/colossalai-0.3.0.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.0 2024-05-31T11:58:38,458 Found link https://files.pythonhosted.org/packages/a8/85/2d687fa9176a8ee5a77b00046ece47e9742c99a98e73b6afc7aa28f118c7/colossalai-0.3.1.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.1 2024-05-31T11:58:38,460 Found link https://files.pythonhosted.org/packages/dd/57/451c37bf3d47fb6946ab4760910e42ff44408613abd4fceeaf9e127e5dc1/colossalai-0.3.2.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.2 2024-05-31T11:58:38,463 Found link https://files.pythonhosted.org/packages/43/66/bed68a43984cf67c84fca23c490dbc97dba90007cde949771211560ed55e/colossalai-0.3.3.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.3 2024-05-31T11:58:38,468 Found link https://files.pythonhosted.org/packages/c9/85/a91ecf398c839be4204438bd143d4c8fb63a0ebfefeb5d91f6d37bd5f7aa/colossalai-0.3.4.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.4 2024-05-31T11:58:38,471 Found link https://files.pythonhosted.org/packages/56/a2/feac53fec427809a81d0773359e156bade048c5e82064109793664156dde/colossalai-0.3.5.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.5 2024-05-31T11:58:38,473 Found link https://files.pythonhosted.org/packages/05/ed/57e80620ea8e35c3aa63a3207720b1890700fd12eea38b6592e9833e5c1b/colossalai-0.3.6.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.6 2024-05-31T11:58:38,475 Found link https://files.pythonhosted.org/packages/3e/64/9bae1e3713511878aa0810d6638b7dfcf3b561e9dac832f03ff0dda8df9a/colossalai-0.3.7.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.7 2024-05-31T11:58:38,477 Found link https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz (from https://pypi.org/simple/colossalai/) (requires-python:>=3.6), version: 0.3.8 2024-05-31T11:58:38,479 Fetching project page and analyzing links: https://www.piwheels.org/simple/colossalai/ 2024-05-31T11:58:38,481 Getting page https://www.piwheels.org/simple/colossalai/ 2024-05-31T11:58:38,483 Found index url https://www.piwheels.org/simple/ 2024-05-31T11:58:38,830 Fetched page https://www.piwheels.org/simple/colossalai/ as text/html 2024-05-31T11:58:38,841 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.7-py3-none-any.whl#sha256=e9e7d6e3716e1f31f81921b19909a3baa64faccd8d8f9564ebb334c129c98eba (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,842 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.6-py3-none-any.whl#sha256=fe218b8ecc49dc2a01940fe3f3515d70dc5d51fa882272bc61e1b8409fc7b529 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,843 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.5-py3-none-any.whl#sha256=1cebde613e37393f5901c002aff141d3d925a002fe6388c766567262c6e77a2b (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,844 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.4-py3-none-any.whl#sha256=c78ca2fa246b5118c61645d0fa15c06d522369f2087160d34815bd5389f885b8 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,845 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.3-py3-none-any.whl#sha256=b3ae2354b4465d5f24919483847ea424cf9724024d840ab414f0d394e88648a7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,846 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.2-py3-none-any.whl#sha256=027b105344a1cb627d6b23e1f60b88391fa3a61ede5e4ee43bed11c1bbb57c02 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,847 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.1-py3-none-any.whl#sha256=7496490930a13a297e1773ec3fac4ac473eafb09bb98d3d882b94c09bca15533 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,848 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.3.0-py3-none-any.whl#sha256=33c149e9cd560d2c3e37c8d19bbd906fccccd7ba9703ef350d081e24b52ba6db (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,849 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.8-py3-none-any.whl#sha256=4692d233a9b6b43dc1fb53ff2aa8de5a78ad7abf07bb21c9e46ddd48f330f666 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,850 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.7-py3-none-any.whl#sha256=d8c17d923035a789da65ce205a0daea196df83cec28f43390376dfca88775424 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,851 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.6-py3-none-any.whl#sha256=2f5357caa65bb726a2aadadbd876c6f53f87d5984bb016ccdfb411f9ccf13e2e (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,852 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.5-py3-none-any.whl#sha256=645c27a6955e81220cbf83dbc4eec810b1b271bdbd2a695bd3f1a179a2a348ff (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,853 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.4-py3-none-any.whl#sha256=4c6554305658e978bfa9b199fd59b284ba6fb60cf9b17002bed4982c13f17c1f (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,854 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.3-py3-none-any.whl#sha256=e5c1d7c77bd0eb9c0b3cea5c33050a759bb29fcd128ef0f6459bec9e69f4969c (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,855 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.2-py3-none-any.whl#sha256=272ef339dfcdc089fc4e150a9ed2377e0998b1b3e5061b8760add23228609122 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,855 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.1-py3-none-any.whl#sha256=fba9ebaec6b5f43d7e2424a858cae18f765cf95d36956496e4476f23f36d97b0 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,856 Skipping link: No binaries permitted for colossalai: https://www.piwheels.org/simple/colossalai/colossalai-0.2.0-py3-none-any.whl#sha256=707a78c4c8d4b96171adc704e95bbdc387fc1dee4f612a8500f0a562c4454dc7 (from https://www.piwheels.org/simple/colossalai/) (requires-python:>=3.6) 2024-05-31T11:58:38,858 Skipping link: not a file: https://www.piwheels.org/simple/colossalai/ 2024-05-31T11:58:38,859 Skipping link: not a file: https://pypi.org/simple/colossalai/ 2024-05-31T11:58:38,904 Given no hashes to check 1 links for project 'colossalai': discarding no candidates 2024-05-31T11:58:38,940 Collecting colossalai==0.3.8 2024-05-31T11:58:38,943 Created temporary directory: /tmp/pip-unpack-ia__t1z_ 2024-05-31T11:58:39,249 Downloading colossalai-0.3.8.tar.gz (1.3 MB) 2024-05-31T11:58:41,614 Added colossalai==0.3.8 from https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz to build tracker '/tmp/pip-build-tracker-oeldu7cw' 2024-05-31T11:58:41,615 Running setup.py (path:/tmp/pip-wheel-7r0zvs2w/colossalai_f4634e93983742c5bdd7cab8d420e321/setup.py) egg_info for package colossalai 2024-05-31T11:58:41,616 Created temporary directory: /tmp/pip-pip-egg-info-5kc9zuzp 2024-05-31T11:58:41,617 Preparing metadata (setup.py): started 2024-05-31T11:58:41,618 Running command python setup.py egg_info 2024-05-31T11:58:42,632 running egg_info 2024-05-31T11:58:42,633 creating /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info 2024-05-31T11:58:42,660 writing /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/PKG-INFO 2024-05-31T11:58:42,665 writing dependency_links to /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/dependency_links.txt 2024-05-31T11:58:42,666 writing entry points to /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/entry_points.txt 2024-05-31T11:58:42,668 writing requirements to /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/requires.txt 2024-05-31T11:58:42,669 writing top-level names to /tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/top_level.txt 2024-05-31T11:58:42,670 writing manifest file '/tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/SOURCES.txt' 2024-05-31T11:58:42,934 reading manifest file '/tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/SOURCES.txt' 2024-05-31T11:58:42,936 reading manifest template 'MANIFEST.in' 2024-05-31T11:58:44,183 warning: no files found matching '*.tr' under directory 'colossalai' 2024-05-31T11:58:44,805 warning: no files found matching '*.cc' under directory 'colossalai' 2024-05-31T11:58:45,132 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-05-31T11:58:45,276 warning: no files found matching '*.tr' under directory 'extensions' 2024-05-31T11:58:45,331 warning: no files found matching '*.cc' under directory 'extensions' 2024-05-31T11:58:45,358 warning: no files found matching '*.pyi' under directory 'extensions' 2024-05-31T11:58:45,358 adding license file 'LICENSE' 2024-05-31T11:58:45,387 writing manifest file '/tmp/pip-pip-egg-info-5kc9zuzp/colossalai.egg-info/SOURCES.txt' 2024-05-31T11:58:45,498 Preparing metadata (setup.py): finished with status 'done' 2024-05-31T11:58:45,505 Source in /tmp/pip-wheel-7r0zvs2w/colossalai_f4634e93983742c5bdd7cab8d420e321 has version 0.3.8, which satisfies requirement colossalai==0.3.8 from https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz 2024-05-31T11:58:45,506 Removed colossalai==0.3.8 from https://files.pythonhosted.org/packages/36/e3/60f8db0b6f013e790fce5f2cc0b177e828aadc0ba1dd462802618387191d/colossalai-0.3.8.tar.gz from build tracker '/tmp/pip-build-tracker-oeldu7cw' 2024-05-31T11:58:45,515 Created temporary directory: /tmp/pip-unpack-hf14nqek 2024-05-31T11:58:45,516 Created temporary directory: /tmp/pip-unpack-0e72osqs 2024-05-31T11:58:45,544 Building wheels for collected packages: colossalai 2024-05-31T11:58:45,548 Created temporary directory: /tmp/pip-wheel-ng5nz6qe 2024-05-31T11:58:45,549 Building wheel for colossalai (setup.py): started 2024-05-31T11:58:45,550 Destination directory: /tmp/pip-wheel-ng5nz6qe 2024-05-31T11:58:45,551 Running command python setup.py bdist_wheel 2024-05-31T11:58:46,495 running bdist_wheel 2024-05-31T11:58:46,635 running build 2024-05-31T11:58:46,636 running build_py 2024-05-31T11:58:46,664 creating build 2024-05-31T11:58:46,665 creating build/lib 2024-05-31T11:58:46,665 creating build/lib/colossalai 2024-05-31T11:58:46,667 copying colossalai/version.py -> build/lib/colossalai 2024-05-31T11:58:46,669 copying colossalai/__init__.py -> build/lib/colossalai 2024-05-31T11:58:46,670 copying colossalai/initialize.py -> build/lib/colossalai 2024-05-31T11:58:46,673 creating build/lib/extensions 2024-05-31T11:58:46,673 creating build/lib/extensions/pybind 2024-05-31T11:58:46,674 copying extensions/pybind/__init__.py -> build/lib/extensions/pybind 2024-05-31T11:58:46,677 creating build/lib/extensions/csrc 2024-05-31T11:58:46,677 copying extensions/csrc/__init__.py -> build/lib/extensions/csrc 2024-05-31T11:58:46,679 creating build/lib/extensions/pybind/cpu_adam 2024-05-31T11:58:46,680 copying extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/extensions/pybind/cpu_adam 2024-05-31T11:58:46,682 copying extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/extensions/pybind/cpu_adam 2024-05-31T11:58:46,684 copying extensions/pybind/cpu_adam/__init__.py -> build/lib/extensions/pybind/cpu_adam 2024-05-31T11:58:46,686 creating build/lib/extensions/pybind/layernorm 2024-05-31T11:58:46,687 copying extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/extensions/pybind/layernorm 2024-05-31T11:58:46,689 copying extensions/pybind/layernorm/__init__.py -> build/lib/extensions/pybind/layernorm 2024-05-31T11:58:46,691 creating build/lib/extensions/pybind/softmax 2024-05-31T11:58:46,692 copying extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-05-31T11:58:46,694 copying extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/extensions/pybind/softmax 2024-05-31T11:58:46,695 copying extensions/pybind/softmax/__init__.py -> build/lib/extensions/pybind/softmax 2024-05-31T11:58:46,697 creating build/lib/extensions/pybind/inference 2024-05-31T11:58:46,698 copying extensions/pybind/inference/inference_ops_cuda.py -> build/lib/extensions/pybind/inference 2024-05-31T11:58:46,700 copying extensions/pybind/inference/__init__.py -> build/lib/extensions/pybind/inference 2024-05-31T11:58:46,702 creating build/lib/extensions/pybind/optimizer 2024-05-31T11:58:46,703 copying extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/extensions/pybind/optimizer 2024-05-31T11:58:46,705 copying extensions/pybind/optimizer/__init__.py -> build/lib/extensions/pybind/optimizer 2024-05-31T11:58:46,707 creating build/lib/extensions/pybind/moe 2024-05-31T11:58:46,707 copying extensions/pybind/moe/moe_cuda.py -> build/lib/extensions/pybind/moe 2024-05-31T11:58:46,709 copying extensions/pybind/moe/__init__.py -> build/lib/extensions/pybind/moe 2024-05-31T11:58:46,711 creating build/lib/extensions/pybind/flash_attention 2024-05-31T11:58:46,712 copying extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-05-31T11:58:46,714 copying extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/extensions/pybind/flash_attention 2024-05-31T11:58:46,716 copying extensions/pybind/flash_attention/__init__.py -> build/lib/extensions/pybind/flash_attention 2024-05-31T11:58:46,718 copying extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/extensions/pybind/flash_attention 2024-05-31T11:58:46,721 creating build/lib/colossalai/lazy 2024-05-31T11:58:46,722 copying colossalai/lazy/pretrained.py -> build/lib/colossalai/lazy 2024-05-31T11:58:46,724 copying colossalai/lazy/construction.py -> build/lib/colossalai/lazy 2024-05-31T11:58:46,726 copying colossalai/lazy/lazy_init.py -> build/lib/colossalai/lazy 2024-05-31T11:58:46,728 copying colossalai/lazy/__init__.py -> build/lib/colossalai/lazy 2024-05-31T11:58:46,730 creating build/lib/colossalai/_C 2024-05-31T11:58:46,731 copying colossalai/_C/__init__.py -> build/lib/colossalai/_C 2024-05-31T11:58:46,733 creating build/lib/colossalai/pipeline 2024-05-31T11:58:46,734 copying colossalai/pipeline/stage_manager.py -> build/lib/colossalai/pipeline 2024-05-31T11:58:46,737 copying colossalai/pipeline/p2p.py -> build/lib/colossalai/pipeline 2024-05-31T11:58:46,739 copying colossalai/pipeline/__init__.py -> build/lib/colossalai/pipeline 2024-05-31T11:58:46,741 creating build/lib/colossalai/testing 2024-05-31T11:58:46,742 copying colossalai/testing/utils.py -> build/lib/colossalai/testing 2024-05-31T11:58:46,745 copying colossalai/testing/pytest_wrapper.py -> build/lib/colossalai/testing 2024-05-31T11:58:46,746 copying colossalai/testing/random.py -> build/lib/colossalai/testing 2024-05-31T11:58:46,748 copying colossalai/testing/__init__.py -> build/lib/colossalai/testing 2024-05-31T11:58:46,750 copying colossalai/testing/comparison.py -> build/lib/colossalai/testing 2024-05-31T11:58:46,752 creating build/lib/colossalai/booster 2024-05-31T11:58:46,753 copying colossalai/booster/booster.py -> build/lib/colossalai/booster 2024-05-31T11:58:46,756 copying colossalai/booster/__init__.py -> build/lib/colossalai/booster 2024-05-31T11:58:46,757 copying colossalai/booster/accelerator.py -> build/lib/colossalai/booster 2024-05-31T11:58:46,760 creating build/lib/colossalai/fx 2024-05-31T11:58:46,761 copying colossalai/fx/graph_module.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,763 copying colossalai/fx/_meta_regist_12.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,765 copying colossalai/fx/_compatibility.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,767 copying colossalai/fx/_meta_regist_13.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,769 copying colossalai/fx/__init__.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,771 copying colossalai/fx/proxy.py -> build/lib/colossalai/fx 2024-05-31T11:58:46,774 creating build/lib/colossalai/logging 2024-05-31T11:58:46,775 copying colossalai/logging/logger.py -> build/lib/colossalai/logging 2024-05-31T11:58:46,778 copying colossalai/logging/__init__.py -> build/lib/colossalai/logging 2024-05-31T11:58:46,784 creating build/lib/colossalai/auto_parallel 2024-05-31T11:58:46,785 copying colossalai/auto_parallel/__init__.py -> build/lib/colossalai/auto_parallel 2024-05-31T11:58:46,787 creating build/lib/colossalai/context 2024-05-31T11:58:46,788 copying colossalai/context/config.py -> build/lib/colossalai/context 2024-05-31T11:58:46,790 copying colossalai/context/__init__.py -> build/lib/colossalai/context 2024-05-31T11:58:46,792 copying colossalai/context/singleton_meta.py -> build/lib/colossalai/context 2024-05-31T11:58:46,794 creating build/lib/colossalai/amp 2024-05-31T11:58:46,795 copying colossalai/amp/__init__.py -> build/lib/colossalai/amp 2024-05-31T11:58:46,797 creating build/lib/colossalai/quantization 2024-05-31T11:58:46,798 copying colossalai/quantization/bnb_config.py -> build/lib/colossalai/quantization 2024-05-31T11:58:46,800 copying colossalai/quantization/bnb.py -> build/lib/colossalai/quantization 2024-05-31T11:58:46,802 copying colossalai/quantization/__init__.py -> build/lib/colossalai/quantization 2024-05-31T11:58:46,804 creating build/lib/colossalai/zero 2024-05-31T11:58:46,805 copying colossalai/zero/wrapper.py -> build/lib/colossalai/zero 2024-05-31T11:58:46,807 copying colossalai/zero/__init__.py -> build/lib/colossalai/zero 2024-05-31T11:58:46,810 creating build/lib/colossalai/interface 2024-05-31T11:58:46,810 copying colossalai/interface/optimizer.py -> build/lib/colossalai/interface 2024-05-31T11:58:46,813 copying colossalai/interface/pretrained.py -> build/lib/colossalai/interface 2024-05-31T11:58:46,814 copying colossalai/interface/model.py -> build/lib/colossalai/interface 2024-05-31T11:58:46,816 copying colossalai/interface/__init__.py -> build/lib/colossalai/interface 2024-05-31T11:58:46,818 creating build/lib/colossalai/utils 2024-05-31T11:58:46,819 copying colossalai/utils/common.py -> build/lib/colossalai/utils 2024-05-31T11:58:46,821 copying colossalai/utils/timer.py -> build/lib/colossalai/utils 2024-05-31T11:58:46,823 copying colossalai/utils/__init__.py -> build/lib/colossalai/utils 2024-05-31T11:58:46,825 copying colossalai/utils/memory.py -> build/lib/colossalai/utils 2024-05-31T11:58:46,827 creating build/lib/colossalai/nn 2024-05-31T11:58:46,828 copying colossalai/nn/init.py -> build/lib/colossalai/nn 2024-05-31T11:58:46,831 copying colossalai/nn/__init__.py -> build/lib/colossalai/nn 2024-05-31T11:58:46,833 creating build/lib/colossalai/inference 2024-05-31T11:58:46,834 copying colossalai/inference/sampler.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,836 copying colossalai/inference/config.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,840 copying colossalai/inference/graph_runner.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,843 copying colossalai/inference/utils.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,846 copying colossalai/inference/batch_bucket.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,849 copying colossalai/inference/flash_decoding_utils.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,850 copying colossalai/inference/__init__.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,852 copying colossalai/inference/logit_processors.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,854 copying colossalai/inference/struct.py -> build/lib/colossalai/inference 2024-05-31T11:58:46,857 creating build/lib/colossalai/shardformer 2024-05-31T11:58:46,858 copying colossalai/shardformer/_utils.py -> build/lib/colossalai/shardformer 2024-05-31T11:58:46,860 copying colossalai/shardformer/__init__.py -> build/lib/colossalai/shardformer 2024-05-31T11:58:46,862 creating build/lib/colossalai/accelerator 2024-05-31T11:58:46,862 copying colossalai/accelerator/base_accelerator.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,865 copying colossalai/accelerator/cpu_accelerator.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,867 copying colossalai/accelerator/cuda_accelerator.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,869 copying colossalai/accelerator/__init__.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,870 copying colossalai/accelerator/npu_accelerator.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,872 copying colossalai/accelerator/api.py -> build/lib/colossalai/accelerator 2024-05-31T11:58:46,875 creating build/lib/colossalai/cli 2024-05-31T11:58:46,876 copying colossalai/cli/cli.py -> build/lib/colossalai/cli 2024-05-31T11:58:46,877 copying colossalai/cli/__init__.py -> build/lib/colossalai/cli 2024-05-31T11:58:46,879 creating build/lib/colossalai/cluster 2024-05-31T11:58:46,880 copying colossalai/cluster/process_group_mesh.py -> build/lib/colossalai/cluster 2024-05-31T11:58:46,882 copying colossalai/cluster/process_group_manager.py -> build/lib/colossalai/cluster 2024-05-31T11:58:46,884 copying colossalai/cluster/dist_coordinator.py -> build/lib/colossalai/cluster 2024-05-31T11:58:46,886 copying colossalai/cluster/device_mesh_manager.py -> build/lib/colossalai/cluster 2024-05-31T11:58:46,888 copying colossalai/cluster/__init__.py -> build/lib/colossalai/cluster 2024-05-31T11:58:46,890 creating build/lib/colossalai/device 2024-05-31T11:58:46,891 copying colossalai/device/calc_pipeline_strategy.py -> build/lib/colossalai/device 2024-05-31T11:58:46,893 copying colossalai/device/alpha_beta_profiler.py -> build/lib/colossalai/device 2024-05-31T11:58:46,896 copying colossalai/device/device_mesh.py -> build/lib/colossalai/device 2024-05-31T11:58:46,898 copying colossalai/device/__init__.py -> build/lib/colossalai/device 2024-05-31T11:58:46,900 creating build/lib/colossalai/kernel 2024-05-31T11:58:46,901 copying colossalai/kernel/__init__.py -> build/lib/colossalai/kernel 2024-05-31T11:58:46,903 copying colossalai/kernel/kernel_loader.py -> build/lib/colossalai/kernel 2024-05-31T11:58:46,906 creating build/lib/colossalai/moe 2024-05-31T11:58:46,907 copying colossalai/moe/checkpoint.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,910 copying colossalai/moe/utils.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,912 copying colossalai/moe/layers.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,915 copying colossalai/moe/loss.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,916 copying colossalai/moe/manager.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,919 copying colossalai/moe/routers.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,921 copying colossalai/moe/__init__.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,923 copying colossalai/moe/load_balance.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,925 copying colossalai/moe/experts.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,927 copying colossalai/moe/_operation.py -> build/lib/colossalai/moe 2024-05-31T11:58:46,930 creating build/lib/colossalai/_analyzer 2024-05-31T11:58:46,931 copying colossalai/_analyzer/envs.py -> build/lib/colossalai/_analyzer 2024-05-31T11:58:46,933 copying colossalai/_analyzer/__init__.py -> build/lib/colossalai/_analyzer 2024-05-31T11:58:46,936 creating build/lib/colossalai/tensor 2024-05-31T11:58:46,937 copying colossalai/tensor/utils.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,939 copying colossalai/tensor/colo_tensor.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,940 copying colossalai/tensor/shape_consistency.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,943 copying colossalai/tensor/param_op_hook.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,945 copying colossalai/tensor/colo_parameter.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,947 copying colossalai/tensor/comm_spec.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,949 copying colossalai/tensor/__init__.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,951 copying colossalai/tensor/sharding_spec.py -> build/lib/colossalai/tensor 2024-05-31T11:58:46,953 creating build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,954 copying colossalai/checkpoint_io/utils.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,957 copying colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,959 copying colossalai/checkpoint_io/general_checkpoint_io.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,962 copying colossalai/checkpoint_io/checkpoint_io_base.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,964 copying colossalai/checkpoint_io/__init__.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,966 copying colossalai/checkpoint_io/index_file.py -> build/lib/colossalai/checkpoint_io 2024-05-31T11:58:46,969 creating build/lib/colossalai/legacy 2024-05-31T11:58:46,970 copying colossalai/legacy/core.py -> build/lib/colossalai/legacy 2024-05-31T11:58:46,972 copying colossalai/legacy/constants.py -> build/lib/colossalai/legacy 2024-05-31T11:58:46,974 copying colossalai/legacy/__init__.py -> build/lib/colossalai/legacy 2024-05-31T11:58:46,976 copying colossalai/legacy/global_variables.py -> build/lib/colossalai/legacy 2024-05-31T11:58:46,978 copying colossalai/legacy/initialize.py -> build/lib/colossalai/legacy 2024-05-31T11:58:46,982 creating build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,983 copying colossalai/pipeline/schedule/interleaved_pp.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,986 copying colossalai/pipeline/schedule/base.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,988 copying colossalai/pipeline/schedule/one_f_one_b.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,991 copying colossalai/pipeline/schedule/_utils.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,994 copying colossalai/pipeline/schedule/generate.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,997 copying colossalai/pipeline/schedule/__init__.py -> build/lib/colossalai/pipeline/schedule 2024-05-31T11:58:46,999 creating build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,000 copying colossalai/booster/mixed_precision/fp16_naive.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,003 copying colossalai/booster/mixed_precision/bf16.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,005 copying colossalai/booster/mixed_precision/fp16_torch.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,007 copying colossalai/booster/mixed_precision/fp16_apex.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,009 copying colossalai/booster/mixed_precision/__init__.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,011 copying colossalai/booster/mixed_precision/mixed_precision_base.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,013 copying colossalai/booster/mixed_precision/fp8.py -> build/lib/colossalai/booster/mixed_precision 2024-05-31T11:58:47,016 creating build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,017 copying colossalai/booster/plugin/gemini_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,020 copying colossalai/booster/plugin/torch_fsdp_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,023 copying colossalai/booster/plugin/torch_ddp_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,026 copying colossalai/booster/plugin/low_level_zero_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,029 copying colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,031 copying colossalai/booster/plugin/plugin_base.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,033 copying colossalai/booster/plugin/dp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,035 copying colossalai/booster/plugin/__init__.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,037 copying colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,041 copying colossalai/booster/plugin/pp_plugin_base.py -> build/lib/colossalai/booster/plugin 2024-05-31T11:58:47,044 creating build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,045 copying colossalai/fx/tracer/experimental.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,048 copying colossalai/fx/tracer/tracer.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,051 copying colossalai/fx/tracer/_tracer_utils.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,054 copying colossalai/fx/tracer/_symbolic_trace.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,056 copying colossalai/fx/tracer/__init__.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,057 copying colossalai/fx/tracer/registry.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,059 copying colossalai/fx/tracer/_meta_trace.py -> build/lib/colossalai/fx/tracer 2024-05-31T11:58:47,062 creating build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,064 copying colossalai/fx/profiler/tensor.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,066 copying colossalai/fx/profiler/constants.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,068 copying colossalai/fx/profiler/opcount.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,071 copying colossalai/fx/profiler/dataflow.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,074 copying colossalai/fx/profiler/__init__.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,076 copying colossalai/fx/profiler/shard_utils.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,078 copying colossalai/fx/profiler/memory_utils.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,080 copying colossalai/fx/profiler/profiler.py -> build/lib/colossalai/fx/profiler 2024-05-31T11:58:47,083 creating build/lib/colossalai/fx/passes 2024-05-31T11:58:47,085 copying colossalai/fx/passes/meta_info_prop.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,088 copying colossalai/fx/passes/concrete_info_prop.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,090 copying colossalai/fx/passes/utils.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,093 copying colossalai/fx/passes/split_module.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,095 copying colossalai/fx/passes/shard_1d_pass.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,098 copying colossalai/fx/passes/adding_split_node_pass.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,101 copying colossalai/fx/passes/passes_for_gpt2_test.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,103 copying colossalai/fx/passes/__init__.py -> build/lib/colossalai/fx/passes 2024-05-31T11:58:47,107 creating build/lib/colossalai/fx/codegen 2024-05-31T11:58:47,108 copying colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/lib/colossalai/fx/codegen 2024-05-31T11:58:47,112 copying colossalai/fx/codegen/__init__.py -> build/lib/colossalai/fx/codegen 2024-05-31T11:58:47,115 creating build/lib/colossalai/fx/tracer/bias_addition_patch 2024-05-31T11:58:47,116 copying colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch 2024-05-31T11:58:47,118 creating build/lib/colossalai/fx/tracer/meta_patch 2024-05-31T11:58:47,120 copying colossalai/fx/tracer/meta_patch/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch 2024-05-31T11:58:47,122 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:47,123 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:47,125 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:47,128 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:47,130 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:47,132 creating build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,133 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,135 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,138 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,140 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,142 copying colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:47,144 creating build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,145 copying colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,148 copying colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,150 copying colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,152 copying colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,155 copying colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,157 copying colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,159 copying colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,161 copying colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:47,163 creating build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,164 copying colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,167 copying colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,169 copying colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,171 copying colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,174 copying colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,176 copying colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,178 copying colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,180 copying colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/lib/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:47,182 creating build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,183 copying colossalai/fx/profiler/experimental/constants.py -> build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,185 copying colossalai/fx/profiler/experimental/__init__.py -> build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,187 copying colossalai/fx/profiler/experimental/registry.py -> build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,189 copying colossalai/fx/profiler/experimental/shard_utils.py -> build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,191 copying colossalai/fx/profiler/experimental/profiler.py -> build/lib/colossalai/fx/profiler/experimental 2024-05-31T11:58:47,194 creating build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,196 copying colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,198 copying colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,200 copying colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,202 copying colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,204 copying colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,206 copying colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,209 copying colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,211 copying colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,213 copying colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:47,216 creating build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,217 copying colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,219 copying colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,221 copying colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,223 copying colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,225 copying colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,227 copying colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,229 copying colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,232 copying colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,234 copying colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,236 copying colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,238 copying colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/lib/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:47,241 creating build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,242 copying colossalai/auto_parallel/passes/meta_info_prop.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,244 copying colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,247 copying colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,250 copying colossalai/auto_parallel/passes/constants.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,252 copying colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,254 copying colossalai/auto_parallel/passes/__init__.py -> build/lib/colossalai/auto_parallel/passes 2024-05-31T11:58:47,257 creating build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,258 copying colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,260 copying colossalai/auto_parallel/checkpoint/operation.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,263 copying colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,265 copying colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,268 copying colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,270 copying colossalai/auto_parallel/checkpoint/__init__.py -> build/lib/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:47,273 creating build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,274 copying colossalai/auto_parallel/tensor_shard/options.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,276 copying colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,279 copying colossalai/auto_parallel/tensor_shard/constants.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,281 copying colossalai/auto_parallel/tensor_shard/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,283 copying colossalai/auto_parallel/tensor_shard/initialize.py -> build/lib/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:47,286 creating build/lib/colossalai/auto_parallel/pipeline_shard 2024-05-31T11:58:47,287 copying colossalai/auto_parallel/pipeline_shard/__init__.py -> build/lib/colossalai/auto_parallel/pipeline_shard 2024-05-31T11:58:47,290 creating build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,291 copying colossalai/auto_parallel/offload/region.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,294 copying colossalai/auto_parallel/offload/training_simulator.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,297 copying colossalai/auto_parallel/offload/amp_optimizer.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,301 copying colossalai/auto_parallel/offload/util.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,303 copying colossalai/auto_parallel/offload/region_manager.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,306 copying colossalai/auto_parallel/offload/solver.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,310 copying colossalai/auto_parallel/offload/mem_optimize.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,312 copying colossalai/auto_parallel/offload/base_offload_module.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,314 copying colossalai/auto_parallel/offload/runtime.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,317 copying colossalai/auto_parallel/offload/__init__.py -> build/lib/colossalai/auto_parallel/offload 2024-05-31T11:58:47,319 creating build/lib/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:47,321 copying colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:47,323 copying colossalai/auto_parallel/meta_profiler/constants.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:47,325 copying colossalai/auto_parallel/meta_profiler/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:47,327 copying colossalai/auto_parallel/meta_profiler/registry.py -> build/lib/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:47,330 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,332 copying colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,334 copying colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,337 copying colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,339 copying colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,341 copying colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,344 copying colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,346 copying colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,348 copying colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,351 copying colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,353 copying colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,356 copying colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,358 copying colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,361 copying colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,363 copying colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,364 copying colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,366 copying colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,368 copying colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,370 copying colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,371 copying colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,373 copying colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,375 copying colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,376 copying colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,378 copying colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,380 copying colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,382 copying colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,383 copying colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,385 copying colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:47,387 creating build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,388 copying colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,391 copying colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,393 copying colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,395 copying colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,397 copying colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,399 copying colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:47,401 creating build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,402 copying colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,405 copying colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,407 copying colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,410 copying colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,412 copying colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:47,415 creating build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,416 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,418 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,420 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,423 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,425 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,427 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,429 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,431 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,433 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,435 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,438 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,443 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,448 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,452 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,454 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,456 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,458 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,461 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,463 copying colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:47,466 creating build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,468 copying colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,471 copying colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,474 copying colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,477 copying colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,479 copying colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,481 copying colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,483 copying colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,484 copying colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,486 copying colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,488 copying colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,489 copying colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/lib/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:47,491 creating build/lib/colossalai/amp/naive_amp 2024-05-31T11:58:47,492 copying colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/lib/colossalai/amp/naive_amp 2024-05-31T11:58:47,494 copying colossalai/amp/naive_amp/__init__.py -> build/lib/colossalai/amp/naive_amp 2024-05-31T11:58:47,496 creating build/lib/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:47,497 copying colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:47,499 copying colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:47,502 copying colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:47,504 copying colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/lib/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:47,508 creating build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:47,509 copying colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:47,513 copying colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:47,514 copying colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:47,517 copying colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/lib/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:47,519 creating build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,520 copying colossalai/zero/gemini/gemini_optimizer.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,522 copying colossalai/zero/gemini/gemini_mgr.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,525 copying colossalai/zero/gemini/gemini_hook.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,526 copying colossalai/zero/gemini/gemini_ddp.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,529 copying colossalai/zero/gemini/utils.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,531 copying colossalai/zero/gemini/placement_policy.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,534 copying colossalai/zero/gemini/__init__.py -> build/lib/colossalai/zero/gemini 2024-05-31T11:58:47,536 creating build/lib/colossalai/zero/low_level 2024-05-31T11:58:47,537 copying colossalai/zero/low_level/low_level_optim.py -> build/lib/colossalai/zero/low_level 2024-05-31T11:58:47,540 copying colossalai/zero/low_level/_utils.py -> build/lib/colossalai/zero/low_level 2024-05-31T11:58:47,542 copying colossalai/zero/low_level/__init__.py -> build/lib/colossalai/zero/low_level 2024-05-31T11:58:47,544 creating build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,545 copying colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,547 copying colossalai/zero/gemini/memory_tracer/utils.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,549 copying colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,551 copying colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,552 copying colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,554 copying colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,556 copying colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,557 copying colossalai/zero/gemini/memory_tracer/__init__.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,559 copying colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/lib/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:47,561 creating build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,562 copying colossalai/zero/gemini/chunk/chunk.py -> build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,565 copying colossalai/zero/gemini/chunk/utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,567 copying colossalai/zero/gemini/chunk/manager.py -> build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,569 copying colossalai/zero/gemini/chunk/search_utils.py -> build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,571 copying colossalai/zero/gemini/chunk/__init__.py -> build/lib/colossalai/zero/gemini/chunk 2024-05-31T11:58:47,573 creating build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,574 copying colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,576 copying colossalai/zero/low_level/bookkeeping/base_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,578 copying colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,580 copying colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,582 copying colossalai/zero/low_level/bookkeeping/__init__.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,584 copying colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/lib/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:47,586 creating build/lib/colossalai/utils/model 2024-05-31T11:58:47,587 copying colossalai/utils/model/utils.py -> build/lib/colossalai/utils/model 2024-05-31T11:58:47,589 copying colossalai/utils/model/__init__.py -> build/lib/colossalai/utils/model 2024-05-31T11:58:47,590 creating build/lib/colossalai/utils/tensor_detector 2024-05-31T11:58:47,591 copying colossalai/utils/tensor_detector/tensor_detector.py -> build/lib/colossalai/utils/tensor_detector 2024-05-31T11:58:47,594 copying colossalai/utils/tensor_detector/__init__.py -> build/lib/colossalai/utils/tensor_detector 2024-05-31T11:58:47,596 creating build/lib/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:47,597 copying colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:47,599 copying colossalai/utils/multi_tensor_apply/__init__.py -> build/lib/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:47,601 creating build/lib/colossalai/utils/rank_recorder 2024-05-31T11:58:47,602 copying colossalai/utils/rank_recorder/rank_recorder.py -> build/lib/colossalai/utils/rank_recorder 2024-05-31T11:58:47,604 copying colossalai/utils/rank_recorder/__init__.py -> build/lib/colossalai/utils/rank_recorder 2024-05-31T11:58:47,606 creating build/lib/colossalai/nn/loss 2024-05-31T11:58:47,607 copying colossalai/nn/loss/__init__.py -> build/lib/colossalai/nn/loss 2024-05-31T11:58:47,609 creating build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,610 copying colossalai/nn/lr_scheduler/onecycle.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,612 copying colossalai/nn/lr_scheduler/linear.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,613 copying colossalai/nn/lr_scheduler/cosine.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,615 copying colossalai/nn/lr_scheduler/delayed.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,618 copying colossalai/nn/lr_scheduler/multistep.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,619 copying colossalai/nn/lr_scheduler/torch.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,621 copying colossalai/nn/lr_scheduler/__init__.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,623 copying colossalai/nn/lr_scheduler/poly.py -> build/lib/colossalai/nn/lr_scheduler 2024-05-31T11:58:47,625 creating build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,626 copying colossalai/nn/optimizer/distributed_lamb.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,628 copying colossalai/nn/optimizer/galore.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,630 copying colossalai/nn/optimizer/fused_adam.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,633 copying colossalai/nn/optimizer/distributed_galore.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,635 copying colossalai/nn/optimizer/lamb.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,637 copying colossalai/nn/optimizer/hybrid_adam.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,639 copying colossalai/nn/optimizer/lars.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,641 copying colossalai/nn/optimizer/fused_lamb.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,644 copying colossalai/nn/optimizer/cpu_adam.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,646 copying colossalai/nn/optimizer/distributed_adafactor.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,649 copying colossalai/nn/optimizer/nvme_optimizer.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,651 copying colossalai/nn/optimizer/adafactor.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,653 copying colossalai/nn/optimizer/__init__.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,655 copying colossalai/nn/optimizer/fused_sgd.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,657 copying colossalai/nn/optimizer/distributed_came.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,660 copying colossalai/nn/optimizer/came.py -> build/lib/colossalai/nn/optimizer 2024-05-31T11:58:47,662 creating build/lib/colossalai/nn/layer 2024-05-31T11:58:47,663 copying colossalai/nn/layer/layernorm.py -> build/lib/colossalai/nn/layer 2024-05-31T11:58:47,665 copying colossalai/nn/layer/utils.py -> build/lib/colossalai/nn/layer 2024-05-31T11:58:47,667 copying colossalai/nn/layer/scaled_softmax.py -> build/lib/colossalai/nn/layer 2024-05-31T11:58:47,669 copying colossalai/nn/layer/__init__.py -> build/lib/colossalai/nn/layer 2024-05-31T11:58:47,671 creating build/lib/colossalai/inference/kv_cache 2024-05-31T11:58:47,672 copying colossalai/inference/kv_cache/kvcache_manager.py -> build/lib/colossalai/inference/kv_cache 2024-05-31T11:58:47,675 copying colossalai/inference/kv_cache/block_cache.py -> build/lib/colossalai/inference/kv_cache 2024-05-31T11:58:47,677 copying colossalai/inference/kv_cache/__init__.py -> build/lib/colossalai/inference/kv_cache 2024-05-31T11:58:47,679 creating build/lib/colossalai/inference/modeling 2024-05-31T11:58:47,680 copying colossalai/inference/modeling/__init__.py -> build/lib/colossalai/inference/modeling 2024-05-31T11:58:47,682 creating build/lib/colossalai/inference/core 2024-05-31T11:58:47,683 copying colossalai/inference/core/rpc_engine.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,685 copying colossalai/inference/core/plugin.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,687 copying colossalai/inference/core/async_engine.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,690 copying colossalai/inference/core/engine.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,693 copying colossalai/inference/core/__init__.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,694 copying colossalai/inference/core/request_handler.py -> build/lib/colossalai/inference/core 2024-05-31T11:58:47,697 creating build/lib/colossalai/inference/spec 2024-05-31T11:58:47,698 copying colossalai/inference/spec/drafter.py -> build/lib/colossalai/inference/spec 2024-05-31T11:58:47,700 copying colossalai/inference/spec/__init__.py -> build/lib/colossalai/inference/spec 2024-05-31T11:58:47,702 copying colossalai/inference/spec/struct.py -> build/lib/colossalai/inference/spec 2024-05-31T11:58:47,704 creating build/lib/colossalai/inference/server 2024-05-31T11:58:47,705 copying colossalai/inference/server/completion_service.py -> build/lib/colossalai/inference/server 2024-05-31T11:58:47,707 copying colossalai/inference/server/utils.py -> build/lib/colossalai/inference/server 2024-05-31T11:58:47,709 copying colossalai/inference/server/api_server.py -> build/lib/colossalai/inference/server 2024-05-31T11:58:47,712 copying colossalai/inference/server/chat_service.py -> build/lib/colossalai/inference/server 2024-05-31T11:58:47,715 copying colossalai/inference/server/__init__.py -> build/lib/colossalai/inference/server 2024-05-31T11:58:47,718 creating build/lib/colossalai/inference/modeling/policy 2024-05-31T11:58:47,719 copying colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/policy 2024-05-31T11:58:47,722 copying colossalai/inference/modeling/policy/glide_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-05-31T11:58:47,725 copying colossalai/inference/modeling/policy/nopadding_llama.py -> build/lib/colossalai/inference/modeling/policy 2024-05-31T11:58:47,728 copying colossalai/inference/modeling/policy/__init__.py -> build/lib/colossalai/inference/modeling/policy 2024-05-31T11:58:47,731 creating build/lib/colossalai/inference/modeling/models 2024-05-31T11:58:47,733 copying colossalai/inference/modeling/models/nopadding_baichuan.py -> build/lib/colossalai/inference/modeling/models 2024-05-31T11:58:47,737 copying colossalai/inference/modeling/models/glide_llama.py -> build/lib/colossalai/inference/modeling/models 2024-05-31T11:58:47,740 copying colossalai/inference/modeling/models/nopadding_llama.py -> build/lib/colossalai/inference/modeling/models 2024-05-31T11:58:47,744 copying colossalai/inference/modeling/models/__init__.py -> build/lib/colossalai/inference/modeling/models 2024-05-31T11:58:47,747 creating build/lib/colossalai/inference/modeling/layers 2024-05-31T11:58:47,749 copying colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/lib/colossalai/inference/modeling/layers 2024-05-31T11:58:47,751 copying colossalai/inference/modeling/layers/attention.py -> build/lib/colossalai/inference/modeling/layers 2024-05-31T11:58:47,755 copying colossalai/inference/modeling/layers/__init__.py -> build/lib/colossalai/inference/modeling/layers 2024-05-31T11:58:47,759 creating build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,760 copying colossalai/shardformer/modeling/t5.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,765 copying colossalai/shardformer/modeling/whisper.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,769 copying colossalai/shardformer/modeling/qwen2.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,773 copying colossalai/shardformer/modeling/opt.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,777 copying colossalai/shardformer/modeling/sam.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,780 copying colossalai/shardformer/modeling/bert.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,784 copying colossalai/shardformer/modeling/vit.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,787 copying colossalai/shardformer/modeling/chatglm2.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,790 copying colossalai/shardformer/modeling/mistral.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,793 copying colossalai/shardformer/modeling/blip2.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,796 copying colossalai/shardformer/modeling/__init__.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,797 copying colossalai/shardformer/modeling/falcon.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,801 copying colossalai/shardformer/modeling/llama.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,804 copying colossalai/shardformer/modeling/gpt2.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,809 copying colossalai/shardformer/modeling/gptj.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,812 copying colossalai/shardformer/modeling/jit.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,814 copying colossalai/shardformer/modeling/bloom.py -> build/lib/colossalai/shardformer/modeling 2024-05-31T11:58:47,819 creating build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,820 copying colossalai/shardformer/policies/t5.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,823 copying colossalai/shardformer/policies/whisper.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,826 copying colossalai/shardformer/policies/qwen2.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,829 copying colossalai/shardformer/policies/opt.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,831 copying colossalai/shardformer/policies/sam.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,834 copying colossalai/shardformer/policies/base_policy.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,837 copying colossalai/shardformer/policies/bert.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,841 copying colossalai/shardformer/policies/vit.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,844 copying colossalai/shardformer/policies/chatglm2.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,846 copying colossalai/shardformer/policies/mistral.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,849 copying colossalai/shardformer/policies/blip2.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,852 copying colossalai/shardformer/policies/auto_policy.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,855 copying colossalai/shardformer/policies/__init__.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,856 copying colossalai/shardformer/policies/falcon.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,859 copying colossalai/shardformer/policies/llama.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,862 copying colossalai/shardformer/policies/gpt2.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,865 copying colossalai/shardformer/policies/gptj.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,868 copying colossalai/shardformer/policies/bloom.py -> build/lib/colossalai/shardformer/policies 2024-05-31T11:58:47,872 creating build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,873 copying colossalai/shardformer/shard/shardformer.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,875 copying colossalai/shardformer/shard/utils.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,877 copying colossalai/shardformer/shard/shard_config.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,879 copying colossalai/shardformer/shard/sharder.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,882 copying colossalai/shardformer/shard/grad_ckpt_config.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,884 copying colossalai/shardformer/shard/__init__.py -> build/lib/colossalai/shardformer/shard 2024-05-31T11:58:47,887 creating build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,888 copying colossalai/shardformer/layer/attn.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,891 copying colossalai/shardformer/layer/linear.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,894 copying colossalai/shardformer/layer/utils.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,896 copying colossalai/shardformer/layer/normalization.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,899 copying colossalai/shardformer/layer/parallel_module.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,902 copying colossalai/shardformer/layer/loss.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,904 copying colossalai/shardformer/layer/dropout.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,906 copying colossalai/shardformer/layer/embedding.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,909 copying colossalai/shardformer/layer/__init__.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,911 copying colossalai/shardformer/layer/qkv_fused_linear.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,914 copying colossalai/shardformer/layer/_operation.py -> build/lib/colossalai/shardformer/layer 2024-05-31T11:58:47,917 creating build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:47,918 copying colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:47,922 copying colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:47,924 copying colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/lib/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:47,927 creating build/lib/colossalai/cli/launcher 2024-05-31T11:58:47,928 copying colossalai/cli/launcher/multinode_runner.py -> build/lib/colossalai/cli/launcher 2024-05-31T11:58:47,931 copying colossalai/cli/launcher/hostinfo.py -> build/lib/colossalai/cli/launcher 2024-05-31T11:58:47,933 copying colossalai/cli/launcher/run.py -> build/lib/colossalai/cli/launcher 2024-05-31T11:58:47,936 copying colossalai/cli/launcher/__init__.py -> build/lib/colossalai/cli/launcher 2024-05-31T11:58:47,939 creating build/lib/colossalai/cli/check 2024-05-31T11:58:47,940 copying colossalai/cli/check/check_installation.py -> build/lib/colossalai/cli/check 2024-05-31T11:58:47,942 copying colossalai/cli/check/__init__.py -> build/lib/colossalai/cli/check 2024-05-31T11:58:47,945 creating build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,946 copying colossalai/kernel/extensions/utils.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,949 copying colossalai/kernel/extensions/triton_extension.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,951 copying colossalai/kernel/extensions/cuda_extension.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,953 copying colossalai/kernel/extensions/cpp_extension.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,955 copying colossalai/kernel/extensions/__init__.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,957 copying colossalai/kernel/extensions/base_extension.py -> build/lib/colossalai/kernel/extensions 2024-05-31T11:58:47,959 creating build/lib/colossalai/kernel/jit 2024-05-31T11:58:47,960 copying colossalai/kernel/jit/option.py -> build/lib/colossalai/kernel/jit 2024-05-31T11:58:47,961 copying colossalai/kernel/jit/bias_dropout_add.py -> build/lib/colossalai/kernel/jit 2024-05-31T11:58:47,963 copying colossalai/kernel/jit/__init__.py -> build/lib/colossalai/kernel/jit 2024-05-31T11:58:47,964 copying colossalai/kernel/jit/bias_gelu.py -> build/lib/colossalai/kernel/jit 2024-05-31T11:58:47,967 creating build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,967 copying colossalai/kernel/triton/kvcache_copy.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,970 copying colossalai/kernel/triton/llama_act_combine_kernel.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,972 copying colossalai/kernel/triton/flash_decoding.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,974 copying colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,977 copying colossalai/kernel/triton/rms_layernorm.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,979 copying colossalai/kernel/triton/softmax.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,980 copying colossalai/kernel/triton/rotary_cache_copy.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,982 copying colossalai/kernel/triton/qkv_matmul_kernel.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,985 copying colossalai/kernel/triton/__init__.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,986 copying colossalai/kernel/triton/context_attn_unpad.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,989 copying colossalai/kernel/triton/fused_rotary_embedding.py -> build/lib/colossalai/kernel/triton 2024-05-31T11:58:47,992 creating build/lib/colossalai/kernel/extensions/pybind 2024-05-31T11:58:47,992 copying colossalai/kernel/extensions/pybind/__init__.py -> build/lib/colossalai/kernel/extensions/pybind 2024-05-31T11:58:47,994 creating build/lib/colossalai/kernel/extensions/csrc 2024-05-31T11:58:47,995 copying colossalai/kernel/extensions/csrc/__init__.py -> build/lib/colossalai/kernel/extensions/csrc 2024-05-31T11:58:47,998 creating build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:47,999 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:48,001 copying colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:48,002 copying colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:48,005 creating build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:48,006 copying colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:48,008 copying colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:48,010 creating build/lib/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:48,011 copying colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:48,013 copying colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:48,015 copying colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:48,018 creating build/lib/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:48,019 copying colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:48,021 copying colossalai/kernel/extensions/pybind/inference/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:48,023 creating build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:48,024 copying colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:48,026 copying colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:48,028 creating build/lib/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:48,029 copying colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:48,030 copying colossalai/kernel/extensions/pybind/moe/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:48,033 creating build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:48,034 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:48,036 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:48,038 copying colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:48,039 copying colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/lib/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:48,042 creating build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,043 copying colossalai/_analyzer/fx/graph_module.py -> build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,046 copying colossalai/_analyzer/fx/node_util.py -> build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,049 copying colossalai/_analyzer/fx/symbolic_profile.py -> build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,051 copying colossalai/_analyzer/fx/codegen.py -> build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,053 copying colossalai/_analyzer/fx/__init__.py -> build/lib/colossalai/_analyzer/fx 2024-05-31T11:58:48,056 creating build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,057 copying colossalai/_analyzer/_subclasses/_meta_registration.py -> build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,060 copying colossalai/_analyzer/_subclasses/flop_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,062 copying colossalai/_analyzer/_subclasses/meta_tensor.py -> build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,065 copying colossalai/_analyzer/_subclasses/__init__.py -> build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,066 copying colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/lib/colossalai/_analyzer/_subclasses 2024-05-31T11:58:48,069 creating build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,070 copying colossalai/_analyzer/fx/tracer/tracer.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,072 copying colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,074 copying colossalai/_analyzer/fx/tracer/bias_addition.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,076 copying colossalai/_analyzer/fx/tracer/__init__.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,078 copying colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,080 copying colossalai/_analyzer/fx/tracer/proxy.py -> build/lib/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:48,083 creating build/lib/colossalai/_analyzer/fx/passes 2024-05-31T11:58:48,084 copying colossalai/_analyzer/fx/passes/graph_profile.py -> build/lib/colossalai/_analyzer/fx/passes 2024-05-31T11:58:48,086 copying colossalai/_analyzer/fx/passes/shape_prop.py -> build/lib/colossalai/_analyzer/fx/passes 2024-05-31T11:58:48,089 copying colossalai/_analyzer/fx/passes/__init__.py -> build/lib/colossalai/_analyzer/fx/passes 2024-05-31T11:58:48,091 creating build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,092 copying colossalai/tensor/d_tensor/layout.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,094 copying colossalai/tensor/d_tensor/utils.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,096 copying colossalai/tensor/d_tensor/misc.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,098 copying colossalai/tensor/d_tensor/layout_converter.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,101 copying colossalai/tensor/d_tensor/comm_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,103 copying colossalai/tensor/d_tensor/__init__.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,105 copying colossalai/tensor/d_tensor/api.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,107 copying colossalai/tensor/d_tensor/sharding_spec.py -> build/lib/colossalai/tensor/d_tensor 2024-05-31T11:58:48,110 creating build/lib/colossalai/tensor/padded_tensor 2024-05-31T11:58:48,111 copying colossalai/tensor/padded_tensor/__init__.py -> build/lib/colossalai/tensor/padded_tensor 2024-05-31T11:58:48,113 copying colossalai/tensor/padded_tensor/api.py -> build/lib/colossalai/tensor/padded_tensor 2024-05-31T11:58:48,116 creating build/lib/colossalai/tensor/moe_tensor 2024-05-31T11:58:48,117 copying colossalai/tensor/moe_tensor/moe_info.py -> build/lib/colossalai/tensor/moe_tensor 2024-05-31T11:58:48,119 copying colossalai/tensor/moe_tensor/__init__.py -> build/lib/colossalai/tensor/moe_tensor 2024-05-31T11:58:48,120 copying colossalai/tensor/moe_tensor/api.py -> build/lib/colossalai/tensor/moe_tensor 2024-05-31T11:58:48,123 creating build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,124 copying colossalai/legacy/communication/utils.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,126 copying colossalai/legacy/communication/ring.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,128 copying colossalai/legacy/communication/p2p.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,131 copying colossalai/legacy/communication/__init__.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,132 copying colossalai/legacy/communication/p2p_v2.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,135 copying colossalai/legacy/communication/collective.py -> build/lib/colossalai/legacy/communication 2024-05-31T11:58:48,138 creating build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,139 copying colossalai/legacy/pipeline/layer_spec.py -> build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,141 copying colossalai/legacy/pipeline/pipelinable.py -> build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,143 copying colossalai/legacy/pipeline/utils.py -> build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,146 copying colossalai/legacy/pipeline/pipeline_process_group.py -> build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,148 copying colossalai/legacy/pipeline/__init__.py -> build/lib/colossalai/legacy/pipeline 2024-05-31T11:58:48,150 creating build/lib/colossalai/legacy/context 2024-05-31T11:58:48,151 copying colossalai/legacy/context/parallel_mode.py -> build/lib/colossalai/legacy/context 2024-05-31T11:58:48,153 copying colossalai/legacy/context/__init__.py -> build/lib/colossalai/legacy/context 2024-05-31T11:58:48,155 copying colossalai/legacy/context/parallel_context.py -> build/lib/colossalai/legacy/context 2024-05-31T11:58:48,159 creating build/lib/colossalai/legacy/amp 2024-05-31T11:58:48,160 copying colossalai/legacy/amp/amp_type.py -> build/lib/colossalai/legacy/amp 2024-05-31T11:58:48,162 copying colossalai/legacy/amp/__init__.py -> build/lib/colossalai/legacy/amp 2024-05-31T11:58:48,164 creating build/lib/colossalai/legacy/zero 2024-05-31T11:58:48,165 copying colossalai/legacy/zero/__init__.py -> build/lib/colossalai/legacy/zero 2024-05-31T11:58:48,167 creating build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,168 copying colossalai/legacy/utils/checkpointing.py -> build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,171 copying colossalai/legacy/utils/common.py -> build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,173 copying colossalai/legacy/utils/__init__.py -> build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,175 copying colossalai/legacy/utils/activation_checkpoint.py -> build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,177 copying colossalai/legacy/utils/memory.py -> build/lib/colossalai/legacy/utils 2024-05-31T11:58:48,180 creating build/lib/colossalai/legacy/nn 2024-05-31T11:58:48,181 copying colossalai/legacy/nn/__init__.py -> build/lib/colossalai/legacy/nn 2024-05-31T11:58:48,183 creating build/lib/colossalai/legacy/inference 2024-05-31T11:58:48,184 copying colossalai/legacy/inference/manager.py -> build/lib/colossalai/legacy/inference 2024-05-31T11:58:48,187 copying colossalai/legacy/inference/async_engine.py -> build/lib/colossalai/legacy/inference 2024-05-31T11:58:48,189 copying colossalai/legacy/inference/async_manager.py -> build/lib/colossalai/legacy/inference 2024-05-31T11:58:48,192 copying colossalai/legacy/inference/__init__.py -> build/lib/colossalai/legacy/inference 2024-05-31T11:58:48,194 creating build/lib/colossalai/legacy/trainer 2024-05-31T11:58:48,195 copying colossalai/legacy/trainer/_trainer.py -> build/lib/colossalai/legacy/trainer 2024-05-31T11:58:48,198 copying colossalai/legacy/trainer/__init__.py -> build/lib/colossalai/legacy/trainer 2024-05-31T11:58:48,200 creating build/lib/colossalai/legacy/builder 2024-05-31T11:58:48,201 copying colossalai/legacy/builder/builder.py -> build/lib/colossalai/legacy/builder 2024-05-31T11:58:48,203 copying colossalai/legacy/builder/__init__.py -> build/lib/colossalai/legacy/builder 2024-05-31T11:58:48,205 creating build/lib/colossalai/legacy/engine 2024-05-31T11:58:48,206 copying colossalai/legacy/engine/_base_engine.py -> build/lib/colossalai/legacy/engine 2024-05-31T11:58:48,209 copying colossalai/legacy/engine/__init__.py -> build/lib/colossalai/legacy/engine 2024-05-31T11:58:48,211 creating build/lib/colossalai/legacy/registry 2024-05-31T11:58:48,212 copying colossalai/legacy/registry/__init__.py -> build/lib/colossalai/legacy/registry 2024-05-31T11:58:48,214 copying colossalai/legacy/registry/registry.py -> build/lib/colossalai/legacy/registry 2024-05-31T11:58:48,217 creating build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,218 copying colossalai/legacy/tensor/process_group.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,220 copying colossalai/legacy/tensor/distspec.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,222 copying colossalai/legacy/tensor/op_wrapper.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,224 copying colossalai/legacy/tensor/dist_spec_mgr.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,227 copying colossalai/legacy/tensor/tensor_spec.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,229 copying colossalai/legacy/tensor/__init__.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,231 copying colossalai/legacy/tensor/compute_spec.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,233 copying colossalai/legacy/tensor/const.py -> build/lib/colossalai/legacy/tensor 2024-05-31T11:58:48,235 creating build/lib/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:48,237 copying colossalai/legacy/pipeline/middleware/topo.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:48,240 copying colossalai/legacy/pipeline/middleware/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:48,243 creating build/lib/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:48,244 copying colossalai/legacy/pipeline/rpc/utils.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:48,246 copying colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:48,249 copying colossalai/legacy/pipeline/rpc/__init__.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:48,250 copying colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/lib/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:48,254 creating build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:48,255 copying colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:48,257 copying colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/lib/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:48,259 creating build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,260 copying colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,262 copying colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,264 copying colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,266 copying colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,268 copying colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,270 copying colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,273 copying colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,276 copying colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,278 copying colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,281 copying colossalai/legacy/context/process_group_initializer/__init__.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,282 copying colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/lib/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:48,285 creating build/lib/colossalai/legacy/context/random 2024-05-31T11:58:48,286 copying colossalai/legacy/context/random/__init__.py -> build/lib/colossalai/legacy/context/random 2024-05-31T11:58:48,289 copying colossalai/legacy/context/random/seed_manager.py -> build/lib/colossalai/legacy/context/random 2024-05-31T11:58:48,291 copying colossalai/legacy/context/random/_helper.py -> build/lib/colossalai/legacy/context/random 2024-05-31T11:58:48,293 creating build/lib/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:48,295 copying colossalai/legacy/amp/naive_amp/naive_amp.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:48,297 copying colossalai/legacy/amp/naive_amp/_utils.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:48,299 copying colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:48,301 copying colossalai/legacy/amp/naive_amp/__init__.py -> build/lib/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:48,303 creating build/lib/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:48,304 copying colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:48,307 copying colossalai/legacy/amp/torch_amp/torch_amp.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:48,309 copying colossalai/legacy/amp/torch_amp/__init__.py -> build/lib/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:48,311 creating build/lib/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:48,312 copying colossalai/legacy/amp/apex_amp/apex_amp.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:48,314 copying colossalai/legacy/amp/apex_amp/__init__.py -> build/lib/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:48,316 creating build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,317 copying colossalai/legacy/zero/gemini/tensor_utils.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,319 copying colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,321 copying colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,323 copying colossalai/legacy/zero/gemini/gemini_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,325 copying colossalai/legacy/zero/gemini/colo_init_context.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,327 copying colossalai/legacy/zero/gemini/stateful_tensor.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,329 copying colossalai/legacy/zero/gemini/__init__.py -> build/lib/colossalai/legacy/zero/gemini 2024-05-31T11:58:48,331 creating build/lib/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:48,332 copying colossalai/legacy/zero/init_ctx/__init__.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:48,334 copying colossalai/legacy/zero/init_ctx/init_context.py -> build/lib/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:48,337 creating build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,338 copying colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,340 copying colossalai/legacy/zero/shard_utils/commons.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,342 copying colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,343 copying colossalai/legacy/zero/shard_utils/__init__.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,345 copying colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/lib/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:48,347 creating build/lib/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:48,349 copying colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:48,351 copying colossalai/legacy/zero/sharded_optim/__init__.py -> build/lib/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:48,353 creating build/lib/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:48,355 copying colossalai/legacy/zero/sharded_param/sharded_param.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:48,356 copying colossalai/legacy/zero/sharded_param/__init__.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:48,358 copying colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/lib/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:48,360 creating build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,362 copying colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,364 copying colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,367 copying colossalai/legacy/zero/sharded_model/zero_hook.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,369 copying colossalai/legacy/zero/sharded_model/utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,371 copying colossalai/legacy/zero/sharded_model/_utils.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,372 copying colossalai/legacy/zero/sharded_model/__init__.py -> build/lib/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:48,375 creating build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,375 copying colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,378 copying colossalai/legacy/zero/gemini/ophooks/utils.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,380 copying colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,381 copying colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,383 copying colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:48,385 creating build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:48,386 copying colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:48,388 copying colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/lib/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:48,391 creating build/lib/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:48,392 copying colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:48,396 copying colossalai/legacy/utils/data_sampler/base_sampler.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:48,399 copying colossalai/legacy/utils/data_sampler/__init__.py -> build/lib/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:48,404 creating build/lib/colossalai/legacy/utils/profiler 2024-05-31T11:58:48,406 copying colossalai/legacy/utils/profiler/extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-05-31T11:58:48,409 copying colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/lib/colossalai/legacy/utils/profiler 2024-05-31T11:58:48,411 copying colossalai/legacy/utils/profiler/__init__.py -> build/lib/colossalai/legacy/utils/profiler 2024-05-31T11:58:48,413 copying colossalai/legacy/utils/profiler/profiler.py -> build/lib/colossalai/legacy/utils/profiler 2024-05-31T11:58:48,417 creating build/lib/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:48,418 copying colossalai/legacy/utils/checkpoint/utils.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:48,420 copying colossalai/legacy/utils/checkpoint/__init__.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:48,422 copying colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/lib/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:48,425 creating build/lib/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:48,426 copying colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:48,428 copying colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:48,430 copying colossalai/legacy/utils/profiler/legacy/__init__.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:48,432 copying colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/lib/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:48,435 creating build/lib/colossalai/legacy/nn/_ops 2024-05-31T11:58:48,436 copying colossalai/legacy/nn/_ops/_utils.py -> build/lib/colossalai/legacy/nn/_ops 2024-05-31T11:58:48,438 copying colossalai/legacy/nn/_ops/__init__.py -> build/lib/colossalai/legacy/nn/_ops 2024-05-31T11:58:48,441 creating build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,442 copying colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,444 copying colossalai/legacy/nn/metric/accuracy_3d.py -> build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,445 copying colossalai/legacy/nn/metric/_utils.py -> build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,447 copying colossalai/legacy/nn/metric/accuracy_2d.py -> build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,449 copying colossalai/legacy/nn/metric/__init__.py -> build/lib/colossalai/legacy/nn/metric 2024-05-31T11:58:48,451 creating build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,452 copying colossalai/legacy/nn/loss/loss_2p5d.py -> build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,454 copying colossalai/legacy/nn/loss/loss_2d.py -> build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,456 copying colossalai/legacy/nn/loss/loss_1d.py -> build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,458 copying colossalai/legacy/nn/loss/loss_3d.py -> build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,460 copying colossalai/legacy/nn/loss/__init__.py -> build/lib/colossalai/legacy/nn/loss 2024-05-31T11:58:48,462 creating build/lib/colossalai/legacy/nn/layer 2024-05-31T11:58:48,463 copying colossalai/legacy/nn/layer/base_layer.py -> build/lib/colossalai/legacy/nn/layer 2024-05-31T11:58:48,465 copying colossalai/legacy/nn/layer/__init__.py -> build/lib/colossalai/legacy/nn/layer 2024-05-31T11:58:48,467 creating build/lib/colossalai/legacy/nn/parallel 2024-05-31T11:58:48,469 copying colossalai/legacy/nn/parallel/reducer.py -> build/lib/colossalai/legacy/nn/parallel 2024-05-31T11:58:48,471 copying colossalai/legacy/nn/parallel/data_parallel.py -> build/lib/colossalai/legacy/nn/parallel 2024-05-31T11:58:48,473 copying colossalai/legacy/nn/parallel/__init__.py -> build/lib/colossalai/legacy/nn/parallel 2024-05-31T11:58:48,475 creating build/lib/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:48,476 copying colossalai/legacy/nn/layer/vanilla/layers.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:48,478 copying colossalai/legacy/nn/layer/vanilla/__init__.py -> build/lib/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:48,481 creating build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,482 copying colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,484 copying colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,486 copying colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,488 copying colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,490 copying colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,492 copying colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/lib/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:48,494 creating build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:48,495 copying colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:48,498 copying colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:48,501 copying colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:48,502 copying colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:48,505 creating build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:48,506 copying colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:48,508 copying colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:48,510 copying colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:48,512 copying colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:48,514 creating build/lib/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:48,516 copying colossalai/legacy/nn/layer/utils/common.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:48,518 copying colossalai/legacy/nn/layer/utils/__init__.py -> build/lib/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:48,521 creating build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:48,522 copying colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:48,526 copying colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:48,528 copying colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:48,530 copying colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:48,535 creating build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:48,537 copying colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:48,541 copying colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:48,543 copying colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:48,545 copying colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:48,549 creating build/lib/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:48,551 copying colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:48,553 copying colossalai/legacy/nn/layer/wrapper/__init__.py -> build/lib/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:48,556 creating build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:48,557 copying colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:48,561 copying colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:48,564 copying colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:48,566 copying colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/lib/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:48,570 creating build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,571 copying colossalai/legacy/nn/parallel/layers/linear.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,574 copying colossalai/legacy/nn/parallel/layers/colo_module.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,576 copying colossalai/legacy/nn/parallel/layers/embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,578 copying colossalai/legacy/nn/parallel/layers/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,580 copying colossalai/legacy/nn/parallel/layers/module_utils.py -> build/lib/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:48,584 creating build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,586 copying colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,588 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,591 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,593 copying colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,595 copying colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,598 copying colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,601 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,603 copying colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,606 copying colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:48,609 creating build/lib/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:48,610 copying colossalai/legacy/inference/hybridengine/engine.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:48,613 copying colossalai/legacy/inference/hybridengine/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:48,615 creating build/lib/colossalai/legacy/inference/pipeline 2024-05-31T11:58:48,616 copying colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/lib/colossalai/legacy/inference/pipeline 2024-05-31T11:58:48,618 copying colossalai/legacy/inference/pipeline/__init__.py -> build/lib/colossalai/legacy/inference/pipeline 2024-05-31T11:58:48,621 creating build/lib/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:48,622 copying colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:48,624 copying colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:48,626 copying colossalai/legacy/inference/tensor_parallel/engine.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:48,629 copying colossalai/legacy/inference/tensor_parallel/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:48,631 creating build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,632 copying colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,634 copying colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,636 copying colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,638 copying colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,641 copying colossalai/legacy/inference/dynamic_batching/stats.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,643 copying colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,646 copying colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,649 copying colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,651 copying colossalai/legacy/inference/dynamic_batching/__init__.py -> build/lib/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:48,653 creating build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:48,654 copying colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:48,656 copying colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:48,658 copying colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:48,661 creating build/lib/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:48,662 copying colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:48,664 copying colossalai/legacy/inference/hybridengine/polices/llama.py -> build/lib/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:48,667 creating build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,667 copying colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,670 copying colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,672 copying colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,674 copying colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,677 copying colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:48,680 creating build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:48,681 copying colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:48,683 copying colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:48,685 copying colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:48,687 copying colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/lib/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:48,690 creating build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,691 copying colossalai/legacy/trainer/hooks/_base_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,693 copying colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,695 copying colossalai/legacy/trainer/hooks/_metric_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,697 copying colossalai/legacy/trainer/hooks/_log_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,700 copying colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,702 copying colossalai/legacy/trainer/hooks/_commons_.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,704 copying colossalai/legacy/trainer/hooks/__init__.py -> build/lib/colossalai/legacy/trainer/hooks 2024-05-31T11:58:48,706 creating build/lib/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:48,707 copying colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:48,709 copying colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/lib/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:48,712 creating build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,713 copying colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,715 copying colossalai/legacy/engine/schedule/_base_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,717 copying colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,720 copying colossalai/legacy/engine/schedule/__init__.py -> build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,722 copying colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/lib/colossalai/legacy/engine/schedule 2024-05-31T11:58:48,725 creating build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,726 copying colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,728 copying colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,730 copying colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,732 copying colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,734 copying colossalai/legacy/engine/gradient_handler/utils.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,736 copying colossalai/legacy/engine/gradient_handler/__init__.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,738 copying colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,739 copying colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/lib/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:48,810 creating build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,811 copying colossalai/kernel/extensions/csrc/common/micros.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,813 copying colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,815 copying colossalai/kernel/extensions/csrc/common/data_type.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,818 copying colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,820 copying colossalai/kernel/extensions/csrc/common/target.h -> build/lib/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:48,822 creating build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,823 copying colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,828 copying colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,834 copying colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,837 copying colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,839 copying colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/lib/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:48,842 creating build/lib/colossalai/kernel/extensions/csrc/kernel 2024-05-31T11:58:48,842 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,843 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,846 copying colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,848 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,851 copying colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,855 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,859 copying colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,863 copying colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,865 copying colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,868 copying colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,870 copying colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,873 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,876 copying colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,879 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,881 copying colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,884 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,887 copying colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,889 copying colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,891 copying colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:48,894 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:48,895 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:48,897 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:48,899 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:48,901 copying colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:48,903 creating build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-05-31T11:58:48,904 copying colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-05-31T11:58:48,907 creating build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:48,908 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:48,910 copying colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:48,913 creating build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:48,914 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:48,916 copying colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/lib/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:49,021 /home/piwheels/.local/lib/python3.11/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-05-31T11:58:49,022 !! 2024-05-31T11:58:49,023 ******************************************************************************** 2024-05-31T11:58:49,023 Please avoid running ``setup.py`` directly. 2024-05-31T11:58:49,024 Instead, use pypa/build, pypa/installer or other 2024-05-31T11:58:49,024 standards-based tools. 2024-05-31T11:58:49,025 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-05-31T11:58:49,026 ******************************************************************************** 2024-05-31T11:58:49,027 !! 2024-05-31T11:58:49,027 self.initialize_options() 2024-05-31T11:58:49,047 installing to build/bdist.linux-armv7l/wheel 2024-05-31T11:58:49,048 running install 2024-05-31T11:58:49,072 running install_lib 2024-05-31T11:58:49,097 creating build/bdist.linux-armv7l 2024-05-31T11:58:49,098 creating build/bdist.linux-armv7l/wheel 2024-05-31T11:58:49,099 creating build/bdist.linux-armv7l/wheel/extensions 2024-05-31T11:58:49,101 creating build/bdist.linux-armv7l/wheel/extensions/pybind 2024-05-31T11:58:49,102 creating build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-05-31T11:58:49,103 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-05-31T11:58:49,105 copying build/lib/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-05-31T11:58:49,107 copying build/lib/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/cpu_adam 2024-05-31T11:58:49,109 creating build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-05-31T11:58:49,110 copying build/lib/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-05-31T11:58:49,112 copying build/lib/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/layernorm 2024-05-31T11:58:49,114 creating build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-05-31T11:58:49,115 copying build/lib/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-05-31T11:58:49,117 copying build/lib/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-05-31T11:58:49,119 copying build/lib/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/softmax 2024-05-31T11:58:49,121 creating build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-05-31T11:58:49,122 copying build/lib/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-05-31T11:58:49,124 copying build/lib/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/inference 2024-05-31T11:58:49,126 creating build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-05-31T11:58:49,127 copying build/lib/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-05-31T11:58:49,129 copying build/lib/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/optimizer 2024-05-31T11:58:49,131 copying build/lib/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind 2024-05-31T11:58:49,132 creating build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-05-31T11:58:49,133 copying build/lib/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-05-31T11:58:49,135 copying build/lib/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/moe 2024-05-31T11:58:49,137 creating build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-05-31T11:58:49,138 copying build/lib/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-05-31T11:58:49,140 copying build/lib/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-05-31T11:58:49,141 copying build/lib/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-05-31T11:58:49,143 copying build/lib/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/extensions/pybind/flash_attention 2024-05-31T11:58:49,145 creating build/bdist.linux-armv7l/wheel/extensions/csrc 2024-05-31T11:58:49,146 copying build/lib/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/extensions/csrc 2024-05-31T11:58:49,148 creating build/bdist.linux-armv7l/wheel/colossalai 2024-05-31T11:58:49,150 creating build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-05-31T11:58:49,151 copying build/lib/colossalai/lazy/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-05-31T11:58:49,154 copying build/lib/colossalai/lazy/construction.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-05-31T11:58:49,156 copying build/lib/colossalai/lazy/lazy_init.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-05-31T11:58:49,159 copying build/lib/colossalai/lazy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/lazy 2024-05-31T11:58:49,161 creating build/bdist.linux-armv7l/wheel/colossalai/_C 2024-05-31T11:58:49,162 copying build/lib/colossalai/_C/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_C 2024-05-31T11:58:49,164 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-05-31T11:58:49,165 copying build/lib/colossalai/pipeline/stage_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-05-31T11:58:49,168 copying build/lib/colossalai/pipeline/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-05-31T11:58:49,171 creating build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,172 copying build/lib/colossalai/pipeline/schedule/interleaved_pp.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,175 copying build/lib/colossalai/pipeline/schedule/base.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,176 copying build/lib/colossalai/pipeline/schedule/one_f_one_b.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,180 copying build/lib/colossalai/pipeline/schedule/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,183 copying build/lib/colossalai/pipeline/schedule/generate.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,187 copying build/lib/colossalai/pipeline/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline/schedule 2024-05-31T11:58:49,189 copying build/lib/colossalai/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/pipeline 2024-05-31T11:58:49,191 creating build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,192 copying build/lib/colossalai/testing/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,195 copying build/lib/colossalai/testing/pytest_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,197 copying build/lib/colossalai/testing/random.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,198 copying build/lib/colossalai/testing/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,200 copying build/lib/colossalai/testing/comparison.py -> build/bdist.linux-armv7l/wheel/colossalai/testing 2024-05-31T11:58:49,203 creating build/bdist.linux-armv7l/wheel/colossalai/booster 2024-05-31T11:58:49,205 creating build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,206 copying build/lib/colossalai/booster/mixed_precision/fp16_naive.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,207 copying build/lib/colossalai/booster/mixed_precision/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,209 copying build/lib/colossalai/booster/mixed_precision/fp16_torch.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,211 copying build/lib/colossalai/booster/mixed_precision/fp16_apex.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,213 copying build/lib/colossalai/booster/mixed_precision/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,215 copying build/lib/colossalai/booster/mixed_precision/mixed_precision_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,217 copying build/lib/colossalai/booster/mixed_precision/fp8.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/mixed_precision 2024-05-31T11:58:49,219 creating build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,220 copying build/lib/colossalai/booster/plugin/gemini_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,223 copying build/lib/colossalai/booster/plugin/torch_fsdp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,225 copying build/lib/colossalai/booster/plugin/torch_ddp_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,228 copying build/lib/colossalai/booster/plugin/low_level_zero_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,230 copying build/lib/colossalai/booster/plugin/moe_hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,233 copying build/lib/colossalai/booster/plugin/plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,235 copying build/lib/colossalai/booster/plugin/dp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,236 copying build/lib/colossalai/booster/plugin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,238 copying build/lib/colossalai/booster/plugin/hybrid_parallel_plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,241 copying build/lib/colossalai/booster/plugin/pp_plugin_base.py -> build/bdist.linux-armv7l/wheel/colossalai/booster/plugin 2024-05-31T11:58:49,243 copying build/lib/colossalai/booster/booster.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-05-31T11:58:49,246 copying build/lib/colossalai/booster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-05-31T11:58:49,247 copying build/lib/colossalai/booster/accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/booster 2024-05-31T11:58:49,250 creating build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,251 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,253 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-05-31T11:58:49,254 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:49,255 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:49,257 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:49,260 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:49,261 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module 2024-05-31T11:58:49,264 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,264 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,266 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,268 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,270 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,272 copying build/lib/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function 2024-05-31T11:58:49,274 copying build/lib/colossalai/fx/tracer/bias_addition_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/bias_addition_patch 2024-05-31T11:58:49,276 copying build/lib/colossalai/fx/tracer/experimental.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,278 copying build/lib/colossalai/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,281 copying build/lib/colossalai/fx/tracer/_tracer_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,283 copying build/lib/colossalai/fx/tracer/_symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,285 copying build/lib/colossalai/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,286 copying build/lib/colossalai/fx/tracer/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,289 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-05-31T11:58:49,290 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,291 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,294 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,295 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,297 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,299 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,301 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,302 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,304 copying build/lib/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_module 2024-05-31T11:58:49,306 creating build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,307 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,309 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,311 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,314 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,316 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,318 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,319 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,321 copying build/lib/colossalai/fx/tracer/meta_patch/patched_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch/patched_function 2024-05-31T11:58:49,323 copying build/lib/colossalai/fx/tracer/meta_patch/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer/meta_patch 2024-05-31T11:58:49,325 copying build/lib/colossalai/fx/tracer/_meta_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/tracer 2024-05-31T11:58:49,327 copying build/lib/colossalai/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,329 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,331 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,332 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,333 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,335 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,337 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,339 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/torch_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,341 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/python_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,343 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/arithmetic.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,344 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,346 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,348 copying build/lib/colossalai/fx/profiler/experimental/profiler_function/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_function 2024-05-31T11:58:49,350 creating build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,351 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,354 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,355 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,357 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,359 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/torch_op.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,361 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,363 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/convolution.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,365 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/rnn.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,367 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,369 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,370 copying build/lib/colossalai/fx/profiler/experimental/profiler_module/activation_function.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental/profiler_module 2024-05-31T11:58:49,373 copying build/lib/colossalai/fx/profiler/experimental/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,374 copying build/lib/colossalai/fx/profiler/experimental/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,376 copying build/lib/colossalai/fx/profiler/experimental/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,378 copying build/lib/colossalai/fx/profiler/experimental/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,380 copying build/lib/colossalai/fx/profiler/experimental/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler/experimental 2024-05-31T11:58:49,383 copying build/lib/colossalai/fx/profiler/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,385 copying build/lib/colossalai/fx/profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,387 copying build/lib/colossalai/fx/profiler/opcount.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,389 copying build/lib/colossalai/fx/profiler/dataflow.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,391 copying build/lib/colossalai/fx/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,393 copying build/lib/colossalai/fx/profiler/shard_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,395 copying build/lib/colossalai/fx/profiler/memory_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,397 copying build/lib/colossalai/fx/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/profiler 2024-05-31T11:58:49,400 copying build/lib/colossalai/fx/_meta_regist_12.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,403 creating build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,404 copying build/lib/colossalai/fx/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,406 copying build/lib/colossalai/fx/passes/concrete_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,408 copying build/lib/colossalai/fx/passes/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,411 copying build/lib/colossalai/fx/passes/split_module.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,413 copying build/lib/colossalai/fx/passes/shard_1d_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,415 copying build/lib/colossalai/fx/passes/adding_split_node_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,418 copying build/lib/colossalai/fx/passes/passes_for_gpt2_test.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,420 copying build/lib/colossalai/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/passes 2024-05-31T11:58:49,422 copying build/lib/colossalai/fx/_compatibility.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,424 creating build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-05-31T11:58:49,425 copying build/lib/colossalai/fx/codegen/activation_checkpoint_codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-05-31T11:58:49,429 copying build/lib/colossalai/fx/codegen/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx/codegen 2024-05-31T11:58:49,432 copying build/lib/colossalai/fx/_meta_regist_13.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,434 copying build/lib/colossalai/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,435 copying build/lib/colossalai/fx/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/fx 2024-05-31T11:58:49,438 creating build/bdist.linux-armv7l/wheel/colossalai/logging 2024-05-31T11:58:49,439 copying build/lib/colossalai/logging/logger.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-05-31T11:58:49,441 copying build/lib/colossalai/logging/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/logging 2024-05-31T11:58:49,443 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-05-31T11:58:49,444 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,445 copying build/lib/colossalai/auto_parallel/passes/meta_info_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,448 copying build/lib/colossalai/auto_parallel/passes/runtime_apply_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,451 copying build/lib/colossalai/auto_parallel/passes/runtime_preparation_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,454 copying build/lib/colossalai/auto_parallel/passes/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,456 copying build/lib/colossalai/auto_parallel/passes/comm_metainfo_pass.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,458 copying build/lib/colossalai/auto_parallel/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/passes 2024-05-31T11:58:49,460 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,461 copying build/lib/colossalai/auto_parallel/checkpoint/build_c_ext.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,463 copying build/lib/colossalai/auto_parallel/checkpoint/operation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,465 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_base.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,467 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,470 copying build/lib/colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,472 copying build/lib/colossalai/auto_parallel/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/checkpoint 2024-05-31T11:58:49,474 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,475 copying build/lib/colossalai/auto_parallel/tensor_shard/options.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,478 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,479 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,481 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,484 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,486 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,488 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,490 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,492 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,494 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,496 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,499 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,502 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,504 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,507 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,511 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,513 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,515 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,516 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,519 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,521 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,524 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,527 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,530 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,533 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,536 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,539 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,541 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,544 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,549 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,554 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,558 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,560 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,562 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,564 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,566 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,569 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler/strategy 2024-05-31T11:58:49,572 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,574 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,577 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,579 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,581 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,583 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,585 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,587 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,589 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,591 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,593 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,594 copying build/lib/colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/node_handler 2024-05-31T11:58:49,597 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,598 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/factory.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,601 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/broadcast.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,604 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/reshape.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,606 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,608 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/sharding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,610 copying build/lib/colossalai/auto_parallel/tensor_shard/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/utils 2024-05-31T11:58:49,611 copying build/lib/colossalai/auto_parallel/tensor_shard/sharding_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,614 copying build/lib/colossalai/auto_parallel/tensor_shard/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,616 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,617 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,619 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,622 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/cost_graph.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,624 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,627 copying build/lib/colossalai/auto_parallel/tensor_shard/solver/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard/solver 2024-05-31T11:58:49,629 copying build/lib/colossalai/auto_parallel/tensor_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,630 copying build/lib/colossalai/auto_parallel/tensor_shard/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/tensor_shard 2024-05-31T11:58:49,634 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-05-31T11:58:49,634 copying build/lib/colossalai/auto_parallel/pipeline_shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/pipeline_shard 2024-05-31T11:58:49,636 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,637 copying build/lib/colossalai/auto_parallel/offload/region.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,640 copying build/lib/colossalai/auto_parallel/offload/training_simulator.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,642 copying build/lib/colossalai/auto_parallel/offload/amp_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,645 copying build/lib/colossalai/auto_parallel/offload/util.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,647 copying build/lib/colossalai/auto_parallel/offload/region_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,649 copying build/lib/colossalai/auto_parallel/offload/solver.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,652 copying build/lib/colossalai/auto_parallel/offload/mem_optimize.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,654 copying build/lib/colossalai/auto_parallel/offload/base_offload_module.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,656 copying build/lib/colossalai/auto_parallel/offload/runtime.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,658 copying build/lib/colossalai/auto_parallel/offload/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/offload 2024-05-31T11:58:49,659 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:49,661 copying build/lib/colossalai/auto_parallel/meta_profiler/shard_metainfo.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:49,664 copying build/lib/colossalai/auto_parallel/meta_profiler/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:49,666 creating build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,667 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/norm.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,669 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,672 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,674 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,676 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/activation.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,678 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,680 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,682 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/where.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,684 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,686 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,688 copying build/lib/colossalai/auto_parallel/meta_profiler/meta_registry/conv.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler/meta_registry 2024-05-31T11:58:49,690 copying build/lib/colossalai/auto_parallel/meta_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:49,692 copying build/lib/colossalai/auto_parallel/meta_profiler/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel/meta_profiler 2024-05-31T11:58:49,694 copying build/lib/colossalai/auto_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/auto_parallel 2024-05-31T11:58:49,696 creating build/bdist.linux-armv7l/wheel/colossalai/context 2024-05-31T11:58:49,697 copying build/lib/colossalai/context/config.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-05-31T11:58:49,699 copying build/lib/colossalai/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-05-31T11:58:49,701 copying build/lib/colossalai/context/singleton_meta.py -> build/bdist.linux-armv7l/wheel/colossalai/context 2024-05-31T11:58:49,703 creating build/bdist.linux-armv7l/wheel/colossalai/amp 2024-05-31T11:58:49,704 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-05-31T11:58:49,705 copying build/lib/colossalai/amp/naive_amp/mixed_precision_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-05-31T11:58:49,709 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:49,710 copying build/lib/colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:49,712 copying build/lib/colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:49,714 copying build/lib/colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:49,716 copying build/lib/colossalai/amp/naive_amp/grad_scaler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/grad_scaler 2024-05-31T11:58:49,718 creating build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:49,719 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:49,721 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/base.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:49,722 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:49,725 copying build/lib/colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp/mixed_precision_mixin 2024-05-31T11:58:49,726 copying build/lib/colossalai/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp/naive_amp 2024-05-31T11:58:49,728 copying build/lib/colossalai/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/amp 2024-05-31T11:58:49,730 creating build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-05-31T11:58:49,731 copying build/lib/colossalai/quantization/bnb_config.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-05-31T11:58:49,733 copying build/lib/colossalai/quantization/bnb.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-05-31T11:58:49,736 copying build/lib/colossalai/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/quantization 2024-05-31T11:58:49,738 creating build/bdist.linux-armv7l/wheel/colossalai/zero 2024-05-31T11:58:49,740 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,741 copying build/lib/colossalai/zero/gemini/gemini_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,744 copying build/lib/colossalai/zero/gemini/gemini_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,746 copying build/lib/colossalai/zero/gemini/gemini_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,748 copying build/lib/colossalai/zero/gemini/gemini_ddp.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,751 copying build/lib/colossalai/zero/gemini/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,753 copying build/lib/colossalai/zero/gemini/placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,756 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,757 copying build/lib/colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,759 copying build/lib/colossalai/zero/gemini/memory_tracer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,761 copying build/lib/colossalai/zero/gemini/memory_tracer/static_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,763 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_monitor.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,765 copying build/lib/colossalai/zero/gemini/memory_tracer/memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,767 copying build/lib/colossalai/zero/gemini/memory_tracer/memory_stats.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,769 copying build/lib/colossalai/zero/gemini/memory_tracer/param_runtime_order.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,771 copying build/lib/colossalai/zero/gemini/memory_tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,772 copying build/lib/colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/memory_tracer 2024-05-31T11:58:49,775 creating build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,775 copying build/lib/colossalai/zero/gemini/chunk/chunk.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,778 copying build/lib/colossalai/zero/gemini/chunk/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,780 copying build/lib/colossalai/zero/gemini/chunk/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,783 copying build/lib/colossalai/zero/gemini/chunk/search_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,785 copying build/lib/colossalai/zero/gemini/chunk/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini/chunk 2024-05-31T11:58:49,786 copying build/lib/colossalai/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/gemini 2024-05-31T11:58:49,789 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-05-31T11:58:49,790 copying build/lib/colossalai/zero/low_level/low_level_optim.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-05-31T11:58:49,795 copying build/lib/colossalai/zero/low_level/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-05-31T11:58:49,798 creating build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,799 copying build/lib/colossalai/zero/low_level/bookkeeping/parameter_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,801 copying build/lib/colossalai/zero/low_level/bookkeeping/base_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,803 copying build/lib/colossalai/zero/low_level/bookkeeping/bucket_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,805 copying build/lib/colossalai/zero/low_level/bookkeeping/gradient_store.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,807 copying build/lib/colossalai/zero/low_level/bookkeeping/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,809 copying build/lib/colossalai/zero/low_level/bookkeeping/tensor_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level/bookkeeping 2024-05-31T11:58:49,811 copying build/lib/colossalai/zero/low_level/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero/low_level 2024-05-31T11:58:49,812 copying build/lib/colossalai/zero/wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-05-31T11:58:49,815 copying build/lib/colossalai/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/zero 2024-05-31T11:58:49,817 creating build/bdist.linux-armv7l/wheel/colossalai/interface 2024-05-31T11:58:49,818 copying build/lib/colossalai/interface/optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-05-31T11:58:49,820 copying build/lib/colossalai/interface/pretrained.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-05-31T11:58:49,822 copying build/lib/colossalai/interface/model.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-05-31T11:58:49,823 copying build/lib/colossalai/interface/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/interface 2024-05-31T11:58:49,826 creating build/bdist.linux-armv7l/wheel/colossalai/utils 2024-05-31T11:58:49,827 creating build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-05-31T11:58:49,828 copying build/lib/colossalai/utils/model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-05-31T11:58:49,830 copying build/lib/colossalai/utils/model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/model 2024-05-31T11:58:49,831 creating build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-05-31T11:58:49,832 copying build/lib/colossalai/utils/tensor_detector/tensor_detector.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-05-31T11:58:49,835 copying build/lib/colossalai/utils/tensor_detector/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/tensor_detector 2024-05-31T11:58:49,836 copying build/lib/colossalai/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-05-31T11:58:49,839 creating build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:49,839 copying build/lib/colossalai/utils/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:49,841 copying build/lib/colossalai/utils/multi_tensor_apply/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/multi_tensor_apply 2024-05-31T11:58:49,843 creating build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-05-31T11:58:49,844 copying build/lib/colossalai/utils/rank_recorder/rank_recorder.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-05-31T11:58:49,846 copying build/lib/colossalai/utils/rank_recorder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils/rank_recorder 2024-05-31T11:58:49,848 copying build/lib/colossalai/utils/timer.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-05-31T11:58:49,850 copying build/lib/colossalai/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-05-31T11:58:49,852 copying build/lib/colossalai/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/utils 2024-05-31T11:58:49,854 creating build/bdist.linux-armv7l/wheel/colossalai/nn 2024-05-31T11:58:49,856 creating build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-05-31T11:58:49,857 copying build/lib/colossalai/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/loss 2024-05-31T11:58:49,858 copying build/lib/colossalai/nn/init.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-05-31T11:58:49,861 creating build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,862 copying build/lib/colossalai/nn/lr_scheduler/onecycle.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,865 copying build/lib/colossalai/nn/lr_scheduler/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,866 copying build/lib/colossalai/nn/lr_scheduler/cosine.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,869 copying build/lib/colossalai/nn/lr_scheduler/delayed.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,871 copying build/lib/colossalai/nn/lr_scheduler/multistep.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,873 copying build/lib/colossalai/nn/lr_scheduler/torch.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,875 copying build/lib/colossalai/nn/lr_scheduler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,876 copying build/lib/colossalai/nn/lr_scheduler/poly.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/lr_scheduler 2024-05-31T11:58:49,879 creating build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,879 copying build/lib/colossalai/nn/optimizer/distributed_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,882 copying build/lib/colossalai/nn/optimizer/galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,884 copying build/lib/colossalai/nn/optimizer/fused_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,886 copying build/lib/colossalai/nn/optimizer/distributed_galore.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,889 copying build/lib/colossalai/nn/optimizer/lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,891 copying build/lib/colossalai/nn/optimizer/hybrid_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,893 copying build/lib/colossalai/nn/optimizer/lars.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,894 copying build/lib/colossalai/nn/optimizer/fused_lamb.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,897 copying build/lib/colossalai/nn/optimizer/cpu_adam.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,899 copying build/lib/colossalai/nn/optimizer/distributed_adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,902 copying build/lib/colossalai/nn/optimizer/nvme_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,904 copying build/lib/colossalai/nn/optimizer/adafactor.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,907 copying build/lib/colossalai/nn/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,908 copying build/lib/colossalai/nn/optimizer/fused_sgd.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,911 copying build/lib/colossalai/nn/optimizer/distributed_came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,913 copying build/lib/colossalai/nn/optimizer/came.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/optimizer 2024-05-31T11:58:49,916 copying build/lib/colossalai/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn 2024-05-31T11:58:49,918 creating build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-05-31T11:58:49,919 copying build/lib/colossalai/nn/layer/layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-05-31T11:58:49,921 copying build/lib/colossalai/nn/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-05-31T11:58:49,923 copying build/lib/colossalai/nn/layer/scaled_softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-05-31T11:58:49,925 copying build/lib/colossalai/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/nn/layer 2024-05-31T11:58:49,927 creating build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,928 copying build/lib/colossalai/inference/sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,931 copying build/lib/colossalai/inference/config.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,934 copying build/lib/colossalai/inference/graph_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,936 copying build/lib/colossalai/inference/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,938 creating build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-05-31T11:58:49,939 copying build/lib/colossalai/inference/kv_cache/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-05-31T11:58:49,942 copying build/lib/colossalai/inference/kv_cache/block_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-05-31T11:58:49,943 copying build/lib/colossalai/inference/kv_cache/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/kv_cache 2024-05-31T11:58:49,945 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-05-31T11:58:49,947 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-05-31T11:58:49,948 copying build/lib/colossalai/inference/modeling/policy/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-05-31T11:58:49,950 copying build/lib/colossalai/inference/modeling/policy/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-05-31T11:58:49,951 copying build/lib/colossalai/inference/modeling/policy/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-05-31T11:58:49,953 copying build/lib/colossalai/inference/modeling/policy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/policy 2024-05-31T11:58:49,956 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-05-31T11:58:49,956 copying build/lib/colossalai/inference/modeling/models/nopadding_baichuan.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-05-31T11:58:49,959 copying build/lib/colossalai/inference/modeling/models/glide_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-05-31T11:58:49,962 copying build/lib/colossalai/inference/modeling/models/nopadding_llama.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-05-31T11:58:49,965 copying build/lib/colossalai/inference/modeling/models/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/models 2024-05-31T11:58:49,967 creating build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-05-31T11:58:49,967 copying build/lib/colossalai/inference/modeling/layers/baichuan_tp_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-05-31T11:58:49,969 copying build/lib/colossalai/inference/modeling/layers/attention.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-05-31T11:58:49,972 copying build/lib/colossalai/inference/modeling/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling/layers 2024-05-31T11:58:49,974 copying build/lib/colossalai/inference/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/modeling 2024-05-31T11:58:49,975 copying build/lib/colossalai/inference/batch_bucket.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,978 copying build/lib/colossalai/inference/flash_decoding_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:49,980 creating build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,981 copying build/lib/colossalai/inference/core/rpc_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,984 copying build/lib/colossalai/inference/core/plugin.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,986 copying build/lib/colossalai/inference/core/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,989 copying build/lib/colossalai/inference/core/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,992 copying build/lib/colossalai/inference/core/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,994 copying build/lib/colossalai/inference/core/request_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/core 2024-05-31T11:58:49,997 creating build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-05-31T11:58:49,998 copying build/lib/colossalai/inference/spec/drafter.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-05-31T11:58:50,000 copying build/lib/colossalai/inference/spec/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-05-31T11:58:50,002 copying build/lib/colossalai/inference/spec/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/spec 2024-05-31T11:58:50,004 creating build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,005 copying build/lib/colossalai/inference/server/completion_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,007 copying build/lib/colossalai/inference/server/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,008 copying build/lib/colossalai/inference/server/api_server.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,011 copying build/lib/colossalai/inference/server/chat_service.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,013 copying build/lib/colossalai/inference/server/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference/server 2024-05-31T11:58:50,015 copying build/lib/colossalai/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:50,016 copying build/lib/colossalai/inference/logit_processors.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:50,019 copying build/lib/colossalai/inference/struct.py -> build/bdist.linux-armv7l/wheel/colossalai/inference 2024-05-31T11:58:50,021 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-05-31T11:58:50,023 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,024 copying build/lib/colossalai/shardformer/modeling/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,028 copying build/lib/colossalai/shardformer/modeling/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,033 copying build/lib/colossalai/shardformer/modeling/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,037 copying build/lib/colossalai/shardformer/modeling/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,041 copying build/lib/colossalai/shardformer/modeling/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,045 copying build/lib/colossalai/shardformer/modeling/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,050 copying build/lib/colossalai/shardformer/modeling/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,053 copying build/lib/colossalai/shardformer/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,057 copying build/lib/colossalai/shardformer/modeling/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,061 copying build/lib/colossalai/shardformer/modeling/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,065 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:50,066 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:50,071 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:50,074 copying build/lib/colossalai/shardformer/modeling/chatglm2_6b/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling/chatglm2_6b 2024-05-31T11:58:50,077 copying build/lib/colossalai/shardformer/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,079 copying build/lib/colossalai/shardformer/modeling/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,083 copying build/lib/colossalai/shardformer/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,088 copying build/lib/colossalai/shardformer/modeling/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,093 copying build/lib/colossalai/shardformer/modeling/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,097 copying build/lib/colossalai/shardformer/modeling/jit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,100 copying build/lib/colossalai/shardformer/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/modeling 2024-05-31T11:58:50,105 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,107 copying build/lib/colossalai/shardformer/policies/t5.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,110 copying build/lib/colossalai/shardformer/policies/whisper.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,114 copying build/lib/colossalai/shardformer/policies/qwen2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,118 copying build/lib/colossalai/shardformer/policies/opt.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,121 copying build/lib/colossalai/shardformer/policies/sam.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,125 copying build/lib/colossalai/shardformer/policies/base_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,128 copying build/lib/colossalai/shardformer/policies/bert.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,130 copying build/lib/colossalai/shardformer/policies/vit.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,133 copying build/lib/colossalai/shardformer/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,135 copying build/lib/colossalai/shardformer/policies/mistral.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,138 copying build/lib/colossalai/shardformer/policies/blip2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,140 copying build/lib/colossalai/shardformer/policies/auto_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,142 copying build/lib/colossalai/shardformer/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,144 copying build/lib/colossalai/shardformer/policies/falcon.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,146 copying build/lib/colossalai/shardformer/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,149 copying build/lib/colossalai/shardformer/policies/gpt2.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,152 copying build/lib/colossalai/shardformer/policies/gptj.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,154 copying build/lib/colossalai/shardformer/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/policies 2024-05-31T11:58:50,157 copying build/lib/colossalai/shardformer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-05-31T11:58:50,160 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,161 copying build/lib/colossalai/shardformer/shard/shardformer.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,163 copying build/lib/colossalai/shardformer/shard/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,165 copying build/lib/colossalai/shardformer/shard/shard_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,167 copying build/lib/colossalai/shardformer/shard/sharder.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,169 copying build/lib/colossalai/shardformer/shard/grad_ckpt_config.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,171 copying build/lib/colossalai/shardformer/shard/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/shard 2024-05-31T11:58:50,173 copying build/lib/colossalai/shardformer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer 2024-05-31T11:58:50,175 creating build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,176 copying build/lib/colossalai/shardformer/layer/attn.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,179 copying build/lib/colossalai/shardformer/layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,181 copying build/lib/colossalai/shardformer/layer/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,184 copying build/lib/colossalai/shardformer/layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,186 copying build/lib/colossalai/shardformer/layer/parallel_module.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,189 copying build/lib/colossalai/shardformer/layer/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,191 copying build/lib/colossalai/shardformer/layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,193 copying build/lib/colossalai/shardformer/layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,195 copying build/lib/colossalai/shardformer/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,197 copying build/lib/colossalai/shardformer/layer/qkv_fused_linear.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,200 copying build/lib/colossalai/shardformer/layer/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/shardformer/layer 2024-05-31T11:58:50,204 creating build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,205 copying build/lib/colossalai/accelerator/base_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,208 copying build/lib/colossalai/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,211 copying build/lib/colossalai/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,214 copying build/lib/colossalai/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,216 copying build/lib/colossalai/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,218 copying build/lib/colossalai/accelerator/api.py -> build/bdist.linux-armv7l/wheel/colossalai/accelerator 2024-05-31T11:58:50,220 copying build/lib/colossalai/version.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-05-31T11:58:50,222 creating build/bdist.linux-armv7l/wheel/colossalai/cli 2024-05-31T11:58:50,224 creating build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-05-31T11:58:50,225 copying build/lib/colossalai/cli/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-05-31T11:58:50,227 copying build/lib/colossalai/cli/launcher/hostinfo.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-05-31T11:58:50,229 copying build/lib/colossalai/cli/launcher/run.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-05-31T11:58:50,231 copying build/lib/colossalai/cli/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/launcher 2024-05-31T11:58:50,234 creating build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-05-31T11:58:50,234 copying build/lib/colossalai/cli/check/check_installation.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-05-31T11:58:50,237 copying build/lib/colossalai/cli/check/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli/check 2024-05-31T11:58:50,238 copying build/lib/colossalai/cli/cli.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-05-31T11:58:50,240 copying build/lib/colossalai/cli/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cli 2024-05-31T11:58:50,242 creating build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,243 copying build/lib/colossalai/cluster/process_group_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,246 copying build/lib/colossalai/cluster/process_group_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,248 copying build/lib/colossalai/cluster/dist_coordinator.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,250 copying build/lib/colossalai/cluster/device_mesh_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,252 copying build/lib/colossalai/cluster/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/cluster 2024-05-31T11:58:50,254 creating build/bdist.linux-armv7l/wheel/colossalai/device 2024-05-31T11:58:50,255 copying build/lib/colossalai/device/calc_pipeline_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-05-31T11:58:50,258 copying build/lib/colossalai/device/alpha_beta_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-05-31T11:58:50,262 copying build/lib/colossalai/device/device_mesh.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-05-31T11:58:50,265 copying build/lib/colossalai/device/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/device 2024-05-31T11:58:50,266 copying build/lib/colossalai/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-05-31T11:58:50,269 creating build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-05-31T11:58:50,270 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,271 copying build/lib/colossalai/kernel/extensions/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,275 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-05-31T11:58:50,276 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:50,277 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:50,279 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:50,281 copying build/lib/colossalai/kernel/extensions/pybind/cpu_adam/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/cpu_adam 2024-05-31T11:58:50,283 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:50,284 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:50,286 copying build/lib/colossalai/kernel/extensions/pybind/layernorm/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/layernorm 2024-05-31T11:58:50,288 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:50,289 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:50,291 copying build/lib/colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:50,293 copying build/lib/colossalai/kernel/extensions/pybind/softmax/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/softmax 2024-05-31T11:58:50,295 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:50,296 copying build/lib/colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:50,297 copying build/lib/colossalai/kernel/extensions/pybind/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/inference 2024-05-31T11:58:50,299 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:50,300 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:50,302 copying build/lib/colossalai/kernel/extensions/pybind/optimizer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/optimizer 2024-05-31T11:58:50,304 copying build/lib/colossalai/kernel/extensions/pybind/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind 2024-05-31T11:58:50,306 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:50,307 copying build/lib/colossalai/kernel/extensions/pybind/moe/moe_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:50,309 copying build/lib/colossalai/kernel/extensions/pybind/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/moe 2024-05-31T11:58:50,311 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:50,312 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:50,314 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:50,316 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:50,318 copying build/lib/colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/pybind/flash_attention 2024-05-31T11:58:50,320 copying build/lib/colossalai/kernel/extensions/triton_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,322 copying build/lib/colossalai/kernel/extensions/cuda_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,324 copying build/lib/colossalai/kernel/extensions/cpp_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,326 copying build/lib/colossalai/kernel/extensions/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,328 copying build/lib/colossalai/kernel/extensions/base_extension.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions 2024-05-31T11:58:50,330 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-05-31T11:58:50,331 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,332 copying build/lib/colossalai/kernel/extensions/csrc/common/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,335 copying build/lib/colossalai/kernel/extensions/csrc/common/mp_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,337 copying build/lib/colossalai/kernel/extensions/csrc/common/data_type.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,338 copying build/lib/colossalai/kernel/extensions/csrc/common/vec_type_traits.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,340 copying build/lib/colossalai/kernel/extensions/csrc/common/target.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/common 2024-05-31T11:58:50,342 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,343 copying build/lib/colossalai/kernel/extensions/csrc/funcs/ternary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,345 copying build/lib/colossalai/kernel/extensions/csrc/funcs/cast_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,348 copying build/lib/colossalai/kernel/extensions/csrc/funcs/binary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,351 copying build/lib/colossalai/kernel/extensions/csrc/funcs/unary_functor.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,352 copying build/lib/colossalai/kernel/extensions/csrc/funcs/reduce_function.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/funcs 2024-05-31T11:58:50,354 copying build/lib/colossalai/kernel/extensions/csrc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc 2024-05-31T11:58:50,357 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel 2024-05-31T11:58:50,359 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,360 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,363 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,365 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,368 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,371 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,374 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,377 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,380 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:50,381 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:50,382 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:50,384 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:50,386 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/utils 2024-05-31T11:58:50,388 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,390 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,394 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-05-31T11:58:50,394 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda/attention 2024-05-31T11:58:50,397 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,399 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,402 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,404 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,407 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,409 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,412 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,414 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,416 copying build/lib/colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/cuda 2024-05-31T11:58:50,419 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:50,420 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:50,422 copying build/lib/colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/x86 2024-05-31T11:58:50,425 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:50,426 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:50,429 copying build/lib/colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp -> build/bdist.linux-armv7l/wheel/colossalai/kernel/extensions/csrc/kernel/arm 2024-05-31T11:58:50,431 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-05-31T11:58:50,432 copying build/lib/colossalai/kernel/jit/option.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-05-31T11:58:50,434 copying build/lib/colossalai/kernel/jit/bias_dropout_add.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-05-31T11:58:50,436 copying build/lib/colossalai/kernel/jit/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-05-31T11:58:50,437 copying build/lib/colossalai/kernel/jit/bias_gelu.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/jit 2024-05-31T11:58:50,439 creating build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,440 copying build/lib/colossalai/kernel/triton/kvcache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,443 copying build/lib/colossalai/kernel/triton/llama_act_combine_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,445 copying build/lib/colossalai/kernel/triton/flash_decoding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,447 copying build/lib/colossalai/kernel/triton/no_pad_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,450 copying build/lib/colossalai/kernel/triton/rms_layernorm.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,452 copying build/lib/colossalai/kernel/triton/softmax.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,454 copying build/lib/colossalai/kernel/triton/rotary_cache_copy.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,457 copying build/lib/colossalai/kernel/triton/qkv_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,460 copying build/lib/colossalai/kernel/triton/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,462 copying build/lib/colossalai/kernel/triton/context_attn_unpad.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,468 copying build/lib/colossalai/kernel/triton/fused_rotary_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel/triton 2024-05-31T11:58:50,474 copying build/lib/colossalai/kernel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-05-31T11:58:50,476 copying build/lib/colossalai/kernel/kernel_loader.py -> build/bdist.linux-armv7l/wheel/colossalai/kernel 2024-05-31T11:58:50,478 creating build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,479 copying build/lib/colossalai/moe/checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,482 copying build/lib/colossalai/moe/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,485 copying build/lib/colossalai/moe/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,488 copying build/lib/colossalai/moe/loss.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,491 copying build/lib/colossalai/moe/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,495 copying build/lib/colossalai/moe/routers.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,500 copying build/lib/colossalai/moe/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,502 copying build/lib/colossalai/moe/load_balance.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,505 copying build/lib/colossalai/moe/experts.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,507 copying build/lib/colossalai/moe/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/moe 2024-05-31T11:58:50,509 copying build/lib/colossalai/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai 2024-05-31T11:58:50,512 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-05-31T11:58:50,513 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,514 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,515 copying build/lib/colossalai/_analyzer/fx/tracer/tracer.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,518 copying build/lib/colossalai/_analyzer/fx/tracer/custom_leaf_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,520 copying build/lib/colossalai/_analyzer/fx/tracer/bias_addition.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,523 copying build/lib/colossalai/_analyzer/fx/tracer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,524 copying build/lib/colossalai/_analyzer/fx/tracer/symbolic_trace.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,527 copying build/lib/colossalai/_analyzer/fx/tracer/proxy.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/tracer 2024-05-31T11:58:50,529 copying build/lib/colossalai/_analyzer/fx/graph_module.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,534 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-05-31T11:58:50,535 copying build/lib/colossalai/_analyzer/fx/passes/graph_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-05-31T11:58:50,541 copying build/lib/colossalai/_analyzer/fx/passes/shape_prop.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-05-31T11:58:50,544 copying build/lib/colossalai/_analyzer/fx/passes/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx/passes 2024-05-31T11:58:50,545 copying build/lib/colossalai/_analyzer/fx/node_util.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,548 copying build/lib/colossalai/_analyzer/fx/symbolic_profile.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,551 copying build/lib/colossalai/_analyzer/fx/codegen.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,554 copying build/lib/colossalai/_analyzer/fx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/fx 2024-05-31T11:58:50,556 copying build/lib/colossalai/_analyzer/envs.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-05-31T11:58:50,559 creating build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,560 copying build/lib/colossalai/_analyzer/_subclasses/_meta_registration.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,563 copying build/lib/colossalai/_analyzer/_subclasses/flop_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,567 copying build/lib/colossalai/_analyzer/_subclasses/meta_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,573 copying build/lib/colossalai/_analyzer/_subclasses/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,577 copying build/lib/colossalai/_analyzer/_subclasses/_monkey_patch.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer/_subclasses 2024-05-31T11:58:50,581 copying build/lib/colossalai/_analyzer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/_analyzer 2024-05-31T11:58:50,586 creating build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,590 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,593 copying build/lib/colossalai/tensor/d_tensor/layout.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,596 copying build/lib/colossalai/tensor/d_tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,599 copying build/lib/colossalai/tensor/d_tensor/misc.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,601 copying build/lib/colossalai/tensor/d_tensor/layout_converter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,606 copying build/lib/colossalai/tensor/d_tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,609 copying build/lib/colossalai/tensor/d_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,611 copying build/lib/colossalai/tensor/d_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,614 copying build/lib/colossalai/tensor/d_tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/d_tensor 2024-05-31T11:58:50,617 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-05-31T11:58:50,618 copying build/lib/colossalai/tensor/padded_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-05-31T11:58:50,620 copying build/lib/colossalai/tensor/padded_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/padded_tensor 2024-05-31T11:58:50,622 copying build/lib/colossalai/tensor/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,625 copying build/lib/colossalai/tensor/colo_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,628 creating build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-05-31T11:58:50,629 copying build/lib/colossalai/tensor/moe_tensor/moe_info.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-05-31T11:58:50,631 copying build/lib/colossalai/tensor/moe_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-05-31T11:58:50,633 copying build/lib/colossalai/tensor/moe_tensor/api.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor/moe_tensor 2024-05-31T11:58:50,636 copying build/lib/colossalai/tensor/shape_consistency.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,640 copying build/lib/colossalai/tensor/param_op_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,642 copying build/lib/colossalai/tensor/colo_parameter.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,644 copying build/lib/colossalai/tensor/comm_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,647 copying build/lib/colossalai/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,649 copying build/lib/colossalai/tensor/sharding_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/tensor 2024-05-31T11:58:50,652 creating build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,653 copying build/lib/colossalai/checkpoint_io/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,657 copying build/lib/colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,660 copying build/lib/colossalai/checkpoint_io/general_checkpoint_io.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,663 copying build/lib/colossalai/checkpoint_io/checkpoint_io_base.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,665 copying build/lib/colossalai/checkpoint_io/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,667 copying build/lib/colossalai/checkpoint_io/index_file.py -> build/bdist.linux-armv7l/wheel/colossalai/checkpoint_io 2024-05-31T11:58:50,669 creating build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:50,671 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,672 copying build/lib/colossalai/legacy/communication/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,674 copying build/lib/colossalai/legacy/communication/ring.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,676 copying build/lib/colossalai/legacy/communication/p2p.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,679 copying build/lib/colossalai/legacy/communication/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,680 copying build/lib/colossalai/legacy/communication/p2p_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,683 copying build/lib/colossalai/legacy/communication/collective.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/communication 2024-05-31T11:58:50,686 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,687 copying build/lib/colossalai/legacy/pipeline/layer_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,689 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:50,690 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:50,691 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:50,693 copying build/lib/colossalai/legacy/pipeline/middleware/adaptor/fx.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware/adaptor 2024-05-31T11:58:50,696 copying build/lib/colossalai/legacy/pipeline/middleware/topo.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:50,699 copying build/lib/colossalai/legacy/pipeline/middleware/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/middleware 2024-05-31T11:58:50,702 copying build/lib/colossalai/legacy/pipeline/pipelinable.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,704 copying build/lib/colossalai/legacy/pipeline/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,707 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:50,708 copying build/lib/colossalai/legacy/pipeline/rpc/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:50,710 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:50,713 copying build/lib/colossalai/legacy/pipeline/rpc/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:50,715 copying build/lib/colossalai/legacy/pipeline/rpc/_pipeline_base.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline/rpc 2024-05-31T11:58:50,718 copying build/lib/colossalai/legacy/pipeline/pipeline_process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,720 copying build/lib/colossalai/legacy/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/pipeline 2024-05-31T11:58:50,722 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-05-31T11:58:50,724 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,725 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_pipeline.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,727 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_model.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,729 copying build/lib/colossalai/legacy/context/process_group_initializer/process_group_initializer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,730 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,733 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,735 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_sequence.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,737 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,739 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,740 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,743 copying build/lib/colossalai/legacy/context/process_group_initializer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,744 copying build/lib/colossalai/legacy/context/process_group_initializer/initializer_data.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/process_group_initializer 2024-05-31T11:58:50,747 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-05-31T11:58:50,747 copying build/lib/colossalai/legacy/context/random/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-05-31T11:58:50,749 copying build/lib/colossalai/legacy/context/random/seed_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-05-31T11:58:50,751 copying build/lib/colossalai/legacy/context/random/_helper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context/random 2024-05-31T11:58:50,754 copying build/lib/colossalai/legacy/context/parallel_mode.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-05-31T11:58:50,755 copying build/lib/colossalai/legacy/context/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-05-31T11:58:50,757 copying build/lib/colossalai/legacy/context/parallel_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/context 2024-05-31T11:58:50,760 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-05-31T11:58:50,761 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:50,762 copying build/lib/colossalai/legacy/amp/naive_amp/naive_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:50,765 copying build/lib/colossalai/legacy/amp/naive_amp/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:50,766 copying build/lib/colossalai/legacy/amp/naive_amp/_fp16_optimizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:50,769 copying build/lib/colossalai/legacy/amp/naive_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/naive_amp 2024-05-31T11:58:50,771 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:50,772 copying build/lib/colossalai/legacy/amp/torch_amp/_grad_scaler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:50,775 copying build/lib/colossalai/legacy/amp/torch_amp/torch_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:50,777 copying build/lib/colossalai/legacy/amp/torch_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/torch_amp 2024-05-31T11:58:50,779 copying build/lib/colossalai/legacy/amp/amp_type.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-05-31T11:58:50,781 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:50,784 copying build/lib/colossalai/legacy/amp/apex_amp/apex_amp.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:50,786 copying build/lib/colossalai/legacy/amp/apex_amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp/apex_amp 2024-05-31T11:58:50,788 copying build/lib/colossalai/legacy/amp/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/amp 2024-05-31T11:58:50,790 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-05-31T11:58:50,791 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,792 copying build/lib/colossalai/legacy/zero/gemini/tensor_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,794 copying build/lib/colossalai/legacy/zero/gemini/tensor_placement_policy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,797 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,797 copying build/lib/colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,799 copying build/lib/colossalai/legacy/zero/gemini/ophooks/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,802 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,803 copying build/lib/colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,805 copying build/lib/colossalai/legacy/zero/gemini/ophooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/ophooks 2024-05-31T11:58:50,807 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,809 copying build/lib/colossalai/legacy/zero/gemini/gemini_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,810 copying build/lib/colossalai/legacy/zero/gemini/colo_init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,813 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:50,814 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:50,816 copying build/lib/colossalai/legacy/zero/gemini/paramhooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini/paramhooks 2024-05-31T11:58:50,818 copying build/lib/colossalai/legacy/zero/gemini/stateful_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,821 copying build/lib/colossalai/legacy/zero/gemini/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/gemini 2024-05-31T11:58:50,824 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:50,826 copying build/lib/colossalai/legacy/zero/init_ctx/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:50,828 copying build/lib/colossalai/legacy/zero/init_ctx/init_context.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/init_ctx 2024-05-31T11:58:50,832 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,834 copying build/lib/colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,837 copying build/lib/colossalai/legacy/zero/shard_utils/commons.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,839 copying build/lib/colossalai/legacy/zero/shard_utils/base_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,842 copying build/lib/colossalai/legacy/zero/shard_utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,845 copying build/lib/colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/shard_utils 2024-05-31T11:58:50,848 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:50,849 copying build/lib/colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:50,853 copying build/lib/colossalai/legacy/zero/sharded_optim/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_optim 2024-05-31T11:58:50,856 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:50,857 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_param.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:50,860 copying build/lib/colossalai/legacy/zero/sharded_param/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:50,862 copying build/lib/colossalai/legacy/zero/sharded_param/sharded_tensor.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_param 2024-05-31T11:58:50,865 copying build/lib/colossalai/legacy/zero/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero 2024-05-31T11:58:50,868 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,869 copying build/lib/colossalai/legacy/zero/sharded_model/reduce_scatter.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,873 copying build/lib/colossalai/legacy/zero/sharded_model/sharded_model_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,877 copying build/lib/colossalai/legacy/zero/sharded_model/zero_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,880 copying build/lib/colossalai/legacy/zero/sharded_model/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,882 copying build/lib/colossalai/legacy/zero/sharded_model/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,885 copying build/lib/colossalai/legacy/zero/sharded_model/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/zero/sharded_model 2024-05-31T11:58:50,887 copying build/lib/colossalai/legacy/core.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:50,890 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,892 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:50,894 copying build/lib/colossalai/legacy/utils/data_sampler/data_parallel_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:50,897 copying build/lib/colossalai/legacy/utils/data_sampler/base_sampler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:50,899 copying build/lib/colossalai/legacy/utils/data_sampler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/data_sampler 2024-05-31T11:58:50,902 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-05-31T11:58:50,904 copying build/lib/colossalai/legacy/utils/profiler/extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-05-31T11:58:50,907 copying build/lib/colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-05-31T11:58:50,909 copying build/lib/colossalai/legacy/utils/profiler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-05-31T11:58:50,912 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:50,913 copying build/lib/colossalai/legacy/utils/profiler/legacy/pcie_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:50,916 copying build/lib/colossalai/legacy/utils/profiler/legacy/comm_profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:50,920 copying build/lib/colossalai/legacy/utils/profiler/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:50,922 copying build/lib/colossalai/legacy/utils/profiler/legacy/prof_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler/legacy 2024-05-31T11:58:50,925 copying build/lib/colossalai/legacy/utils/profiler/profiler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/profiler 2024-05-31T11:58:50,928 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:50,929 copying build/lib/colossalai/legacy/utils/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:50,931 copying build/lib/colossalai/legacy/utils/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:50,933 copying build/lib/colossalai/legacy/utils/checkpoint/module_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils/checkpoint 2024-05-31T11:58:50,935 copying build/lib/colossalai/legacy/utils/checkpointing.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,938 copying build/lib/colossalai/legacy/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,940 copying build/lib/colossalai/legacy/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,942 copying build/lib/colossalai/legacy/utils/activation_checkpoint.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,945 copying build/lib/colossalai/legacy/utils/memory.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/utils 2024-05-31T11:58:50,947 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-05-31T11:58:50,949 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-05-31T11:58:50,950 copying build/lib/colossalai/legacy/nn/_ops/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-05-31T11:58:50,952 copying build/lib/colossalai/legacy/nn/_ops/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/_ops 2024-05-31T11:58:50,954 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,955 copying build/lib/colossalai/legacy/nn/metric/accuracy_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,957 copying build/lib/colossalai/legacy/nn/metric/accuracy_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,959 copying build/lib/colossalai/legacy/nn/metric/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,961 copying build/lib/colossalai/legacy/nn/metric/accuracy_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,962 copying build/lib/colossalai/legacy/nn/metric/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/metric 2024-05-31T11:58:50,965 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,966 copying build/lib/colossalai/legacy/nn/loss/loss_2p5d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,968 copying build/lib/colossalai/legacy/nn/loss/loss_2d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,970 copying build/lib/colossalai/legacy/nn/loss/loss_1d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,973 copying build/lib/colossalai/legacy/nn/loss/loss_3d.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,975 copying build/lib/colossalai/legacy/nn/loss/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/loss 2024-05-31T11:58:50,977 copying build/lib/colossalai/legacy/nn/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn 2024-05-31T11:58:50,979 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-05-31T11:58:50,980 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:50,981 copying build/lib/colossalai/legacy/nn/layer/vanilla/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:50,983 copying build/lib/colossalai/legacy/nn/layer/vanilla/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/vanilla 2024-05-31T11:58:50,985 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,986 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,989 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/normalization.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,991 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,993 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/dropout.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,995 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,997 copying build/lib/colossalai/legacy/nn/layer/colossalai_layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/colossalai_layer 2024-05-31T11:58:50,999 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:51,000 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:51,003 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:51,005 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:51,007 copying build/lib/colossalai/legacy/nn/layer/parallel_1d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_1d 2024-05-31T11:58:51,010 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:51,011 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:51,013 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:51,015 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:51,017 copying build/lib/colossalai/legacy/nn/layer/parallel_sequence/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_sequence 2024-05-31T11:58:51,019 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:51,020 copying build/lib/colossalai/legacy/nn/layer/utils/common.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:51,022 copying build/lib/colossalai/legacy/nn/layer/utils/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/utils 2024-05-31T11:58:51,025 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:51,026 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:51,029 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:51,030 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:51,032 copying build/lib/colossalai/legacy/nn/layer/parallel_2p5d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2p5d 2024-05-31T11:58:51,035 copying build/lib/colossalai/legacy/nn/layer/base_layer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-05-31T11:58:51,037 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:51,038 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:51,041 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:51,043 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:51,045 copying build/lib/colossalai/legacy/nn/layer/parallel_3d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_3d 2024-05-31T11:58:51,048 copying build/lib/colossalai/legacy/nn/layer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer 2024-05-31T11:58:51,050 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:51,050 copying build/lib/colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:51,052 copying build/lib/colossalai/legacy/nn/layer/wrapper/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/wrapper 2024-05-31T11:58:51,054 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:51,055 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/layers.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:51,059 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:51,060 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:51,062 copying build/lib/colossalai/legacy/nn/layer/parallel_2d/_operation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/layer/parallel_2d 2024-05-31T11:58:51,065 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-05-31T11:58:51,066 copying build/lib/colossalai/legacy/nn/parallel/reducer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-05-31T11:58:51,069 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,070 copying build/lib/colossalai/legacy/nn/parallel/layers/linear.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,072 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,073 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,075 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,078 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,080 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,082 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,085 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,086 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,088 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,090 copying build/lib/colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers/cache_embedding 2024-05-31T11:58:51,092 copying build/lib/colossalai/legacy/nn/parallel/layers/colo_module.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,094 copying build/lib/colossalai/legacy/nn/parallel/layers/embedding.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,096 copying build/lib/colossalai/legacy/nn/parallel/layers/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,097 copying build/lib/colossalai/legacy/nn/parallel/layers/module_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel/layers 2024-05-31T11:58:51,100 copying build/lib/colossalai/legacy/nn/parallel/data_parallel.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-05-31T11:58:51,102 copying build/lib/colossalai/legacy/nn/parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/nn/parallel 2024-05-31T11:58:51,104 copying build/lib/colossalai/legacy/constants.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:51,107 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-05-31T11:58:51,108 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:51,110 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:51,111 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:51,112 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:51,114 copying build/lib/colossalai/legacy/inference/hybridengine/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/modeling 2024-05-31T11:58:51,117 copying build/lib/colossalai/legacy/inference/hybridengine/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:51,119 copying build/lib/colossalai/legacy/inference/hybridengine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine 2024-05-31T11:58:51,121 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:51,122 copying build/lib/colossalai/legacy/inference/hybridengine/polices/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:51,124 copying build/lib/colossalai/legacy/inference/hybridengine/polices/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/hybridengine/polices 2024-05-31T11:58:51,127 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-05-31T11:58:51,128 copying build/lib/colossalai/legacy/inference/pipeline/microbatch_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-05-31T11:58:51,130 copying build/lib/colossalai/legacy/inference/pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/pipeline 2024-05-31T11:58:51,133 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:51,134 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,135 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,138 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/_utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,140 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,141 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,144 copying build/lib/colossalai/legacy/inference/tensor_parallel/modeling/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/modeling 2024-05-31T11:58:51,146 copying build/lib/colossalai/legacy/inference/tensor_parallel/kvcache_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:51,149 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:51,150 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:51,152 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:51,154 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/llama.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:51,156 copying build/lib/colossalai/legacy/inference/tensor_parallel/policies/bloom.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel/policies 2024-05-31T11:58:51,158 copying build/lib/colossalai/legacy/inference/tensor_parallel/batch_infer_state.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:51,160 copying build/lib/colossalai/legacy/inference/tensor_parallel/engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:51,162 copying build/lib/colossalai/legacy/inference/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/tensor_parallel 2024-05-31T11:58:51,164 copying build/lib/colossalai/legacy/inference/manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-05-31T11:58:51,167 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,168 copying build/lib/colossalai/legacy/inference/dynamic_batching/sampling_params.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,170 copying build/lib/colossalai/legacy/inference/dynamic_batching/get_tokenizer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,172 copying build/lib/colossalai/legacy/inference/dynamic_batching/io_struct.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,174 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_dist_init.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,176 copying build/lib/colossalai/legacy/inference/dynamic_batching/stats.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,178 copying build/lib/colossalai/legacy/inference/dynamic_batching/ray_init_config.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,180 copying build/lib/colossalai/legacy/inference/dynamic_batching/infer_batch.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,182 copying build/lib/colossalai/legacy/inference/dynamic_batching/req_queue.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,184 copying build/lib/colossalai/legacy/inference/dynamic_batching/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference/dynamic_batching 2024-05-31T11:58:51,186 copying build/lib/colossalai/legacy/inference/async_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-05-31T11:58:51,188 copying build/lib/colossalai/legacy/inference/async_manager.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-05-31T11:58:51,190 copying build/lib/colossalai/legacy/inference/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/inference 2024-05-31T11:58:51,192 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-05-31T11:58:51,194 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,195 copying build/lib/colossalai/legacy/trainer/hooks/_base_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,196 copying build/lib/colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,198 copying build/lib/colossalai/legacy/trainer/hooks/_metric_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,201 copying build/lib/colossalai/legacy/trainer/hooks/_log_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,203 copying build/lib/colossalai/legacy/trainer/hooks/_checkpoint_hook.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,205 copying build/lib/colossalai/legacy/trainer/hooks/_commons_.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,207 copying build/lib/colossalai/legacy/trainer/hooks/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer/hooks 2024-05-31T11:58:51,208 copying build/lib/colossalai/legacy/trainer/_trainer.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-05-31T11:58:51,211 copying build/lib/colossalai/legacy/trainer/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/trainer 2024-05-31T11:58:51,213 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-05-31T11:58:51,214 copying build/lib/colossalai/legacy/builder/builder.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-05-31T11:58:51,217 copying build/lib/colossalai/legacy/builder/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/builder 2024-05-31T11:58:51,219 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-05-31T11:58:51,220 copying build/lib/colossalai/legacy/engine/_base_engine.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-05-31T11:58:51,223 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:51,224 copying build/lib/colossalai/legacy/engine/gradient_accumulation/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:51,227 copying build/lib/colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_accumulation 2024-05-31T11:58:51,230 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,230 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,233 copying build/lib/colossalai/legacy/engine/schedule/_base_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,235 copying build/lib/colossalai/legacy/engine/schedule/_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,239 copying build/lib/colossalai/legacy/engine/schedule/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,241 copying build/lib/colossalai/legacy/engine/schedule/_non_pipeline_schedule.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/schedule 2024-05-31T11:58:51,244 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,244 copying build/lib/colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,246 copying build/lib/colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,248 copying build/lib/colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,250 copying build/lib/colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,252 copying build/lib/colossalai/legacy/engine/gradient_handler/utils.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,254 copying build/lib/colossalai/legacy/engine/gradient_handler/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,255 copying build/lib/colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,257 copying build/lib/colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine/gradient_handler 2024-05-31T11:58:51,259 copying build/lib/colossalai/legacy/engine/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/engine 2024-05-31T11:58:51,261 copying build/lib/colossalai/legacy/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:51,263 copying build/lib/colossalai/legacy/global_variables.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:51,265 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-05-31T11:58:51,266 copying build/lib/colossalai/legacy/registry/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-05-31T11:58:51,268 copying build/lib/colossalai/legacy/registry/registry.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/registry 2024-05-31T11:58:51,270 copying build/lib/colossalai/legacy/initialize.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy 2024-05-31T11:58:51,273 creating build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,274 copying build/lib/colossalai/legacy/tensor/process_group.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,276 copying build/lib/colossalai/legacy/tensor/distspec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,278 copying build/lib/colossalai/legacy/tensor/op_wrapper.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,280 copying build/lib/colossalai/legacy/tensor/dist_spec_mgr.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,282 copying build/lib/colossalai/legacy/tensor/tensor_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,284 copying build/lib/colossalai/legacy/tensor/__init__.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,286 copying build/lib/colossalai/legacy/tensor/compute_spec.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,288 copying build/lib/colossalai/legacy/tensor/const.py -> build/bdist.linux-armv7l/wheel/colossalai/legacy/tensor 2024-05-31T11:58:51,289 running install_egg_info 2024-05-31T11:58:51,320 running egg_info 2024-05-31T11:58:51,346 writing colossalai.egg-info/PKG-INFO 2024-05-31T11:58:51,350 writing dependency_links to colossalai.egg-info/dependency_links.txt 2024-05-31T11:58:51,352 writing entry points to colossalai.egg-info/entry_points.txt 2024-05-31T11:58:51,353 writing requirements to colossalai.egg-info/requires.txt 2024-05-31T11:58:51,355 writing top-level names to colossalai.egg-info/top_level.txt 2024-05-31T11:58:51,589 reading manifest file 'colossalai.egg-info/SOURCES.txt' 2024-05-31T11:58:51,637 reading manifest template 'MANIFEST.in' 2024-05-31T11:58:52,891 warning: no files found matching '*.tr' under directory 'colossalai' 2024-05-31T11:58:53,529 warning: no files found matching '*.cc' under directory 'colossalai' 2024-05-31T11:58:53,844 warning: no files found matching '*.pyi' under directory 'colossalai' 2024-05-31T11:58:53,989 warning: no files found matching '*.tr' under directory 'extensions' 2024-05-31T11:58:54,060 warning: no files found matching '*.cc' under directory 'extensions' 2024-05-31T11:58:54,088 warning: no files found matching '*.pyi' under directory 'extensions' 2024-05-31T11:58:54,089 adding license file 'LICENSE' 2024-05-31T11:58:54,133 writing manifest file 'colossalai.egg-info/SOURCES.txt' 2024-05-31T11:58:54,138 Copying colossalai.egg-info to build/bdist.linux-armv7l/wheel/colossalai-0.3.8-py3.11.egg-info 2024-05-31T11:58:54,152 running install_scripts 2024-05-31T11:58:54,178 creating build/bdist.linux-armv7l/wheel/colossalai-0.3.8.dist-info/WHEEL 2024-05-31T11:58:54,181 creating '/tmp/pip-wheel-ng5nz6qe/colossalai-0.3.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-05-31T11:58:54,184 adding 'colossalai/__init__.py' 2024-05-31T11:58:54,186 adding 'colossalai/initialize.py' 2024-05-31T11:58:54,187 adding 'colossalai/version.py' 2024-05-31T11:58:54,189 adding 'colossalai/_C/__init__.py' 2024-05-31T11:58:54,191 adding 'colossalai/_analyzer/__init__.py' 2024-05-31T11:58:54,193 adding 'colossalai/_analyzer/envs.py' 2024-05-31T11:58:54,195 adding 'colossalai/_analyzer/_subclasses/__init__.py' 2024-05-31T11:58:54,198 adding 'colossalai/_analyzer/_subclasses/_meta_registration.py' 2024-05-31T11:58:54,200 adding 'colossalai/_analyzer/_subclasses/_monkey_patch.py' 2024-05-31T11:58:54,203 adding 'colossalai/_analyzer/_subclasses/flop_tensor.py' 2024-05-31T11:58:54,205 adding 'colossalai/_analyzer/_subclasses/meta_tensor.py' 2024-05-31T11:58:54,207 adding 'colossalai/_analyzer/fx/__init__.py' 2024-05-31T11:58:54,210 adding 'colossalai/_analyzer/fx/codegen.py' 2024-05-31T11:58:54,213 adding 'colossalai/_analyzer/fx/graph_module.py' 2024-05-31T11:58:54,216 adding 'colossalai/_analyzer/fx/node_util.py' 2024-05-31T11:58:54,217 adding 'colossalai/_analyzer/fx/symbolic_profile.py' 2024-05-31T11:58:54,220 adding 'colossalai/_analyzer/fx/passes/__init__.py' 2024-05-31T11:58:54,223 adding 'colossalai/_analyzer/fx/passes/graph_profile.py' 2024-05-31T11:58:54,225 adding 'colossalai/_analyzer/fx/passes/shape_prop.py' 2024-05-31T11:58:54,227 adding 'colossalai/_analyzer/fx/tracer/__init__.py' 2024-05-31T11:58:54,229 adding 'colossalai/_analyzer/fx/tracer/bias_addition.py' 2024-05-31T11:58:54,231 adding 'colossalai/_analyzer/fx/tracer/custom_leaf_module.py' 2024-05-31T11:58:54,233 adding 'colossalai/_analyzer/fx/tracer/proxy.py' 2024-05-31T11:58:54,235 adding 'colossalai/_analyzer/fx/tracer/symbolic_trace.py' 2024-05-31T11:58:54,237 adding 'colossalai/_analyzer/fx/tracer/tracer.py' 2024-05-31T11:58:54,240 adding 'colossalai/accelerator/__init__.py' 2024-05-31T11:58:54,241 adding 'colossalai/accelerator/api.py' 2024-05-31T11:58:54,243 adding 'colossalai/accelerator/base_accelerator.py' 2024-05-31T11:58:54,245 adding 'colossalai/accelerator/cpu_accelerator.py' 2024-05-31T11:58:54,247 adding 'colossalai/accelerator/cuda_accelerator.py' 2024-05-31T11:58:54,249 adding 'colossalai/accelerator/npu_accelerator.py' 2024-05-31T11:58:54,252 adding 'colossalai/amp/__init__.py' 2024-05-31T11:58:54,253 adding 'colossalai/amp/naive_amp/__init__.py' 2024-05-31T11:58:54,255 adding 'colossalai/amp/naive_amp/mixed_precision_optimizer.py' 2024-05-31T11:58:54,258 adding 'colossalai/amp/naive_amp/grad_scaler/__init__.py' 2024-05-31T11:58:54,259 adding 'colossalai/amp/naive_amp/grad_scaler/base_grad_scaler.py' 2024-05-31T11:58:54,261 adding 'colossalai/amp/naive_amp/grad_scaler/constant_grad_scaler.py' 2024-05-31T11:58:54,263 adding 'colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py' 2024-05-31T11:58:54,265 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/__init__.py' 2024-05-31T11:58:54,267 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/base.py' 2024-05-31T11:58:54,268 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/bf16.py' 2024-05-31T11:58:54,270 adding 'colossalai/amp/naive_amp/mixed_precision_mixin/fp16.py' 2024-05-31T11:58:54,272 adding 'colossalai/auto_parallel/__init__.py' 2024-05-31T11:58:54,274 adding 'colossalai/auto_parallel/checkpoint/__init__.py' 2024-05-31T11:58:54,276 adding 'colossalai/auto_parallel/checkpoint/build_c_ext.py' 2024-05-31T11:58:54,278 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_base.py' 2024-05-31T11:58:54,280 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_chen.py' 2024-05-31T11:58:54,283 adding 'colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py' 2024-05-31T11:58:54,285 adding 'colossalai/auto_parallel/checkpoint/operation.py' 2024-05-31T11:58:54,286 adding 'colossalai/auto_parallel/meta_profiler/__init__.py' 2024-05-31T11:58:54,288 adding 'colossalai/auto_parallel/meta_profiler/constants.py' 2024-05-31T11:58:54,289 adding 'colossalai/auto_parallel/meta_profiler/registry.py' 2024-05-31T11:58:54,290 adding 'colossalai/auto_parallel/meta_profiler/shard_metainfo.py' 2024-05-31T11:58:54,292 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/__init__.py' 2024-05-31T11:58:54,294 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/activation.py' 2024-05-31T11:58:54,295 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/binary_elementwise_ops.py' 2024-05-31T11:58:54,296 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/conv.py' 2024-05-31T11:58:54,298 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/embedding.py' 2024-05-31T11:58:54,300 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/linear.py' 2024-05-31T11:58:54,302 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/non_spmd.py' 2024-05-31T11:58:54,304 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/norm.py' 2024-05-31T11:58:54,305 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/pooling.py' 2024-05-31T11:58:54,306 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/tensor.py' 2024-05-31T11:58:54,308 adding 'colossalai/auto_parallel/meta_profiler/meta_registry/where.py' 2024-05-31T11:58:54,309 adding 'colossalai/auto_parallel/offload/__init__.py' 2024-05-31T11:58:54,311 adding 'colossalai/auto_parallel/offload/amp_optimizer.py' 2024-05-31T11:58:54,312 adding 'colossalai/auto_parallel/offload/base_offload_module.py' 2024-05-31T11:58:54,314 adding 'colossalai/auto_parallel/offload/mem_optimize.py' 2024-05-31T11:58:54,315 adding 'colossalai/auto_parallel/offload/region.py' 2024-05-31T11:58:54,318 adding 'colossalai/auto_parallel/offload/region_manager.py' 2024-05-31T11:58:54,319 adding 'colossalai/auto_parallel/offload/runtime.py' 2024-05-31T11:58:54,322 adding 'colossalai/auto_parallel/offload/solver.py' 2024-05-31T11:58:54,324 adding 'colossalai/auto_parallel/offload/training_simulator.py' 2024-05-31T11:58:54,325 adding 'colossalai/auto_parallel/offload/util.py' 2024-05-31T11:58:54,327 adding 'colossalai/auto_parallel/passes/__init__.py' 2024-05-31T11:58:54,328 adding 'colossalai/auto_parallel/passes/comm_metainfo_pass.py' 2024-05-31T11:58:54,329 adding 'colossalai/auto_parallel/passes/constants.py' 2024-05-31T11:58:54,330 adding 'colossalai/auto_parallel/passes/meta_info_prop.py' 2024-05-31T11:58:54,332 adding 'colossalai/auto_parallel/passes/runtime_apply_pass.py' 2024-05-31T11:58:54,335 adding 'colossalai/auto_parallel/passes/runtime_preparation_pass.py' 2024-05-31T11:58:54,337 adding 'colossalai/auto_parallel/pipeline_shard/__init__.py' 2024-05-31T11:58:54,338 adding 'colossalai/auto_parallel/tensor_shard/__init__.py' 2024-05-31T11:58:54,340 adding 'colossalai/auto_parallel/tensor_shard/constants.py' 2024-05-31T11:58:54,342 adding 'colossalai/auto_parallel/tensor_shard/initialize.py' 2024-05-31T11:58:54,343 adding 'colossalai/auto_parallel/tensor_shard/options.py' 2024-05-31T11:58:54,345 adding 'colossalai/auto_parallel/tensor_shard/sharding_strategy.py' 2024-05-31T11:58:54,347 adding 'colossalai/auto_parallel/tensor_shard/node_handler/__init__.py' 2024-05-31T11:58:54,348 adding 'colossalai/auto_parallel/tensor_shard/node_handler/addmm_handler.py' 2024-05-31T11:58:54,350 adding 'colossalai/auto_parallel/tensor_shard/node_handler/batch_norm_handler.py' 2024-05-31T11:58:54,351 adding 'colossalai/auto_parallel/tensor_shard/node_handler/binary_elementwise_handler.py' 2024-05-31T11:58:54,353 adding 'colossalai/auto_parallel/tensor_shard/node_handler/bmm_handler.py' 2024-05-31T11:58:54,354 adding 'colossalai/auto_parallel/tensor_shard/node_handler/conv_handler.py' 2024-05-31T11:58:54,355 adding 'colossalai/auto_parallel/tensor_shard/node_handler/default_reshape_handler.py' 2024-05-31T11:58:54,357 adding 'colossalai/auto_parallel/tensor_shard/node_handler/embedding_handler.py' 2024-05-31T11:58:54,358 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getattr_handler.py' 2024-05-31T11:58:54,359 adding 'colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py' 2024-05-31T11:58:54,361 adding 'colossalai/auto_parallel/tensor_shard/node_handler/layer_norm_handler.py' 2024-05-31T11:58:54,363 adding 'colossalai/auto_parallel/tensor_shard/node_handler/linear_handler.py' 2024-05-31T11:58:54,365 adding 'colossalai/auto_parallel/tensor_shard/node_handler/matmul_handler.py' 2024-05-31T11:58:54,368 adding 'colossalai/auto_parallel/tensor_shard/node_handler/node_handler.py' 2024-05-31T11:58:54,369 adding 'colossalai/auto_parallel/tensor_shard/node_handler/normal_pooling_handler.py' 2024-05-31T11:58:54,370 adding 'colossalai/auto_parallel/tensor_shard/node_handler/output_handler.py' 2024-05-31T11:58:54,372 adding 'colossalai/auto_parallel/tensor_shard/node_handler/permute_handler.py' 2024-05-31T11:58:54,373 adding 'colossalai/auto_parallel/tensor_shard/node_handler/placeholder_handler.py' 2024-05-31T11:58:54,374 adding 'colossalai/auto_parallel/tensor_shard/node_handler/registry.py' 2024-05-31T11:58:54,375 adding 'colossalai/auto_parallel/tensor_shard/node_handler/softmax_handler.py' 2024-05-31T11:58:54,377 adding 'colossalai/auto_parallel/tensor_shard/node_handler/split_handler.py' 2024-05-31T11:58:54,378 adding 'colossalai/auto_parallel/tensor_shard/node_handler/sum_handler.py' 2024-05-31T11:58:54,379 adding 'colossalai/auto_parallel/tensor_shard/node_handler/tensor_constructor_handler.py' 2024-05-31T11:58:54,381 adding 'colossalai/auto_parallel/tensor_shard/node_handler/transpose_handler.py' 2024-05-31T11:58:54,382 adding 'colossalai/auto_parallel/tensor_shard/node_handler/unary_elementwise_handler.py' 2024-05-31T11:58:54,383 adding 'colossalai/auto_parallel/tensor_shard/node_handler/view_handler.py' 2024-05-31T11:58:54,384 adding 'colossalai/auto_parallel/tensor_shard/node_handler/where_handler.py' 2024-05-31T11:58:54,386 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/__init__.py' 2024-05-31T11:58:54,388 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/batch_norm_generator.py' 2024-05-31T11:58:54,389 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/binary_elementwise_generator.py' 2024-05-31T11:58:54,391 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/conv_strategy_generator.py' 2024-05-31T11:58:54,393 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/embedding_generator.py' 2024-05-31T11:58:54,394 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getattr_generator.py' 2024-05-31T11:58:54,396 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/getitem_generator.py' 2024-05-31T11:58:54,398 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/layer_norm_generator.py' 2024-05-31T11:58:54,401 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/matmul_strategy_generator.py' 2024-05-31T11:58:54,402 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/normal_pooling_generator.py' 2024-05-31T11:58:54,404 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/output_generator.py' 2024-05-31T11:58:54,405 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/placeholder_generator.py' 2024-05-31T11:58:54,407 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/reshape_generator.py' 2024-05-31T11:58:54,408 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/softmax_generator.py' 2024-05-31T11:58:54,410 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/strategy_generator.py' 2024-05-31T11:58:54,412 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/sum_generator.py' 2024-05-31T11:58:54,413 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/tensor_constructor_generator.py' 2024-05-31T11:58:54,415 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/unary_elementwise_generator.py' 2024-05-31T11:58:54,416 adding 'colossalai/auto_parallel/tensor_shard/node_handler/strategy/where_generator.py' 2024-05-31T11:58:54,418 adding 'colossalai/auto_parallel/tensor_shard/solver/__init__.py' 2024-05-31T11:58:54,420 adding 'colossalai/auto_parallel/tensor_shard/solver/cost_graph.py' 2024-05-31T11:58:54,421 adding 'colossalai/auto_parallel/tensor_shard/solver/graph_analysis.py' 2024-05-31T11:58:54,424 adding 'colossalai/auto_parallel/tensor_shard/solver/solver.py' 2024-05-31T11:58:54,425 adding 'colossalai/auto_parallel/tensor_shard/solver/strategies_constructor.py' 2024-05-31T11:58:54,427 adding 'colossalai/auto_parallel/tensor_shard/utils/__init__.py' 2024-05-31T11:58:54,429 adding 'colossalai/auto_parallel/tensor_shard/utils/broadcast.py' 2024-05-31T11:58:54,431 adding 'colossalai/auto_parallel/tensor_shard/utils/factory.py' 2024-05-31T11:58:54,432 adding 'colossalai/auto_parallel/tensor_shard/utils/misc.py' 2024-05-31T11:58:54,434 adding 'colossalai/auto_parallel/tensor_shard/utils/reshape.py' 2024-05-31T11:58:54,435 adding 'colossalai/auto_parallel/tensor_shard/utils/sharding.py' 2024-05-31T11:58:54,437 adding 'colossalai/booster/__init__.py' 2024-05-31T11:58:54,438 adding 'colossalai/booster/accelerator.py' 2024-05-31T11:58:54,441 adding 'colossalai/booster/booster.py' 2024-05-31T11:58:54,443 adding 'colossalai/booster/mixed_precision/__init__.py' 2024-05-31T11:58:54,444 adding 'colossalai/booster/mixed_precision/bf16.py' 2024-05-31T11:58:54,445 adding 'colossalai/booster/mixed_precision/fp16_apex.py' 2024-05-31T11:58:54,446 adding 'colossalai/booster/mixed_precision/fp16_naive.py' 2024-05-31T11:58:54,448 adding 'colossalai/booster/mixed_precision/fp16_torch.py' 2024-05-31T11:58:54,449 adding 'colossalai/booster/mixed_precision/fp8.py' 2024-05-31T11:58:54,450 adding 'colossalai/booster/mixed_precision/mixed_precision_base.py' 2024-05-31T11:58:54,451 adding 'colossalai/booster/plugin/__init__.py' 2024-05-31T11:58:54,453 adding 'colossalai/booster/plugin/dp_plugin_base.py' 2024-05-31T11:58:54,456 adding 'colossalai/booster/plugin/gemini_plugin.py' 2024-05-31T11:58:54,462 adding 'colossalai/booster/plugin/hybrid_parallel_plugin.py' 2024-05-31T11:58:54,465 adding 'colossalai/booster/plugin/low_level_zero_plugin.py' 2024-05-31T11:58:54,467 adding 'colossalai/booster/plugin/moe_hybrid_parallel_plugin.py' 2024-05-31T11:58:54,469 adding 'colossalai/booster/plugin/plugin_base.py' 2024-05-31T11:58:54,470 adding 'colossalai/booster/plugin/pp_plugin_base.py' 2024-05-31T11:58:54,471 adding 'colossalai/booster/plugin/torch_ddp_plugin.py' 2024-05-31T11:58:54,474 adding 'colossalai/booster/plugin/torch_fsdp_plugin.py' 2024-05-31T11:58:54,475 adding 'colossalai/checkpoint_io/__init__.py' 2024-05-31T11:58:54,478 adding 'colossalai/checkpoint_io/checkpoint_io_base.py' 2024-05-31T11:58:54,479 adding 'colossalai/checkpoint_io/general_checkpoint_io.py' 2024-05-31T11:58:54,484 adding 'colossalai/checkpoint_io/hybrid_parallel_checkpoint_io.py' 2024-05-31T11:58:54,485 adding 'colossalai/checkpoint_io/index_file.py' 2024-05-31T11:58:54,489 adding 'colossalai/checkpoint_io/utils.py' 2024-05-31T11:58:54,491 adding 'colossalai/cli/__init__.py' 2024-05-31T11:58:54,492 adding 'colossalai/cli/cli.py' 2024-05-31T11:58:54,494 adding 'colossalai/cli/check/__init__.py' 2024-05-31T11:58:54,495 adding 'colossalai/cli/check/check_installation.py' 2024-05-31T11:58:54,497 adding 'colossalai/cli/launcher/__init__.py' 2024-05-31T11:58:54,499 adding 'colossalai/cli/launcher/hostinfo.py' 2024-05-31T11:58:54,500 adding 'colossalai/cli/launcher/multinode_runner.py' 2024-05-31T11:58:54,502 adding 'colossalai/cli/launcher/run.py' 2024-05-31T11:58:54,504 adding 'colossalai/cluster/__init__.py' 2024-05-31T11:58:54,505 adding 'colossalai/cluster/device_mesh_manager.py' 2024-05-31T11:58:54,507 adding 'colossalai/cluster/dist_coordinator.py' 2024-05-31T11:58:54,508 adding 'colossalai/cluster/process_group_manager.py' 2024-05-31T11:58:54,510 adding 'colossalai/cluster/process_group_mesh.py' 2024-05-31T11:58:54,512 adding 'colossalai/context/__init__.py' 2024-05-31T11:58:54,513 adding 'colossalai/context/config.py' 2024-05-31T11:58:54,514 adding 'colossalai/context/singleton_meta.py' 2024-05-31T11:58:54,516 adding 'colossalai/device/__init__.py' 2024-05-31T11:58:54,518 adding 'colossalai/device/alpha_beta_profiler.py' 2024-05-31T11:58:54,520 adding 'colossalai/device/calc_pipeline_strategy.py' 2024-05-31T11:58:54,522 adding 'colossalai/device/device_mesh.py' 2024-05-31T11:58:54,524 adding 'colossalai/fx/__init__.py' 2024-05-31T11:58:54,526 adding 'colossalai/fx/_compatibility.py' 2024-05-31T11:58:54,528 adding 'colossalai/fx/_meta_regist_12.py' 2024-05-31T11:58:54,529 adding 'colossalai/fx/_meta_regist_13.py' 2024-05-31T11:58:54,531 adding 'colossalai/fx/graph_module.py' 2024-05-31T11:58:54,533 adding 'colossalai/fx/proxy.py' 2024-05-31T11:58:54,534 adding 'colossalai/fx/codegen/__init__.py' 2024-05-31T11:58:54,538 adding 'colossalai/fx/codegen/activation_checkpoint_codegen.py' 2024-05-31T11:58:54,540 adding 'colossalai/fx/passes/__init__.py' 2024-05-31T11:58:54,542 adding 'colossalai/fx/passes/adding_split_node_pass.py' 2024-05-31T11:58:54,544 adding 'colossalai/fx/passes/concrete_info_prop.py' 2024-05-31T11:58:54,546 adding 'colossalai/fx/passes/meta_info_prop.py' 2024-05-31T11:58:54,549 adding 'colossalai/fx/passes/passes_for_gpt2_test.py' 2024-05-31T11:58:54,550 adding 'colossalai/fx/passes/shard_1d_pass.py' 2024-05-31T11:58:54,552 adding 'colossalai/fx/passes/split_module.py' 2024-05-31T11:58:54,554 adding 'colossalai/fx/passes/utils.py' 2024-05-31T11:58:54,555 adding 'colossalai/fx/profiler/__init__.py' 2024-05-31T11:58:54,556 adding 'colossalai/fx/profiler/constants.py' 2024-05-31T11:58:54,558 adding 'colossalai/fx/profiler/dataflow.py' 2024-05-31T11:58:54,559 adding 'colossalai/fx/profiler/memory_utils.py' 2024-05-31T11:58:54,561 adding 'colossalai/fx/profiler/opcount.py' 2024-05-31T11:58:54,563 adding 'colossalai/fx/profiler/profiler.py' 2024-05-31T11:58:54,564 adding 'colossalai/fx/profiler/shard_utils.py' 2024-05-31T11:58:54,566 adding 'colossalai/fx/profiler/tensor.py' 2024-05-31T11:58:54,567 adding 'colossalai/fx/profiler/experimental/__init__.py' 2024-05-31T11:58:54,568 adding 'colossalai/fx/profiler/experimental/constants.py' 2024-05-31T11:58:54,570 adding 'colossalai/fx/profiler/experimental/profiler.py' 2024-05-31T11:58:54,571 adding 'colossalai/fx/profiler/experimental/registry.py' 2024-05-31T11:58:54,572 adding 'colossalai/fx/profiler/experimental/shard_utils.py' 2024-05-31T11:58:54,574 adding 'colossalai/fx/profiler/experimental/profiler_function/__init__.py' 2024-05-31T11:58:54,575 adding 'colossalai/fx/profiler/experimental/profiler_function/activation_function.py' 2024-05-31T11:58:54,576 adding 'colossalai/fx/profiler/experimental/profiler_function/arithmetic.py' 2024-05-31T11:58:54,577 adding 'colossalai/fx/profiler/experimental/profiler_function/embedding.py' 2024-05-31T11:58:54,578 adding 'colossalai/fx/profiler/experimental/profiler_function/linear.py' 2024-05-31T11:58:54,579 adding 'colossalai/fx/profiler/experimental/profiler_function/normalization.py' 2024-05-31T11:58:54,580 adding 'colossalai/fx/profiler/experimental/profiler_function/pooling.py' 2024-05-31T11:58:54,582 adding 'colossalai/fx/profiler/experimental/profiler_function/python_ops.py' 2024-05-31T11:58:54,583 adding 'colossalai/fx/profiler/experimental/profiler_function/torch_ops.py' 2024-05-31T11:58:54,585 adding 'colossalai/fx/profiler/experimental/profiler_module/__init__.py' 2024-05-31T11:58:54,586 adding 'colossalai/fx/profiler/experimental/profiler_module/activation_function.py' 2024-05-31T11:58:54,587 adding 'colossalai/fx/profiler/experimental/profiler_module/attention.py' 2024-05-31T11:58:54,588 adding 'colossalai/fx/profiler/experimental/profiler_module/convolution.py' 2024-05-31T11:58:54,590 adding 'colossalai/fx/profiler/experimental/profiler_module/dropout.py' 2024-05-31T11:58:54,591 adding 'colossalai/fx/profiler/experimental/profiler_module/embedding.py' 2024-05-31T11:58:54,592 adding 'colossalai/fx/profiler/experimental/profiler_module/linear.py' 2024-05-31T11:58:54,593 adding 'colossalai/fx/profiler/experimental/profiler_module/normalization.py' 2024-05-31T11:58:54,594 adding 'colossalai/fx/profiler/experimental/profiler_module/pooling.py' 2024-05-31T11:58:54,595 adding 'colossalai/fx/profiler/experimental/profiler_module/rnn.py' 2024-05-31T11:58:54,597 adding 'colossalai/fx/profiler/experimental/profiler_module/torch_op.py' 2024-05-31T11:58:54,598 adding 'colossalai/fx/tracer/__init__.py' 2024-05-31T11:58:54,600 adding 'colossalai/fx/tracer/_meta_trace.py' 2024-05-31T11:58:54,601 adding 'colossalai/fx/tracer/_symbolic_trace.py' 2024-05-31T11:58:54,602 adding 'colossalai/fx/tracer/_tracer_utils.py' 2024-05-31T11:58:54,605 adding 'colossalai/fx/tracer/experimental.py' 2024-05-31T11:58:54,607 adding 'colossalai/fx/tracer/registry.py' 2024-05-31T11:58:54,610 adding 'colossalai/fx/tracer/tracer.py' 2024-05-31T11:58:54,612 adding 'colossalai/fx/tracer/bias_addition_patch/__init__.py' 2024-05-31T11:58:54,613 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/__init__.py' 2024-05-31T11:58:54,615 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addbmm.py' 2024-05-31T11:58:54,616 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/addmm.py' 2024-05-31T11:58:54,617 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/bias_addition_function.py' 2024-05-31T11:58:54,619 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_function/linear.py' 2024-05-31T11:58:54,620 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/__init__.py' 2024-05-31T11:58:54,621 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/bias_addition_module.py' 2024-05-31T11:58:54,623 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/conv.py' 2024-05-31T11:58:54,624 adding 'colossalai/fx/tracer/bias_addition_patch/patched_bias_addition_module/linear.py' 2024-05-31T11:58:54,625 adding 'colossalai/fx/tracer/meta_patch/__init__.py' 2024-05-31T11:58:54,627 adding 'colossalai/fx/tracer/meta_patch/patched_function/__init__.py' 2024-05-31T11:58:54,628 adding 'colossalai/fx/tracer/meta_patch/patched_function/activation_function.py' 2024-05-31T11:58:54,629 adding 'colossalai/fx/tracer/meta_patch/patched_function/arithmetic.py' 2024-05-31T11:58:54,631 adding 'colossalai/fx/tracer/meta_patch/patched_function/convolution.py' 2024-05-31T11:58:54,632 adding 'colossalai/fx/tracer/meta_patch/patched_function/embedding.py' 2024-05-31T11:58:54,633 adding 'colossalai/fx/tracer/meta_patch/patched_function/normalization.py' 2024-05-31T11:58:54,634 adding 'colossalai/fx/tracer/meta_patch/patched_function/python_ops.py' 2024-05-31T11:58:54,636 adding 'colossalai/fx/tracer/meta_patch/patched_function/torch_ops.py' 2024-05-31T11:58:54,637 adding 'colossalai/fx/tracer/meta_patch/patched_module/__init__.py' 2024-05-31T11:58:54,638 adding 'colossalai/fx/tracer/meta_patch/patched_module/activation_function.py' 2024-05-31T11:58:54,640 adding 'colossalai/fx/tracer/meta_patch/patched_module/convolution.py' 2024-05-31T11:58:54,641 adding 'colossalai/fx/tracer/meta_patch/patched_module/embedding.py' 2024-05-31T11:58:54,642 adding 'colossalai/fx/tracer/meta_patch/patched_module/linear.py' 2024-05-31T11:58:54,643 adding 'colossalai/fx/tracer/meta_patch/patched_module/normalization.py' 2024-05-31T11:58:54,645 adding 'colossalai/fx/tracer/meta_patch/patched_module/pooling.py' 2024-05-31T11:58:54,646 adding 'colossalai/fx/tracer/meta_patch/patched_module/rnn.py' 2024-05-31T11:58:54,648 adding 'colossalai/inference/__init__.py' 2024-05-31T11:58:54,650 adding 'colossalai/inference/batch_bucket.py' 2024-05-31T11:58:54,653 adding 'colossalai/inference/config.py' 2024-05-31T11:58:54,654 adding 'colossalai/inference/flash_decoding_utils.py' 2024-05-31T11:58:54,656 adding 'colossalai/inference/graph_runner.py' 2024-05-31T11:58:54,657 adding 'colossalai/inference/logit_processors.py' 2024-05-31T11:58:54,659 adding 'colossalai/inference/sampler.py' 2024-05-31T11:58:54,660 adding 'colossalai/inference/struct.py' 2024-05-31T11:58:54,662 adding 'colossalai/inference/utils.py' 2024-05-31T11:58:54,663 adding 'colossalai/inference/core/__init__.py' 2024-05-31T11:58:54,666 adding 'colossalai/inference/core/async_engine.py' 2024-05-31T11:58:54,670 adding 'colossalai/inference/core/engine.py' 2024-05-31T11:58:54,671 adding 'colossalai/inference/core/plugin.py' 2024-05-31T11:58:54,674 adding 'colossalai/inference/core/request_handler.py' 2024-05-31T11:58:54,676 adding 'colossalai/inference/core/rpc_engine.py' 2024-05-31T11:58:54,677 adding 'colossalai/inference/kv_cache/__init__.py' 2024-05-31T11:58:54,679 adding 'colossalai/inference/kv_cache/block_cache.py' 2024-05-31T11:58:54,682 adding 'colossalai/inference/kv_cache/kvcache_manager.py' 2024-05-31T11:58:54,684 adding 'colossalai/inference/modeling/__init__.py' 2024-05-31T11:58:54,685 adding 'colossalai/inference/modeling/layers/__init__.py' 2024-05-31T11:58:54,687 adding 'colossalai/inference/modeling/layers/attention.py' 2024-05-31T11:58:54,689 adding 'colossalai/inference/modeling/layers/baichuan_tp_linear.py' 2024-05-31T11:58:54,690 adding 'colossalai/inference/modeling/models/__init__.py' 2024-05-31T11:58:54,693 adding 'colossalai/inference/modeling/models/glide_llama.py' 2024-05-31T11:58:54,695 adding 'colossalai/inference/modeling/models/nopadding_baichuan.py' 2024-05-31T11:58:54,698 adding 'colossalai/inference/modeling/models/nopadding_llama.py' 2024-05-31T11:58:54,700 adding 'colossalai/inference/modeling/policy/__init__.py' 2024-05-31T11:58:54,702 adding 'colossalai/inference/modeling/policy/glide_llama.py' 2024-05-31T11:58:54,703 adding 'colossalai/inference/modeling/policy/nopadding_baichuan.py' 2024-05-31T11:58:54,704 adding 'colossalai/inference/modeling/policy/nopadding_llama.py' 2024-05-31T11:58:54,706 adding 'colossalai/inference/server/__init__.py' 2024-05-31T11:58:54,707 adding 'colossalai/inference/server/api_server.py' 2024-05-31T11:58:54,709 adding 'colossalai/inference/server/chat_service.py' 2024-05-31T11:58:54,710 adding 'colossalai/inference/server/completion_service.py' 2024-05-31T11:58:54,711 adding 'colossalai/inference/server/utils.py' 2024-05-31T11:58:54,713 adding 'colossalai/inference/spec/__init__.py' 2024-05-31T11:58:54,715 adding 'colossalai/inference/spec/drafter.py' 2024-05-31T11:58:54,716 adding 'colossalai/inference/spec/struct.py' 2024-05-31T11:58:54,718 adding 'colossalai/interface/__init__.py' 2024-05-31T11:58:54,719 adding 'colossalai/interface/model.py' 2024-05-31T11:58:54,721 adding 'colossalai/interface/optimizer.py' 2024-05-31T11:58:54,722 adding 'colossalai/interface/pretrained.py' 2024-05-31T11:58:54,723 adding 'colossalai/kernel/__init__.py' 2024-05-31T11:58:54,725 adding 'colossalai/kernel/kernel_loader.py' 2024-05-31T11:58:54,727 adding 'colossalai/kernel/extensions/__init__.py' 2024-05-31T11:58:54,728 adding 'colossalai/kernel/extensions/base_extension.py' 2024-05-31T11:58:54,729 adding 'colossalai/kernel/extensions/cpp_extension.py' 2024-05-31T11:58:54,731 adding 'colossalai/kernel/extensions/cuda_extension.py' 2024-05-31T11:58:54,732 adding 'colossalai/kernel/extensions/triton_extension.py' 2024-05-31T11:58:54,734 adding 'colossalai/kernel/extensions/utils.py' 2024-05-31T11:58:54,736 adding 'colossalai/kernel/extensions/csrc/__init__.py' 2024-05-31T11:58:54,737 adding 'colossalai/kernel/extensions/csrc/common/data_type.h' 2024-05-31T11:58:54,739 adding 'colossalai/kernel/extensions/csrc/common/micros.h' 2024-05-31T11:58:54,740 adding 'colossalai/kernel/extensions/csrc/common/mp_type_traits.h' 2024-05-31T11:58:54,741 adding 'colossalai/kernel/extensions/csrc/common/target.h' 2024-05-31T11:58:54,743 adding 'colossalai/kernel/extensions/csrc/common/vec_type_traits.h' 2024-05-31T11:58:54,745 adding 'colossalai/kernel/extensions/csrc/funcs/binary_functor.h' 2024-05-31T11:58:54,747 adding 'colossalai/kernel/extensions/csrc/funcs/cast_functor.h' 2024-05-31T11:58:54,748 adding 'colossalai/kernel/extensions/csrc/funcs/reduce_function.h' 2024-05-31T11:58:54,751 adding 'colossalai/kernel/extensions/csrc/funcs/ternary_functor.h' 2024-05-31T11:58:54,752 adding 'colossalai/kernel/extensions/csrc/funcs/unary_functor.h' 2024-05-31T11:58:54,755 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.cpp' 2024-05-31T11:58:54,756 adding 'colossalai/kernel/extensions/csrc/kernel/arm/cpu_adam_arm.h' 2024-05-31T11:58:54,758 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/activation_kernel.cu' 2024-05-31T11:58:54,760 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/context_kv_cache_memcpy_kernel.cu' 2024-05-31T11:58:54,761 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/convert_fp8_kernel.cu' 2024-05-31T11:58:54,763 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/decode_kv_cache_memcpy_kernel.cu' 2024-05-31T11:58:54,767 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/flash_decoding_attention_kernel.cu' 2024-05-31T11:58:54,770 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/fused_rotary_emb_and_cache_kernel.cu' 2024-05-31T11:58:54,772 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/get_cos_and_sin_kernel.cu' 2024-05-31T11:58:54,775 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/layer_norm_kernel.cu' 2024-05-31T11:58:54,778 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/moe_kernel.cu' 2024-05-31T11:58:54,781 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_adam_kernel.cu' 2024-05-31T11:58:54,783 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_apply.cuh' 2024-05-31T11:58:54,785 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_l2norm_kernel.cu' 2024-05-31T11:58:54,787 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_lamb_kernel.cu' 2024-05-31T11:58:54,789 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_scale_kernel.cu' 2024-05-31T11:58:54,791 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/multi_tensor_sgd_kernel.cu' 2024-05-31T11:58:54,793 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/rms_layernorm_kernel.cu' 2024-05-31T11:58:54,796 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_masked_softmax_kernel.cu' 2024-05-31T11:58:54,798 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/scaled_upper_triang_masked_softmax_kernel.cu' 2024-05-31T11:58:54,801 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/attention/attention_utils.h' 2024-05-31T11:58:54,803 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/gpu_launch_config.h' 2024-05-31T11:58:54,804 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/micros.h' 2024-05-31T11:58:54,805 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/nvgpu_dev_info.h' 2024-05-31T11:58:54,807 adding 'colossalai/kernel/extensions/csrc/kernel/cuda/utils/vec_copy.h' 2024-05-31T11:58:54,809 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.cpp' 2024-05-31T11:58:54,811 adding 'colossalai/kernel/extensions/csrc/kernel/x86/cpu_adam.h' 2024-05-31T11:58:54,812 adding 'colossalai/kernel/extensions/pybind/__init__.py' 2024-05-31T11:58:54,814 adding 'colossalai/kernel/extensions/pybind/cpu_adam/__init__.py' 2024-05-31T11:58:54,815 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-05-31T11:58:54,817 adding 'colossalai/kernel/extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-05-31T11:58:54,818 adding 'colossalai/kernel/extensions/pybind/flash_attention/__init__.py' 2024-05-31T11:58:54,820 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-05-31T11:58:54,821 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_npu.py' 2024-05-31T11:58:54,822 adding 'colossalai/kernel/extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-05-31T11:58:54,824 adding 'colossalai/kernel/extensions/pybind/inference/__init__.py' 2024-05-31T11:58:54,825 adding 'colossalai/kernel/extensions/pybind/inference/inference_ops_cuda.py' 2024-05-31T11:58:54,827 adding 'colossalai/kernel/extensions/pybind/layernorm/__init__.py' 2024-05-31T11:58:54,828 adding 'colossalai/kernel/extensions/pybind/layernorm/layernorm_cuda.py' 2024-05-31T11:58:54,829 adding 'colossalai/kernel/extensions/pybind/moe/__init__.py' 2024-05-31T11:58:54,831 adding 'colossalai/kernel/extensions/pybind/moe/moe_cuda.py' 2024-05-31T11:58:54,832 adding 'colossalai/kernel/extensions/pybind/optimizer/__init__.py' 2024-05-31T11:58:54,833 adding 'colossalai/kernel/extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-05-31T11:58:54,835 adding 'colossalai/kernel/extensions/pybind/softmax/__init__.py' 2024-05-31T11:58:54,836 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-05-31T11:58:54,838 adding 'colossalai/kernel/extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-05-31T11:58:54,839 adding 'colossalai/kernel/jit/__init__.py' 2024-05-31T11:58:54,840 adding 'colossalai/kernel/jit/bias_dropout_add.py' 2024-05-31T11:58:54,842 adding 'colossalai/kernel/jit/bias_gelu.py' 2024-05-31T11:58:54,843 adding 'colossalai/kernel/jit/option.py' 2024-05-31T11:58:54,845 adding 'colossalai/kernel/triton/__init__.py' 2024-05-31T11:58:54,848 adding 'colossalai/kernel/triton/context_attn_unpad.py' 2024-05-31T11:58:54,850 adding 'colossalai/kernel/triton/flash_decoding.py' 2024-05-31T11:58:54,851 adding 'colossalai/kernel/triton/fused_rotary_embedding.py' 2024-05-31T11:58:54,853 adding 'colossalai/kernel/triton/kvcache_copy.py' 2024-05-31T11:58:54,854 adding 'colossalai/kernel/triton/llama_act_combine_kernel.py' 2024-05-31T11:58:54,857 adding 'colossalai/kernel/triton/no_pad_rotary_embedding.py' 2024-05-31T11:58:54,858 adding 'colossalai/kernel/triton/qkv_matmul_kernel.py' 2024-05-31T11:58:54,859 adding 'colossalai/kernel/triton/rms_layernorm.py' 2024-05-31T11:58:54,861 adding 'colossalai/kernel/triton/rotary_cache_copy.py' 2024-05-31T11:58:54,862 adding 'colossalai/kernel/triton/softmax.py' 2024-05-31T11:58:54,863 adding 'colossalai/lazy/__init__.py' 2024-05-31T11:58:54,865 adding 'colossalai/lazy/construction.py' 2024-05-31T11:58:54,868 adding 'colossalai/lazy/lazy_init.py' 2024-05-31T11:58:54,870 adding 'colossalai/lazy/pretrained.py' 2024-05-31T11:58:54,872 adding 'colossalai/legacy/__init__.py' 2024-05-31T11:58:54,873 adding 'colossalai/legacy/constants.py' 2024-05-31T11:58:54,874 adding 'colossalai/legacy/core.py' 2024-05-31T11:58:54,875 adding 'colossalai/legacy/global_variables.py' 2024-05-31T11:58:54,878 adding 'colossalai/legacy/initialize.py' 2024-05-31T11:58:54,880 adding 'colossalai/legacy/amp/__init__.py' 2024-05-31T11:58:54,881 adding 'colossalai/legacy/amp/amp_type.py' 2024-05-31T11:58:54,883 adding 'colossalai/legacy/amp/apex_amp/__init__.py' 2024-05-31T11:58:54,884 adding 'colossalai/legacy/amp/apex_amp/apex_amp.py' 2024-05-31T11:58:54,886 adding 'colossalai/legacy/amp/naive_amp/__init__.py' 2024-05-31T11:58:54,888 adding 'colossalai/legacy/amp/naive_amp/_fp16_optimizer.py' 2024-05-31T11:58:54,889 adding 'colossalai/legacy/amp/naive_amp/_utils.py' 2024-05-31T11:58:54,891 adding 'colossalai/legacy/amp/naive_amp/naive_amp.py' 2024-05-31T11:58:54,892 adding 'colossalai/legacy/amp/torch_amp/__init__.py' 2024-05-31T11:58:54,896 adding 'colossalai/legacy/amp/torch_amp/_grad_scaler.py' 2024-05-31T11:58:54,897 adding 'colossalai/legacy/amp/torch_amp/torch_amp.py' 2024-05-31T11:58:54,899 adding 'colossalai/legacy/builder/__init__.py' 2024-05-31T11:58:54,900 adding 'colossalai/legacy/builder/builder.py' 2024-05-31T11:58:54,902 adding 'colossalai/legacy/communication/__init__.py' 2024-05-31T11:58:54,904 adding 'colossalai/legacy/communication/collective.py' 2024-05-31T11:58:54,906 adding 'colossalai/legacy/communication/p2p.py' 2024-05-31T11:58:54,908 adding 'colossalai/legacy/communication/p2p_v2.py' 2024-05-31T11:58:54,909 adding 'colossalai/legacy/communication/ring.py' 2024-05-31T11:58:54,910 adding 'colossalai/legacy/communication/utils.py' 2024-05-31T11:58:54,912 adding 'colossalai/legacy/context/__init__.py' 2024-05-31T11:58:54,915 adding 'colossalai/legacy/context/parallel_context.py' 2024-05-31T11:58:54,916 adding 'colossalai/legacy/context/parallel_mode.py' 2024-05-31T11:58:54,918 adding 'colossalai/legacy/context/process_group_initializer/__init__.py' 2024-05-31T11:58:54,920 adding 'colossalai/legacy/context/process_group_initializer/initializer_1d.py' 2024-05-31T11:58:54,922 adding 'colossalai/legacy/context/process_group_initializer/initializer_2d.py' 2024-05-31T11:58:54,924 adding 'colossalai/legacy/context/process_group_initializer/initializer_2p5d.py' 2024-05-31T11:58:54,925 adding 'colossalai/legacy/context/process_group_initializer/initializer_3d.py' 2024-05-31T11:58:54,927 adding 'colossalai/legacy/context/process_group_initializer/initializer_data.py' 2024-05-31T11:58:54,928 adding 'colossalai/legacy/context/process_group_initializer/initializer_model.py' 2024-05-31T11:58:54,929 adding 'colossalai/legacy/context/process_group_initializer/initializer_pipeline.py' 2024-05-31T11:58:54,931 adding 'colossalai/legacy/context/process_group_initializer/initializer_sequence.py' 2024-05-31T11:58:54,932 adding 'colossalai/legacy/context/process_group_initializer/initializer_tensor.py' 2024-05-31T11:58:54,933 adding 'colossalai/legacy/context/process_group_initializer/process_group_initializer.py' 2024-05-31T11:58:54,935 adding 'colossalai/legacy/context/random/__init__.py' 2024-05-31T11:58:54,936 adding 'colossalai/legacy/context/random/_helper.py' 2024-05-31T11:58:54,937 adding 'colossalai/legacy/context/random/seed_manager.py' 2024-05-31T11:58:54,939 adding 'colossalai/legacy/engine/__init__.py' 2024-05-31T11:58:54,941 adding 'colossalai/legacy/engine/_base_engine.py' 2024-05-31T11:58:54,942 adding 'colossalai/legacy/engine/gradient_accumulation/__init__.py' 2024-05-31T11:58:54,944 adding 'colossalai/legacy/engine/gradient_accumulation/_gradient_accumulation.py' 2024-05-31T11:58:54,946 adding 'colossalai/legacy/engine/gradient_handler/__init__.py' 2024-05-31T11:58:54,947 adding 'colossalai/legacy/engine/gradient_handler/_base_gradient_handler.py' 2024-05-31T11:58:54,948 adding 'colossalai/legacy/engine/gradient_handler/_data_parallel_gradient_handler.py' 2024-05-31T11:58:54,949 adding 'colossalai/legacy/engine/gradient_handler/_moe_gradient_handler.py' 2024-05-31T11:58:54,950 adding 'colossalai/legacy/engine/gradient_handler/_pipeline_parallel_gradient_handler.py' 2024-05-31T11:58:54,952 adding 'colossalai/legacy/engine/gradient_handler/_sequence_parallel_gradient_handler.py' 2024-05-31T11:58:54,953 adding 'colossalai/legacy/engine/gradient_handler/_zero_gradient_handler.py' 2024-05-31T11:58:54,954 adding 'colossalai/legacy/engine/gradient_handler/utils.py' 2024-05-31T11:58:54,956 adding 'colossalai/legacy/engine/schedule/__init__.py' 2024-05-31T11:58:54,957 adding 'colossalai/legacy/engine/schedule/_base_schedule.py' 2024-05-31T11:58:54,959 adding 'colossalai/legacy/engine/schedule/_non_pipeline_schedule.py' 2024-05-31T11:58:54,963 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule.py' 2024-05-31T11:58:54,965 adding 'colossalai/legacy/engine/schedule/_pipeline_schedule_v2.py' 2024-05-31T11:58:54,967 adding 'colossalai/legacy/inference/__init__.py' 2024-05-31T11:58:54,969 adding 'colossalai/legacy/inference/async_engine.py' 2024-05-31T11:58:54,970 adding 'colossalai/legacy/inference/async_manager.py' 2024-05-31T11:58:54,972 adding 'colossalai/legacy/inference/manager.py' 2024-05-31T11:58:54,974 adding 'colossalai/legacy/inference/dynamic_batching/__init__.py' 2024-05-31T11:58:54,975 adding 'colossalai/legacy/inference/dynamic_batching/get_tokenizer.py' 2024-05-31T11:58:54,977 adding 'colossalai/legacy/inference/dynamic_batching/infer_batch.py' 2024-05-31T11:58:54,979 adding 'colossalai/legacy/inference/dynamic_batching/io_struct.py' 2024-05-31T11:58:54,980 adding 'colossalai/legacy/inference/dynamic_batching/ray_dist_init.py' 2024-05-31T11:58:54,981 adding 'colossalai/legacy/inference/dynamic_batching/ray_init_config.py' 2024-05-31T11:58:54,983 adding 'colossalai/legacy/inference/dynamic_batching/req_queue.py' 2024-05-31T11:58:54,984 adding 'colossalai/legacy/inference/dynamic_batching/sampling_params.py' 2024-05-31T11:58:54,985 adding 'colossalai/legacy/inference/dynamic_batching/stats.py' 2024-05-31T11:58:54,987 adding 'colossalai/legacy/inference/hybridengine/__init__.py' 2024-05-31T11:58:54,989 adding 'colossalai/legacy/inference/hybridengine/engine.py' 2024-05-31T11:58:54,990 adding 'colossalai/legacy/inference/hybridengine/modeling/__init__.py' 2024-05-31T11:58:54,992 adding 'colossalai/legacy/inference/hybridengine/modeling/_utils.py' 2024-05-31T11:58:54,994 adding 'colossalai/legacy/inference/hybridengine/modeling/llama.py' 2024-05-31T11:58:54,996 adding 'colossalai/legacy/inference/hybridengine/polices/__init__.py' 2024-05-31T11:58:54,998 adding 'colossalai/legacy/inference/hybridengine/polices/llama.py' 2024-05-31T11:58:54,999 adding 'colossalai/legacy/inference/pipeline/__init__.py' 2024-05-31T11:58:55,001 adding 'colossalai/legacy/inference/pipeline/microbatch_manager.py' 2024-05-31T11:58:55,003 adding 'colossalai/legacy/inference/tensor_parallel/__init__.py' 2024-05-31T11:58:55,005 adding 'colossalai/legacy/inference/tensor_parallel/batch_infer_state.py' 2024-05-31T11:58:55,008 adding 'colossalai/legacy/inference/tensor_parallel/engine.py' 2024-05-31T11:58:55,010 adding 'colossalai/legacy/inference/tensor_parallel/kvcache_manager.py' 2024-05-31T11:58:55,011 adding 'colossalai/legacy/inference/tensor_parallel/modeling/__init__.py' 2024-05-31T11:58:55,012 adding 'colossalai/legacy/inference/tensor_parallel/modeling/_utils.py' 2024-05-31T11:58:55,015 adding 'colossalai/legacy/inference/tensor_parallel/modeling/bloom.py' 2024-05-31T11:58:55,018 adding 'colossalai/legacy/inference/tensor_parallel/modeling/chatglm2.py' 2024-05-31T11:58:55,020 adding 'colossalai/legacy/inference/tensor_parallel/modeling/llama.py' 2024-05-31T11:58:55,022 adding 'colossalai/legacy/inference/tensor_parallel/policies/__init__.py' 2024-05-31T11:58:55,023 adding 'colossalai/legacy/inference/tensor_parallel/policies/bloom.py' 2024-05-31T11:58:55,024 adding 'colossalai/legacy/inference/tensor_parallel/policies/chatglm2.py' 2024-05-31T11:58:55,025 adding 'colossalai/legacy/inference/tensor_parallel/policies/llama.py' 2024-05-31T11:58:55,027 adding 'colossalai/legacy/nn/__init__.py' 2024-05-31T11:58:55,028 adding 'colossalai/legacy/nn/_ops/__init__.py' 2024-05-31T11:58:55,030 adding 'colossalai/legacy/nn/_ops/_utils.py' 2024-05-31T11:58:55,032 adding 'colossalai/legacy/nn/layer/__init__.py' 2024-05-31T11:58:55,033 adding 'colossalai/legacy/nn/layer/base_layer.py' 2024-05-31T11:58:55,034 adding 'colossalai/legacy/nn/layer/colossalai_layer/__init__.py' 2024-05-31T11:58:55,036 adding 'colossalai/legacy/nn/layer/colossalai_layer/_utils.py' 2024-05-31T11:58:55,037 adding 'colossalai/legacy/nn/layer/colossalai_layer/dropout.py' 2024-05-31T11:58:55,038 adding 'colossalai/legacy/nn/layer/colossalai_layer/embedding.py' 2024-05-31T11:58:55,040 adding 'colossalai/legacy/nn/layer/colossalai_layer/linear.py' 2024-05-31T11:58:55,041 adding 'colossalai/legacy/nn/layer/colossalai_layer/normalization.py' 2024-05-31T11:58:55,043 adding 'colossalai/legacy/nn/layer/parallel_1d/__init__.py' 2024-05-31T11:58:55,044 adding 'colossalai/legacy/nn/layer/parallel_1d/_operation.py' 2024-05-31T11:58:55,045 adding 'colossalai/legacy/nn/layer/parallel_1d/_utils.py' 2024-05-31T11:58:55,049 adding 'colossalai/legacy/nn/layer/parallel_1d/layers.py' 2024-05-31T11:58:55,051 adding 'colossalai/legacy/nn/layer/parallel_2d/__init__.py' 2024-05-31T11:58:55,053 adding 'colossalai/legacy/nn/layer/parallel_2d/_operation.py' 2024-05-31T11:58:55,055 adding 'colossalai/legacy/nn/layer/parallel_2d/_utils.py' 2024-05-31T11:58:55,059 adding 'colossalai/legacy/nn/layer/parallel_2d/layers.py' 2024-05-31T11:58:55,060 adding 'colossalai/legacy/nn/layer/parallel_2p5d/__init__.py' 2024-05-31T11:58:55,064 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_operation.py' 2024-05-31T11:58:55,065 adding 'colossalai/legacy/nn/layer/parallel_2p5d/_utils.py' 2024-05-31T11:58:55,068 adding 'colossalai/legacy/nn/layer/parallel_2p5d/layers.py' 2024-05-31T11:58:55,070 adding 'colossalai/legacy/nn/layer/parallel_3d/__init__.py' 2024-05-31T11:58:55,073 adding 'colossalai/legacy/nn/layer/parallel_3d/_operation.py' 2024-05-31T11:58:55,074 adding 'colossalai/legacy/nn/layer/parallel_3d/_utils.py' 2024-05-31T11:58:55,077 adding 'colossalai/legacy/nn/layer/parallel_3d/layers.py' 2024-05-31T11:58:55,079 adding 'colossalai/legacy/nn/layer/parallel_sequence/__init__.py' 2024-05-31T11:58:55,081 adding 'colossalai/legacy/nn/layer/parallel_sequence/_operation.py' 2024-05-31T11:58:55,082 adding 'colossalai/legacy/nn/layer/parallel_sequence/_utils.py' 2024-05-31T11:58:55,084 adding 'colossalai/legacy/nn/layer/parallel_sequence/layers.py' 2024-05-31T11:58:55,085 adding 'colossalai/legacy/nn/layer/utils/__init__.py' 2024-05-31T11:58:55,087 adding 'colossalai/legacy/nn/layer/utils/common.py' 2024-05-31T11:58:55,088 adding 'colossalai/legacy/nn/layer/vanilla/__init__.py' 2024-05-31T11:58:55,090 adding 'colossalai/legacy/nn/layer/vanilla/layers.py' 2024-05-31T11:58:55,092 adding 'colossalai/legacy/nn/layer/wrapper/__init__.py' 2024-05-31T11:58:55,093 adding 'colossalai/legacy/nn/layer/wrapper/pipeline_wrapper.py' 2024-05-31T11:58:55,095 adding 'colossalai/legacy/nn/loss/__init__.py' 2024-05-31T11:58:55,096 adding 'colossalai/legacy/nn/loss/loss_1d.py' 2024-05-31T11:58:55,097 adding 'colossalai/legacy/nn/loss/loss_2d.py' 2024-05-31T11:58:55,099 adding 'colossalai/legacy/nn/loss/loss_2p5d.py' 2024-05-31T11:58:55,100 adding 'colossalai/legacy/nn/loss/loss_3d.py' 2024-05-31T11:58:55,102 adding 'colossalai/legacy/nn/metric/__init__.py' 2024-05-31T11:58:55,103 adding 'colossalai/legacy/nn/metric/_utils.py' 2024-05-31T11:58:55,104 adding 'colossalai/legacy/nn/metric/accuracy_2d.py' 2024-05-31T11:58:55,105 adding 'colossalai/legacy/nn/metric/accuracy_2p5d.py' 2024-05-31T11:58:55,106 adding 'colossalai/legacy/nn/metric/accuracy_3d.py' 2024-05-31T11:58:55,107 adding 'colossalai/legacy/nn/parallel/__init__.py' 2024-05-31T11:58:55,109 adding 'colossalai/legacy/nn/parallel/data_parallel.py' 2024-05-31T11:58:55,111 adding 'colossalai/legacy/nn/parallel/reducer.py' 2024-05-31T11:58:55,112 adding 'colossalai/legacy/nn/parallel/layers/__init__.py' 2024-05-31T11:58:55,113 adding 'colossalai/legacy/nn/parallel/layers/colo_module.py' 2024-05-31T11:58:55,115 adding 'colossalai/legacy/nn/parallel/layers/embedding.py' 2024-05-31T11:58:55,116 adding 'colossalai/legacy/nn/parallel/layers/linear.py' 2024-05-31T11:58:55,117 adding 'colossalai/legacy/nn/parallel/layers/module_utils.py' 2024-05-31T11:58:55,119 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/__init__.py' 2024-05-31T11:58:55,120 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/base_embedding.py' 2024-05-31T11:58:55,123 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cache_mgr.py' 2024-05-31T11:58:55,125 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/cached_embedding.py' 2024-05-31T11:58:55,126 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/copyer.py' 2024-05-31T11:58:55,127 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/embedding_config.py' 2024-05-31T11:58:55,129 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding.py' 2024-05-31T11:58:55,131 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise.py' 2024-05-31T11:58:55,132 adding 'colossalai/legacy/nn/parallel/layers/cache_embedding/parallel_cached_embedding_tablewise_split_cache.py' 2024-05-31T11:58:55,134 adding 'colossalai/legacy/pipeline/__init__.py' 2024-05-31T11:58:55,135 adding 'colossalai/legacy/pipeline/layer_spec.py' 2024-05-31T11:58:55,137 adding 'colossalai/legacy/pipeline/pipelinable.py' 2024-05-31T11:58:55,138 adding 'colossalai/legacy/pipeline/pipeline_process_group.py' 2024-05-31T11:58:55,140 adding 'colossalai/legacy/pipeline/utils.py' 2024-05-31T11:58:55,142 adding 'colossalai/legacy/pipeline/middleware/__init__.py' 2024-05-31T11:58:55,143 adding 'colossalai/legacy/pipeline/middleware/topo.py' 2024-05-31T11:58:55,145 adding 'colossalai/legacy/pipeline/middleware/adaptor/__init__.py' 2024-05-31T11:58:55,146 adding 'colossalai/legacy/pipeline/middleware/adaptor/fx.py' 2024-05-31T11:58:55,148 adding 'colossalai/legacy/pipeline/rpc/__init__.py' 2024-05-31T11:58:55,154 adding 'colossalai/legacy/pipeline/rpc/_pipeline_base.py' 2024-05-31T11:58:55,156 adding 'colossalai/legacy/pipeline/rpc/_pipeline_schedule.py' 2024-05-31T11:58:55,158 adding 'colossalai/legacy/pipeline/rpc/utils.py' 2024-05-31T11:58:55,160 adding 'colossalai/legacy/registry/__init__.py' 2024-05-31T11:58:55,161 adding 'colossalai/legacy/registry/registry.py' 2024-05-31T11:58:55,163 adding 'colossalai/legacy/tensor/__init__.py' 2024-05-31T11:58:55,164 adding 'colossalai/legacy/tensor/compute_spec.py' 2024-05-31T11:58:55,165 adding 'colossalai/legacy/tensor/const.py' 2024-05-31T11:58:55,167 adding 'colossalai/legacy/tensor/dist_spec_mgr.py' 2024-05-31T11:58:55,168 adding 'colossalai/legacy/tensor/distspec.py' 2024-05-31T11:58:55,169 adding 'colossalai/legacy/tensor/op_wrapper.py' 2024-05-31T11:58:55,171 adding 'colossalai/legacy/tensor/process_group.py' 2024-05-31T11:58:55,172 adding 'colossalai/legacy/tensor/tensor_spec.py' 2024-05-31T11:58:55,173 adding 'colossalai/legacy/trainer/__init__.py' 2024-05-31T11:58:55,175 adding 'colossalai/legacy/trainer/_trainer.py' 2024-05-31T11:58:55,177 adding 'colossalai/legacy/trainer/hooks/__init__.py' 2024-05-31T11:58:55,178 adding 'colossalai/legacy/trainer/hooks/_base_hook.py' 2024-05-31T11:58:55,179 adding 'colossalai/legacy/trainer/hooks/_checkpoint_hook.py' 2024-05-31T11:58:55,181 adding 'colossalai/legacy/trainer/hooks/_commons_.py' 2024-05-31T11:58:55,182 adding 'colossalai/legacy/trainer/hooks/_log_hook.py' 2024-05-31T11:58:55,183 adding 'colossalai/legacy/trainer/hooks/_lr_scheduler_hook.py' 2024-05-31T11:58:55,185 adding 'colossalai/legacy/trainer/hooks/_metric_hook.py' 2024-05-31T11:58:55,187 adding 'colossalai/legacy/utils/__init__.py' 2024-05-31T11:58:55,189 adding 'colossalai/legacy/utils/activation_checkpoint.py' 2024-05-31T11:58:55,191 adding 'colossalai/legacy/utils/checkpointing.py' 2024-05-31T11:58:55,193 adding 'colossalai/legacy/utils/common.py' 2024-05-31T11:58:55,195 adding 'colossalai/legacy/utils/memory.py' 2024-05-31T11:58:55,197 adding 'colossalai/legacy/utils/checkpoint/__init__.py' 2024-05-31T11:58:55,198 adding 'colossalai/legacy/utils/checkpoint/module_checkpoint.py' 2024-05-31T11:58:55,199 adding 'colossalai/legacy/utils/checkpoint/utils.py' 2024-05-31T11:58:55,201 adding 'colossalai/legacy/utils/data_sampler/__init__.py' 2024-05-31T11:58:55,202 adding 'colossalai/legacy/utils/data_sampler/base_sampler.py' 2024-05-31T11:58:55,204 adding 'colossalai/legacy/utils/data_sampler/data_parallel_sampler.py' 2024-05-31T11:58:55,205 adding 'colossalai/legacy/utils/profiler/__init__.py' 2024-05-31T11:58:55,207 adding 'colossalai/legacy/utils/profiler/extention.py' 2024-05-31T11:58:55,208 adding 'colossalai/legacy/utils/profiler/profiler.py' 2024-05-31T11:58:55,210 adding 'colossalai/legacy/utils/profiler/stateful_tensor_mem_extention.py' 2024-05-31T11:58:55,211 adding 'colossalai/legacy/utils/profiler/legacy/__init__.py' 2024-05-31T11:58:55,213 adding 'colossalai/legacy/utils/profiler/legacy/comm_profiler.py' 2024-05-31T11:58:55,214 adding 'colossalai/legacy/utils/profiler/legacy/pcie_profiler.py' 2024-05-31T11:58:55,216 adding 'colossalai/legacy/utils/profiler/legacy/prof_utils.py' 2024-05-31T11:58:55,218 adding 'colossalai/legacy/zero/__init__.py' 2024-05-31T11:58:55,219 adding 'colossalai/legacy/zero/gemini/__init__.py' 2024-05-31T11:58:55,221 adding 'colossalai/legacy/zero/gemini/colo_init_context.py' 2024-05-31T11:58:55,222 adding 'colossalai/legacy/zero/gemini/gemini_context.py' 2024-05-31T11:58:55,224 adding 'colossalai/legacy/zero/gemini/stateful_tensor.py' 2024-05-31T11:58:55,225 adding 'colossalai/legacy/zero/gemini/stateful_tensor_mgr.py' 2024-05-31T11:58:55,227 adding 'colossalai/legacy/zero/gemini/tensor_placement_policy.py' 2024-05-31T11:58:55,228 adding 'colossalai/legacy/zero/gemini/tensor_utils.py' 2024-05-31T11:58:55,230 adding 'colossalai/legacy/zero/gemini/ophooks/__init__.py' 2024-05-31T11:58:55,231 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_grad_ophook.py' 2024-05-31T11:58:55,232 adding 'colossalai/legacy/zero/gemini/ophooks/_shard_param_ophook.py' 2024-05-31T11:58:55,234 adding 'colossalai/legacy/zero/gemini/ophooks/runtime_mem_tracer_hook.py' 2024-05-31T11:58:55,235 adding 'colossalai/legacy/zero/gemini/ophooks/utils.py' 2024-05-31T11:58:55,237 adding 'colossalai/legacy/zero/gemini/paramhooks/__init__.py' 2024-05-31T11:58:55,238 adding 'colossalai/legacy/zero/gemini/paramhooks/_param_hookmgr.py' 2024-05-31T11:58:55,239 adding 'colossalai/legacy/zero/init_ctx/__init__.py' 2024-05-31T11:58:55,241 adding 'colossalai/legacy/zero/init_ctx/init_context.py' 2024-05-31T11:58:55,243 adding 'colossalai/legacy/zero/shard_utils/__init__.py' 2024-05-31T11:58:55,244 adding 'colossalai/legacy/zero/shard_utils/base_shard_strategy.py' 2024-05-31T11:58:55,245 adding 'colossalai/legacy/zero/shard_utils/bucket_tensor_shard_strategy.py' 2024-05-31T11:58:55,246 adding 'colossalai/legacy/zero/shard_utils/commons.py' 2024-05-31T11:58:55,247 adding 'colossalai/legacy/zero/shard_utils/tensor_shard_strategy.py' 2024-05-31T11:58:55,249 adding 'colossalai/legacy/zero/sharded_model/__init__.py' 2024-05-31T11:58:55,250 adding 'colossalai/legacy/zero/sharded_model/_utils.py' 2024-05-31T11:58:55,252 adding 'colossalai/legacy/zero/sharded_model/reduce_scatter.py' 2024-05-31T11:58:55,255 adding 'colossalai/legacy/zero/sharded_model/sharded_model_v2.py' 2024-05-31T11:58:55,256 adding 'colossalai/legacy/zero/sharded_model/utils.py' 2024-05-31T11:58:55,258 adding 'colossalai/legacy/zero/sharded_model/zero_hook.py' 2024-05-31T11:58:55,259 adding 'colossalai/legacy/zero/sharded_optim/__init__.py' 2024-05-31T11:58:55,262 adding 'colossalai/legacy/zero/sharded_optim/sharded_optim_v2.py' 2024-05-31T11:58:55,264 adding 'colossalai/legacy/zero/sharded_param/__init__.py' 2024-05-31T11:58:55,265 adding 'colossalai/legacy/zero/sharded_param/sharded_param.py' 2024-05-31T11:58:55,266 adding 'colossalai/legacy/zero/sharded_param/sharded_tensor.py' 2024-05-31T11:58:55,268 adding 'colossalai/logging/__init__.py' 2024-05-31T11:58:55,269 adding 'colossalai/logging/logger.py' 2024-05-31T11:58:55,271 adding 'colossalai/moe/__init__.py' 2024-05-31T11:58:55,273 adding 'colossalai/moe/_operation.py' 2024-05-31T11:58:55,276 adding 'colossalai/moe/checkpoint.py' 2024-05-31T11:58:55,278 adding 'colossalai/moe/experts.py' 2024-05-31T11:58:55,280 adding 'colossalai/moe/layers.py' 2024-05-31T11:58:55,283 adding 'colossalai/moe/load_balance.py' 2024-05-31T11:58:55,284 adding 'colossalai/moe/loss.py' 2024-05-31T11:58:55,285 adding 'colossalai/moe/manager.py' 2024-05-31T11:58:55,288 adding 'colossalai/moe/routers.py' 2024-05-31T11:58:55,290 adding 'colossalai/moe/utils.py' 2024-05-31T11:58:55,291 adding 'colossalai/nn/__init__.py' 2024-05-31T11:58:55,293 adding 'colossalai/nn/init.py' 2024-05-31T11:58:55,295 adding 'colossalai/nn/layer/__init__.py' 2024-05-31T11:58:55,296 adding 'colossalai/nn/layer/layernorm.py' 2024-05-31T11:58:55,298 adding 'colossalai/nn/layer/scaled_softmax.py' 2024-05-31T11:58:55,299 adding 'colossalai/nn/layer/utils.py' 2024-05-31T11:58:55,301 adding 'colossalai/nn/loss/__init__.py' 2024-05-31T11:58:55,302 adding 'colossalai/nn/lr_scheduler/__init__.py' 2024-05-31T11:58:55,304 adding 'colossalai/nn/lr_scheduler/cosine.py' 2024-05-31T11:58:55,305 adding 'colossalai/nn/lr_scheduler/delayed.py' 2024-05-31T11:58:55,306 adding 'colossalai/nn/lr_scheduler/linear.py' 2024-05-31T11:58:55,308 adding 'colossalai/nn/lr_scheduler/multistep.py' 2024-05-31T11:58:55,309 adding 'colossalai/nn/lr_scheduler/onecycle.py' 2024-05-31T11:58:55,310 adding 'colossalai/nn/lr_scheduler/poly.py' 2024-05-31T11:58:55,312 adding 'colossalai/nn/lr_scheduler/torch.py' 2024-05-31T11:58:55,314 adding 'colossalai/nn/optimizer/__init__.py' 2024-05-31T11:58:55,315 adding 'colossalai/nn/optimizer/adafactor.py' 2024-05-31T11:58:55,317 adding 'colossalai/nn/optimizer/came.py' 2024-05-31T11:58:55,318 adding 'colossalai/nn/optimizer/cpu_adam.py' 2024-05-31T11:58:55,321 adding 'colossalai/nn/optimizer/distributed_adafactor.py' 2024-05-31T11:58:55,323 adding 'colossalai/nn/optimizer/distributed_came.py' 2024-05-31T11:58:55,325 adding 'colossalai/nn/optimizer/distributed_galore.py' 2024-05-31T11:58:55,327 adding 'colossalai/nn/optimizer/distributed_lamb.py' 2024-05-31T11:58:55,329 adding 'colossalai/nn/optimizer/fused_adam.py' 2024-05-31T11:58:55,330 adding 'colossalai/nn/optimizer/fused_lamb.py' 2024-05-31T11:58:55,332 adding 'colossalai/nn/optimizer/fused_sgd.py' 2024-05-31T11:58:55,334 adding 'colossalai/nn/optimizer/galore.py' 2024-05-31T11:58:55,336 adding 'colossalai/nn/optimizer/hybrid_adam.py' 2024-05-31T11:58:55,337 adding 'colossalai/nn/optimizer/lamb.py' 2024-05-31T11:58:55,339 adding 'colossalai/nn/optimizer/lars.py' 2024-05-31T11:58:55,340 adding 'colossalai/nn/optimizer/nvme_optimizer.py' 2024-05-31T11:58:55,342 adding 'colossalai/pipeline/__init__.py' 2024-05-31T11:58:55,345 adding 'colossalai/pipeline/p2p.py' 2024-05-31T11:58:55,346 adding 'colossalai/pipeline/stage_manager.py' 2024-05-31T11:58:55,348 adding 'colossalai/pipeline/schedule/__init__.py' 2024-05-31T11:58:55,350 adding 'colossalai/pipeline/schedule/_utils.py' 2024-05-31T11:58:55,351 adding 'colossalai/pipeline/schedule/base.py' 2024-05-31T11:58:55,353 adding 'colossalai/pipeline/schedule/generate.py' 2024-05-31T11:58:55,356 adding 'colossalai/pipeline/schedule/interleaved_pp.py' 2024-05-31T11:58:55,358 adding 'colossalai/pipeline/schedule/one_f_one_b.py' 2024-05-31T11:58:55,360 adding 'colossalai/quantization/__init__.py' 2024-05-31T11:58:55,362 adding 'colossalai/quantization/bnb.py' 2024-05-31T11:58:55,364 adding 'colossalai/quantization/bnb_config.py' 2024-05-31T11:58:55,365 adding 'colossalai/shardformer/__init__.py' 2024-05-31T11:58:55,367 adding 'colossalai/shardformer/_utils.py' 2024-05-31T11:58:55,369 adding 'colossalai/shardformer/layer/__init__.py' 2024-05-31T11:58:55,372 adding 'colossalai/shardformer/layer/_operation.py' 2024-05-31T11:58:55,374 adding 'colossalai/shardformer/layer/attn.py' 2024-05-31T11:58:55,375 adding 'colossalai/shardformer/layer/dropout.py' 2024-05-31T11:58:55,377 adding 'colossalai/shardformer/layer/embedding.py' 2024-05-31T11:58:55,380 adding 'colossalai/shardformer/layer/linear.py' 2024-05-31T11:58:55,381 adding 'colossalai/shardformer/layer/loss.py' 2024-05-31T11:58:55,383 adding 'colossalai/shardformer/layer/normalization.py' 2024-05-31T11:58:55,385 adding 'colossalai/shardformer/layer/parallel_module.py' 2024-05-31T11:58:55,388 adding 'colossalai/shardformer/layer/qkv_fused_linear.py' 2024-05-31T11:58:55,390 adding 'colossalai/shardformer/layer/utils.py' 2024-05-31T11:58:55,391 adding 'colossalai/shardformer/modeling/__init__.py' 2024-05-31T11:58:55,396 adding 'colossalai/shardformer/modeling/bert.py' 2024-05-31T11:58:55,398 adding 'colossalai/shardformer/modeling/blip2.py' 2024-05-31T11:58:55,403 adding 'colossalai/shardformer/modeling/bloom.py' 2024-05-31T11:58:55,405 adding 'colossalai/shardformer/modeling/chatglm2.py' 2024-05-31T11:58:55,408 adding 'colossalai/shardformer/modeling/falcon.py' 2024-05-31T11:58:55,413 adding 'colossalai/shardformer/modeling/gpt2.py' 2024-05-31T11:58:55,417 adding 'colossalai/shardformer/modeling/gptj.py' 2024-05-31T11:58:55,418 adding 'colossalai/shardformer/modeling/jit.py' 2024-05-31T11:58:55,422 adding 'colossalai/shardformer/modeling/llama.py' 2024-05-31T11:58:55,425 adding 'colossalai/shardformer/modeling/mistral.py' 2024-05-31T11:58:55,429 adding 'colossalai/shardformer/modeling/opt.py' 2024-05-31T11:58:55,432 adding 'colossalai/shardformer/modeling/qwen2.py' 2024-05-31T11:58:55,434 adding 'colossalai/shardformer/modeling/sam.py' 2024-05-31T11:58:55,437 adding 'colossalai/shardformer/modeling/t5.py' 2024-05-31T11:58:55,440 adding 'colossalai/shardformer/modeling/vit.py' 2024-05-31T11:58:55,445 adding 'colossalai/shardformer/modeling/whisper.py' 2024-05-31T11:58:55,447 adding 'colossalai/shardformer/modeling/chatglm2_6b/__init__.py' 2024-05-31T11:58:55,448 adding 'colossalai/shardformer/modeling/chatglm2_6b/configuration_chatglm.py' 2024-05-31T11:58:55,454 adding 'colossalai/shardformer/modeling/chatglm2_6b/modeling_chatglm.py' 2024-05-31T11:58:55,456 adding 'colossalai/shardformer/policies/__init__.py' 2024-05-31T11:58:55,457 adding 'colossalai/shardformer/policies/auto_policy.py' 2024-05-31T11:58:55,459 adding 'colossalai/shardformer/policies/base_policy.py' 2024-05-31T11:58:55,461 adding 'colossalai/shardformer/policies/bert.py' 2024-05-31T11:58:55,463 adding 'colossalai/shardformer/policies/blip2.py' 2024-05-31T11:58:55,465 adding 'colossalai/shardformer/policies/bloom.py' 2024-05-31T11:58:55,467 adding 'colossalai/shardformer/policies/chatglm2.py' 2024-05-31T11:58:55,469 adding 'colossalai/shardformer/policies/falcon.py' 2024-05-31T11:58:55,471 adding 'colossalai/shardformer/policies/gpt2.py' 2024-05-31T11:58:55,473 adding 'colossalai/shardformer/policies/gptj.py' 2024-05-31T11:58:55,475 adding 'colossalai/shardformer/policies/llama.py' 2024-05-31T11:58:55,477 adding 'colossalai/shardformer/policies/mistral.py' 2024-05-31T11:58:55,479 adding 'colossalai/shardformer/policies/opt.py' 2024-05-31T11:58:55,480 adding 'colossalai/shardformer/policies/qwen2.py' 2024-05-31T11:58:55,482 adding 'colossalai/shardformer/policies/sam.py' 2024-05-31T11:58:55,484 adding 'colossalai/shardformer/policies/t5.py' 2024-05-31T11:58:55,486 adding 'colossalai/shardformer/policies/vit.py' 2024-05-31T11:58:55,488 adding 'colossalai/shardformer/policies/whisper.py' 2024-05-31T11:58:55,489 adding 'colossalai/shardformer/shard/__init__.py' 2024-05-31T11:58:55,491 adding 'colossalai/shardformer/shard/grad_ckpt_config.py' 2024-05-31T11:58:55,492 adding 'colossalai/shardformer/shard/shard_config.py' 2024-05-31T11:58:55,494 adding 'colossalai/shardformer/shard/sharder.py' 2024-05-31T11:58:55,495 adding 'colossalai/shardformer/shard/shardformer.py' 2024-05-31T11:58:55,496 adding 'colossalai/shardformer/shard/utils.py' 2024-05-31T11:58:55,498 adding 'colossalai/tensor/__init__.py' 2024-05-31T11:58:55,500 adding 'colossalai/tensor/colo_parameter.py' 2024-05-31T11:58:55,501 adding 'colossalai/tensor/colo_tensor.py' 2024-05-31T11:58:55,503 adding 'colossalai/tensor/comm_spec.py' 2024-05-31T11:58:55,505 adding 'colossalai/tensor/param_op_hook.py' 2024-05-31T11:58:55,508 adding 'colossalai/tensor/shape_consistency.py' 2024-05-31T11:58:55,510 adding 'colossalai/tensor/sharding_spec.py' 2024-05-31T11:58:55,512 adding 'colossalai/tensor/utils.py' 2024-05-31T11:58:55,514 adding 'colossalai/tensor/d_tensor/__init__.py' 2024-05-31T11:58:55,516 adding 'colossalai/tensor/d_tensor/api.py' 2024-05-31T11:58:55,518 adding 'colossalai/tensor/d_tensor/comm_spec.py' 2024-05-31T11:58:55,519 adding 'colossalai/tensor/d_tensor/layout.py' 2024-05-31T11:58:55,522 adding 'colossalai/tensor/d_tensor/layout_converter.py' 2024-05-31T11:58:55,523 adding 'colossalai/tensor/d_tensor/misc.py' 2024-05-31T11:58:55,525 adding 'colossalai/tensor/d_tensor/sharding_spec.py' 2024-05-31T11:58:55,527 adding 'colossalai/tensor/d_tensor/utils.py' 2024-05-31T11:58:55,528 adding 'colossalai/tensor/moe_tensor/__init__.py' 2024-05-31T11:58:55,529 adding 'colossalai/tensor/moe_tensor/api.py' 2024-05-31T11:58:55,531 adding 'colossalai/tensor/moe_tensor/moe_info.py' 2024-05-31T11:58:55,532 adding 'colossalai/tensor/padded_tensor/__init__.py' 2024-05-31T11:58:55,534 adding 'colossalai/tensor/padded_tensor/api.py' 2024-05-31T11:58:55,535 adding 'colossalai/testing/__init__.py' 2024-05-31T11:58:55,537 adding 'colossalai/testing/comparison.py' 2024-05-31T11:58:55,538 adding 'colossalai/testing/pytest_wrapper.py' 2024-05-31T11:58:55,539 adding 'colossalai/testing/random.py' 2024-05-31T11:58:55,541 adding 'colossalai/testing/utils.py' 2024-05-31T11:58:55,543 adding 'colossalai/utils/__init__.py' 2024-05-31T11:58:55,544 adding 'colossalai/utils/common.py' 2024-05-31T11:58:55,545 adding 'colossalai/utils/memory.py' 2024-05-31T11:58:55,547 adding 'colossalai/utils/timer.py' 2024-05-31T11:58:55,548 adding 'colossalai/utils/model/__init__.py' 2024-05-31T11:58:55,550 adding 'colossalai/utils/model/utils.py' 2024-05-31T11:58:55,551 adding 'colossalai/utils/multi_tensor_apply/__init__.py' 2024-05-31T11:58:55,553 adding 'colossalai/utils/multi_tensor_apply/multi_tensor_apply.py' 2024-05-31T11:58:55,554 adding 'colossalai/utils/rank_recorder/__init__.py' 2024-05-31T11:58:55,556 adding 'colossalai/utils/rank_recorder/rank_recorder.py' 2024-05-31T11:58:55,557 adding 'colossalai/utils/tensor_detector/__init__.py' 2024-05-31T11:58:55,559 adding 'colossalai/utils/tensor_detector/tensor_detector.py' 2024-05-31T11:58:55,560 adding 'colossalai/zero/__init__.py' 2024-05-31T11:58:55,562 adding 'colossalai/zero/wrapper.py' 2024-05-31T11:58:55,563 adding 'colossalai/zero/gemini/__init__.py' 2024-05-31T11:58:55,568 adding 'colossalai/zero/gemini/gemini_ddp.py' 2024-05-31T11:58:55,570 adding 'colossalai/zero/gemini/gemini_hook.py' 2024-05-31T11:58:55,571 adding 'colossalai/zero/gemini/gemini_mgr.py' 2024-05-31T11:58:55,575 adding 'colossalai/zero/gemini/gemini_optimizer.py' 2024-05-31T11:58:55,577 adding 'colossalai/zero/gemini/placement_policy.py' 2024-05-31T11:58:55,579 adding 'colossalai/zero/gemini/utils.py' 2024-05-31T11:58:55,580 adding 'colossalai/zero/gemini/chunk/__init__.py' 2024-05-31T11:58:55,583 adding 'colossalai/zero/gemini/chunk/chunk.py' 2024-05-31T11:58:55,585 adding 'colossalai/zero/gemini/chunk/manager.py' 2024-05-31T11:58:55,587 adding 'colossalai/zero/gemini/chunk/search_utils.py' 2024-05-31T11:58:55,588 adding 'colossalai/zero/gemini/chunk/utils.py' 2024-05-31T11:58:55,590 adding 'colossalai/zero/gemini/memory_tracer/__init__.py' 2024-05-31T11:58:55,591 adding 'colossalai/zero/gemini/memory_tracer/chunk_memstats_collector.py' 2024-05-31T11:58:55,592 adding 'colossalai/zero/gemini/memory_tracer/memory_monitor.py' 2024-05-31T11:58:55,594 adding 'colossalai/zero/gemini/memory_tracer/memory_stats.py' 2024-05-31T11:58:55,595 adding 'colossalai/zero/gemini/memory_tracer/memstats_collector.py' 2024-05-31T11:58:55,596 adding 'colossalai/zero/gemini/memory_tracer/param_runtime_order.py' 2024-05-31T11:58:55,598 adding 'colossalai/zero/gemini/memory_tracer/runtime_mem_tracer.py' 2024-05-31T11:58:55,599 adding 'colossalai/zero/gemini/memory_tracer/static_memstats_collector.py' 2024-05-31T11:58:55,600 adding 'colossalai/zero/gemini/memory_tracer/utils.py' 2024-05-31T11:58:55,602 adding 'colossalai/zero/low_level/__init__.py' 2024-05-31T11:58:55,604 adding 'colossalai/zero/low_level/_utils.py' 2024-05-31T11:58:55,608 adding 'colossalai/zero/low_level/low_level_optim.py' 2024-05-31T11:58:55,610 adding 'colossalai/zero/low_level/bookkeeping/__init__.py' 2024-05-31T11:58:55,611 adding 'colossalai/zero/low_level/bookkeeping/base_store.py' 2024-05-31T11:58:55,613 adding 'colossalai/zero/low_level/bookkeeping/bucket_store.py' 2024-05-31T11:58:55,614 adding 'colossalai/zero/low_level/bookkeeping/gradient_store.py' 2024-05-31T11:58:55,616 adding 'colossalai/zero/low_level/bookkeeping/parameter_store.py' 2024-05-31T11:58:55,617 adding 'colossalai/zero/low_level/bookkeeping/tensor_bucket.py' 2024-05-31T11:58:55,619 adding 'extensions/csrc/__init__.py' 2024-05-31T11:58:55,621 adding 'extensions/pybind/__init__.py' 2024-05-31T11:58:55,623 adding 'extensions/pybind/cpu_adam/__init__.py' 2024-05-31T11:58:55,624 adding 'extensions/pybind/cpu_adam/cpu_adam_arm.py' 2024-05-31T11:58:55,625 adding 'extensions/pybind/cpu_adam/cpu_adam_x86.py' 2024-05-31T11:58:55,627 adding 'extensions/pybind/flash_attention/__init__.py' 2024-05-31T11:58:55,628 adding 'extensions/pybind/flash_attention/flash_attention_dao_cuda.py' 2024-05-31T11:58:55,629 adding 'extensions/pybind/flash_attention/flash_attention_npu.py' 2024-05-31T11:58:55,631 adding 'extensions/pybind/flash_attention/flash_attention_sdpa_cuda.py' 2024-05-31T11:58:55,632 adding 'extensions/pybind/inference/__init__.py' 2024-05-31T11:58:55,633 adding 'extensions/pybind/inference/inference_ops_cuda.py' 2024-05-31T11:58:55,635 adding 'extensions/pybind/layernorm/__init__.py' 2024-05-31T11:58:55,636 adding 'extensions/pybind/layernorm/layernorm_cuda.py' 2024-05-31T11:58:55,638 adding 'extensions/pybind/moe/__init__.py' 2024-05-31T11:58:55,639 adding 'extensions/pybind/moe/moe_cuda.py' 2024-05-31T11:58:55,641 adding 'extensions/pybind/optimizer/__init__.py' 2024-05-31T11:58:55,642 adding 'extensions/pybind/optimizer/fused_optimizer_cuda.py' 2024-05-31T11:58:55,644 adding 'extensions/pybind/softmax/__init__.py' 2024-05-31T11:58:55,645 adding 'extensions/pybind/softmax/scaled_masked_softmax_cuda.py' 2024-05-31T11:58:55,646 adding 'extensions/pybind/softmax/scaled_upper_triangle_masked_softmax_cuda.py' 2024-05-31T11:58:55,648 adding 'colossalai-0.3.8.dist-info/LICENSE' 2024-05-31T11:58:55,652 adding 'colossalai-0.3.8.dist-info/METADATA' 2024-05-31T11:58:55,653 adding 'colossalai-0.3.8.dist-info/WHEEL' 2024-05-31T11:58:55,654 adding 'colossalai-0.3.8.dist-info/entry_points.txt' 2024-05-31T11:58:55,655 adding 'colossalai-0.3.8.dist-info/top_level.txt' 2024-05-31T11:58:55,669 adding 'colossalai-0.3.8.dist-info/RECORD' 2024-05-31T11:58:55,706 removing build/bdist.linux-armv7l/wheel 2024-05-31T11:58:56,056 Building wheel for colossalai (setup.py): finished with status 'done' 2024-05-31T11:58:56,074 Created wheel for colossalai: filename=colossalai-0.3.8-py3-none-any.whl size=1513607 sha256=73a2dba29be661597422944d917c709df77c91843d30ab323f6c740173686dab 2024-05-31T11:58:56,075 Stored in directory: /tmp/pip-ephem-wheel-cache-up5smtjt/wheels/f3/84/2a/9f878109ed071f171f7dc5f91d87a18a2187846806114f32d8 2024-05-31T11:58:56,115 Successfully built colossalai 2024-05-31T11:58:56,170 Removed build tracker: '/tmp/pip-build-tracker-oeldu7cw'