2021-08-10T17:59:45,019 Created temporary directory: /tmp/pip-ephem-wheel-cache-cm7dra7m 2021-08-10T17:59:45,023 Created temporary directory: /tmp/pip-req-tracker-sjdfl53m 2021-08-10T17:59:45,023 Initialized build tracking at /tmp/pip-req-tracker-sjdfl53m 2021-08-10T17:59:45,023 Created build tracker: /tmp/pip-req-tracker-sjdfl53m 2021-08-10T17:59:45,024 Entered build tracker: /tmp/pip-req-tracker-sjdfl53m 2021-08-10T17:59:45,024 Created temporary directory: /tmp/pip-wheel-73pqudkg 2021-08-10T17:59:45,058 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2021-08-10T17:59:45,061 2 location(s) to search for versions of deepspeed: 2021-08-10T17:59:45,061 * https://pypi.org/simple/deepspeed/ 2021-08-10T17:59:45,061 * https://www.piwheels.org/simple/deepspeed/ 2021-08-10T17:59:45,062 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-08-10T17:59:45,062 Getting page https://pypi.org/simple/deepspeed/ 2021-08-10T17:59:45,064 Found index url https://pypi.org/simple 2021-08-10T17:59:45,173 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2021-08-10T17:59:45,174 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-08-10T17:59:45,174 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2021-08-10T17:59:45,174 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-08-10T17:59:45,174 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2021-08-10T17:59:45,175 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-08-10T17:59:45,175 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2021-08-10T17:59:45,175 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-08-10T17:59:45,176 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2021-08-10T17:59:45,176 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-08-10T17:59:45,176 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-08-10T17:59:45,176 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-08-10T17:59:45,177 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-08-10T17:59:45,177 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-08-10T17:59:45,177 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-08-10T17:59:45,178 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-08-10T17:59:45,178 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-08-10T17:59:45,178 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-08-10T17:59:45,179 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-08-10T17:59:45,179 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-08-10T17:59:45,179 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-08-10T17:59:45,179 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-08-10T17:59:45,180 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-08-10T17:59:45,180 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-08-10T17:59:45,180 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-08-10T17:59:45,181 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-08-10T17:59:45,181 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-08-10T17:59:45,181 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-08-10T17:59:45,181 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-08-10T17:59:45,182 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-08-10T17:59:45,182 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-08-10T17:59:45,182 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-08-10T17:59:45,183 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2021-08-10T17:59:45,183 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2021-08-10T17:59:45,183 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2021-08-10T17:59:45,184 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2021-08-10T17:59:45,184 Getting page https://www.piwheels.org/simple/deepspeed/ 2021-08-10T17:59:45,185 Found index url https://www.piwheels.org/simple 2021-08-10T17:59:45,303 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,304 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,304 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,304 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,304 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,305 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,305 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,305 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,305 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-10T17:59:45,305 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2021-08-10T17:59:45,306 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-08-10T17:59:45,325 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-08-10T17:59:45,339 Collecting deepspeed==0.4.5 2021-08-10T17:59:45,341 Created temporary directory: /tmp/pip-unpack-6tpett_b 2021-08-10T17:59:45,383 Downloading deepspeed-0.4.5.tar.gz (457 kB) 2021-08-10T17:59:46,227 Added deepspeed==0.4.5 from https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb to build tracker '/tmp/pip-req-tracker-sjdfl53m' 2021-08-10T17:59:46,228 Running setup.py (path:/tmp/pip-wheel-73pqudkg/deepspeed_c46f736714904087b643f27f0b144e4f/setup.py) egg_info for package deepspeed 2021-08-10T17:59:46,229 Created temporary directory: /tmp/pip-pip-egg-info-lbp4l65m 2021-08-10T17:59:46,229 Running command python setup.py egg_info 2021-08-10T17:59:47,338 fatal: not a git repository (or any of the parent directories): .git 2021-08-10T17:59:47,615 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-08-10T17:59:47,615 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-08-10T17:59:47,615 DS_BUILD_OPS=0 2021-08-10T17:59:47,615 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-08-10T17:59:47,615 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-08-10T17:59:47,615 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-08-10T17:59:47,616 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-08-10T17:59:47,616 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-08-10T17:59:47,616 version=0.4.5, git_hash=unknown, git_branch=unknown 2021-08-10T17:59:47,616 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-08-10T17:59:47,616 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-08-10T17:59:47,616 ext_modules=[] 2021-08-10T17:59:47,617 running egg_info 2021-08-10T17:59:47,617 creating /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info 2021-08-10T17:59:47,618 writing /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/PKG-INFO 2021-08-10T17:59:47,621 writing dependency_links to /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/dependency_links.txt 2021-08-10T17:59:47,623 writing entry points to /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/entry_points.txt 2021-08-10T17:59:47,624 writing requirements to /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/requires.txt 2021-08-10T17:59:47,625 writing top-level names to /tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/top_level.txt 2021-08-10T17:59:47,627 writing manifest file '/tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/SOURCES.txt' 2021-08-10T17:59:47,786 reading manifest file '/tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/SOURCES.txt' 2021-08-10T17:59:47,788 reading manifest template 'MANIFEST.in' 2021-08-10T17:59:48,411 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-08-10T17:59:48,548 warning: no files found matching '*.tr' under directory 'csrc' 2021-08-10T17:59:48,612 warning: no files found matching '*.cc' under directory 'csrc' 2021-08-10T17:59:48,612 adding license file 'LICENSE' 2021-08-10T17:59:48,628 writing manifest file '/tmp/pip-pip-egg-info-lbp4l65m/deepspeed.egg-info/SOURCES.txt' 2021-08-10T17:59:48,630 deepspeed build time = 1.285362958908081 secs 2021-08-10T17:59:48,700 Source in /tmp/pip-wheel-73pqudkg/deepspeed_c46f736714904087b643f27f0b144e4f has version 0.4.5, which satisfies requirement deepspeed==0.4.5 from https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb 2021-08-10T17:59:48,701 Removed deepspeed==0.4.5 from https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb from build tracker '/tmp/pip-req-tracker-sjdfl53m' 2021-08-10T17:59:48,706 Created temporary directory: /tmp/pip-unpack-8wq9wat9 2021-08-10T17:59:48,707 Building wheels for collected packages: deepspeed 2021-08-10T17:59:48,711 Created temporary directory: /tmp/pip-wheel-vjxjrldf 2021-08-10T17:59:48,712 Building wheel for deepspeed (setup.py): started 2021-08-10T17:59:48,712 Destination directory: /tmp/pip-wheel-vjxjrldf 2021-08-10T17:59:48,712 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-73pqudkg/deepspeed_c46f736714904087b643f27f0b144e4f/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-73pqudkg/deepspeed_c46f736714904087b643f27f0b144e4f/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-vjxjrldf 2021-08-10T17:59:49,393 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-08-10T17:59:49,406 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-08-10T17:59:49,416 DS_BUILD_OPS=0 2021-08-10T17:59:49,417 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-08-10T17:59:49,569 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-08-10T17:59:49,648 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-08-10T17:59:49,649 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-08-10T17:59:49,649 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-08-10T17:59:49,668 fatal: not a git repository (or any of the parent directories): .git 2021-08-10T17:59:49,671 version=0.4.5, git_hash=unknown, git_branch=unknown 2021-08-10T17:59:49,672 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-08-10T17:59:49,672 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-08-10T17:59:49,672 ext_modules=[] 2021-08-10T17:59:49,934 running bdist_wheel 2021-08-10T17:59:49,939 running build 2021-08-10T17:59:49,939 running build_py 2021-08-10T17:59:50,066 creating build 2021-08-10T17:59:50,066 creating build/lib 2021-08-10T17:59:50,067 creating build/lib/deepspeed 2021-08-10T17:59:50,068 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-08-10T17:59:50,071 copying deepspeed/constants.py -> build/lib/deepspeed 2021-08-10T17:59:50,072 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-08-10T17:59:50,074 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-08-10T17:59:50,076 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-08-10T17:59:50,078 creating build/lib/op_builder 2021-08-10T17:59:50,079 copying op_builder/async_io.py -> build/lib/op_builder 2021-08-10T17:59:50,081 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-08-10T17:59:50,083 copying op_builder/__init__.py -> build/lib/op_builder 2021-08-10T17:59:50,085 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-08-10T17:59:50,087 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-08-10T17:59:50,089 copying op_builder/builder.py -> build/lib/op_builder 2021-08-10T17:59:50,091 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-08-10T17:59:50,093 copying op_builder/quantizer.py -> build/lib/op_builder 2021-08-10T17:59:50,095 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-08-10T17:59:50,097 copying op_builder/utils.py -> build/lib/op_builder 2021-08-10T17:59:50,099 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-08-10T17:59:50,100 copying op_builder/transformer.py -> build/lib/op_builder 2021-08-10T17:59:50,103 creating build/lib/deepspeed/elasticity 2021-08-10T17:59:50,104 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-08-10T17:59:50,106 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-08-10T17:59:50,108 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-08-10T17:59:50,110 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-08-10T17:59:50,113 creating build/lib/deepspeed/profiling 2021-08-10T17:59:50,114 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-08-10T17:59:50,116 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-08-10T17:59:50,118 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-08-10T17:59:50,120 creating build/lib/deepspeed/inference 2021-08-10T17:59:50,121 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-08-10T17:59:50,123 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-08-10T17:59:50,127 creating build/lib/deepspeed/runtime 2021-08-10T17:59:50,128 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,133 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,135 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,137 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,140 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,143 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,147 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,150 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,152 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,154 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,157 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,159 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,162 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,164 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-08-10T17:59:50,170 creating build/lib/deepspeed/ops 2021-08-10T17:59:50,171 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-08-10T17:59:50,173 creating build/lib/deepspeed/module_inject 2021-08-10T17:59:50,174 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-08-10T17:59:50,176 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-08-10T17:59:50,179 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-08-10T17:59:50,181 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-08-10T17:59:50,184 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-08-10T17:59:50,187 creating build/lib/deepspeed/utils 2021-08-10T17:59:50,188 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,190 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,192 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,195 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,197 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,199 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-08-10T17:59:50,202 creating build/lib/deepspeed/pipe 2021-08-10T17:59:50,203 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-08-10T17:59:50,206 creating build/lib/deepspeed/launcher 2021-08-10T17:59:50,207 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-08-10T17:59:50,208 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-08-10T17:59:50,211 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-08-10T17:59:50,213 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-08-10T17:59:50,215 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-08-10T17:59:50,218 creating build/lib/deepspeed/profiling/flops_profiler 2021-08-10T17:59:50,219 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-08-10T17:59:50,221 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-08-10T17:59:50,225 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:50,226 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:50,228 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:50,230 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:50,234 creating build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,235 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,237 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,239 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,242 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,244 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,246 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,249 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,250 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,252 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,255 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,258 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,263 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,265 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,269 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-08-10T17:59:50,275 creating build/lib/deepspeed/runtime/compression 2021-08-10T17:59:50,276 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-08-10T17:59:50,278 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-08-10T17:59:50,281 creating build/lib/deepspeed/runtime/fp16 2021-08-10T17:59:50,282 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-08-10T17:59:50,283 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-08-10T17:59:50,286 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-08-10T17:59:50,289 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-08-10T17:59:50,293 creating build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,294 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,296 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,298 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,300 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,303 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,305 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,308 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,311 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,313 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-10T17:59:50,316 creating build/lib/deepspeed/runtime/comm 2021-08-10T17:59:50,317 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-08-10T17:59:50,320 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-08-10T17:59:50,321 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-08-10T17:59:50,325 creating build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,325 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,328 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,330 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,333 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,336 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,340 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-08-10T17:59:50,342 creating build/lib/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:50,343 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:50,345 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:50,348 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:50,351 creating build/lib/deepspeed/ops/transformer 2021-08-10T17:59:50,352 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-08-10T17:59:50,354 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-08-10T17:59:50,358 creating build/lib/deepspeed/ops/aio 2021-08-10T17:59:50,359 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-08-10T17:59:50,362 creating build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,363 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,365 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,368 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,370 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,372 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,376 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,378 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-10T17:59:50,381 creating build/lib/deepspeed/ops/quantizer 2021-08-10T17:59:50,382 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-08-10T17:59:50,384 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-08-10T17:59:50,387 creating build/lib/deepspeed/ops/adam 2021-08-10T17:59:50,388 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-08-10T17:59:50,390 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-08-10T17:59:50,393 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-08-10T17:59:50,395 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-08-10T17:59:50,399 creating build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,400 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,402 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,404 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,406 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,408 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,410 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,413 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,414 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,416 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,419 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,421 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,422 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-08-10T17:59:50,425 creating build/lib/deepspeed/ops/lamb 2021-08-10T17:59:50,426 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-08-10T17:59:50,428 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-08-10T17:59:50,431 creating build/lib/deepspeed/ops/transformer/inference 2021-08-10T17:59:50,432 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-08-10T17:59:50,435 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-08-10T17:59:50,438 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:50,439 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:50,441 running egg_info 2021-08-10T17:59:50,455 writing deepspeed.egg-info/PKG-INFO 2021-08-10T17:59:50,458 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-08-10T17:59:50,460 writing entry points to deepspeed.egg-info/entry_points.txt 2021-08-10T17:59:50,461 writing requirements to deepspeed.egg-info/requires.txt 2021-08-10T17:59:50,463 writing top-level names to deepspeed.egg-info/top_level.txt 2021-08-10T17:59:50,487 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-08-10T17:59:50,496 reading manifest template 'MANIFEST.in' 2021-08-10T17:59:51,097 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-08-10T17:59:51,220 warning: no files found matching '*.tr' under directory 'csrc' 2021-08-10T17:59:51,280 warning: no files found matching '*.cc' under directory 'csrc' 2021-08-10T17:59:51,280 adding license file 'LICENSE' 2021-08-10T17:59:51,298 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-08-10T17:59:51,313 creating build/lib/deepspeed/ops/csrc 2021-08-10T17:59:51,314 creating build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,314 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,317 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,320 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,322 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,324 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,326 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,329 creating build/lib/deepspeed/ops/csrc/aio 2021-08-10T17:59:51,329 creating build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,330 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,333 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,335 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,338 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,340 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,342 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,344 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,345 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,348 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,350 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,352 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,355 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,358 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,360 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,363 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,365 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,367 creating build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,368 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,371 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,373 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,376 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,379 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,381 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,384 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,386 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,389 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,392 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,394 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,397 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,399 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,402 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,404 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,407 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,410 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,412 creating build/lib/deepspeed/ops/csrc/lamb 2021-08-10T17:59:51,413 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-08-10T17:59:51,416 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-08-10T17:59:51,419 creating build/lib/deepspeed/ops/csrc/quantization 2021-08-10T17:59:51,420 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-08-10T17:59:51,423 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-08-10T17:59:51,427 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-08-10T17:59:51,428 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-08-10T17:59:51,431 creating build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,432 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,436 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,439 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,443 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,446 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,450 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,454 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,458 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,461 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-08-10T17:59:51,462 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,463 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,466 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,469 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,472 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,476 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,479 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,480 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,483 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,486 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,488 creating build/lib/deepspeed/ops/csrc/utils 2021-08-10T17:59:51,489 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-08-10T17:59:51,492 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,495 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,498 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,522 running build_scripts 2021-08-10T17:59:51,523 creating build/scripts-3.7 2021-08-10T17:59:51,524 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-08-10T17:59:51,526 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-08-10T17:59:51,527 copying and adjusting bin/ds -> build/scripts-3.7 2021-08-10T17:59:51,529 copying bin/ds_ssh -> build/scripts-3.7 2021-08-10T17:59:51,531 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-08-10T17:59:51,532 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-08-10T17:59:51,533 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-08-10T17:59:51,534 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-08-10T17:59:51,534 changing mode of build/scripts-3.7/ds from 644 to 755 2021-08-10T17:59:51,534 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-08-10T17:59:51,534 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-08-10T17:59:51,540 installing to build/bdist.linux-armv7l/wheel 2021-08-10T17:59:51,540 running install 2021-08-10T17:59:51,541 running install_lib 2021-08-10T17:59:51,545 creating build/bdist.linux-armv7l 2021-08-10T17:59:51,545 creating build/bdist.linux-armv7l/wheel 2021-08-10T17:59:51,547 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:51,549 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-10T17:59:51,550 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-10T17:59:51,552 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-10T17:59:51,554 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-10T17:59:51,556 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-10T17:59:51,560 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-10T17:59:51,560 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-10T17:59:51,562 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-10T17:59:51,564 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-10T17:59:51,567 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-10T17:59:51,568 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-10T17:59:51,570 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-10T17:59:51,574 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-10T17:59:51,575 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-10T17:59:51,577 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-10T17:59:51,580 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:51,584 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,585 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,588 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:51,589 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:51,591 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:51,593 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-10T17:59:51,597 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,598 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,600 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,602 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,605 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,608 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,610 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,613 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,615 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,617 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,620 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,623 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,631 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,633 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,637 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-10T17:59:51,645 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,647 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,649 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,653 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,656 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,660 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,662 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,666 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-10T17:59:51,667 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-10T17:59:51,669 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-10T17:59:51,672 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-10T17:59:51,674 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:51,675 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:51,677 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:51,680 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-10T17:59:51,683 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-10T17:59:51,685 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-10T17:59:51,688 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-10T17:59:51,692 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-10T17:59:51,695 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,698 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,699 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,701 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,703 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,706 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,708 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,711 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,714 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,717 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,720 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-10T17:59:51,723 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,727 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-10T17:59:51,728 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-10T17:59:51,732 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-10T17:59:51,733 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-10T17:59:51,736 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,739 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,740 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,743 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,746 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,749 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,752 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,757 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-10T17:59:51,759 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,762 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,764 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-10T17:59:51,769 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:51,771 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:51,774 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-08-10T17:59:51,775 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-10T17:59:51,777 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-10T17:59:51,778 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-10T17:59:51,781 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-10T17:59:51,783 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-10T17:59:51,784 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-10T17:59:51,788 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-08-10T17:59:51,789 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-08-10T17:59:51,791 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-08-10T17:59:51,794 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,795 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,797 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,800 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,803 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,805 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,808 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,810 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-10T17:59:51,815 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,815 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,818 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,821 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,823 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-10T17:59:51,826 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-10T17:59:51,826 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-10T17:59:51,829 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-10T17:59:51,832 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-10T17:59:51,833 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-10T17:59:51,835 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-10T17:59:51,837 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-10T17:59:51,839 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-10T17:59:51,843 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-08-10T17:59:51,844 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,845 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,848 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,850 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,852 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,854 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,856 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,859 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,861 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,864 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,866 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,868 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,871 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,873 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,876 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,878 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,881 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,883 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-10T17:59:51,887 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,888 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,891 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,895 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-08-10T17:59:51,896 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,898 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,901 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,903 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-10T17:59:51,906 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,907 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,911 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,913 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,916 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,919 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-10T17:59:51,922 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,925 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,927 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,930 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,934 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,937 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-10T17:59:51,942 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-08-10T17:59:51,944 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,945 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,948 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,951 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,953 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,956 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,958 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-10T17:59:51,961 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,962 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,965 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,967 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,970 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,972 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,974 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,976 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,979 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,981 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-10T17:59:51,985 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-08-10T17:59:51,986 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-08-10T17:59:51,989 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,990 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,994 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,997 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:51,999 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:52,002 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:52,005 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-10T17:59:52,008 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-08-10T17:59:52,009 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-08-10T17:59:52,012 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-10T17:59:52,013 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-10T17:59:52,018 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-10T17:59:52,021 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-10T17:59:52,022 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-10T17:59:52,025 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-10T17:59:52,030 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,031 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,034 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,037 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,039 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,042 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,044 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,047 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,049 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,052 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,054 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,056 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,058 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-10T17:59:52,061 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-10T17:59:52,062 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-10T17:59:52,064 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-10T17:59:52,068 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,069 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,071 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,074 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,076 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,079 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-10T17:59:52,083 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,084 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,086 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,088 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,091 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,094 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,096 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-10T17:59:52,099 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-08-10T17:59:52,100 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-08-10T17:59:52,102 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:52,105 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,106 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,109 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,111 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,113 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,116 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-10T17:59:52,119 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-10T17:59:52,122 creating build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,123 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,125 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,127 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,129 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,131 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,134 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,137 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,139 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,141 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,143 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,146 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,148 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-10T17:59:52,149 running install_egg_info 2021-08-10T17:59:52,159 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.4.5-py3.7.egg-info 2021-08-10T17:59:52,175 running install_scripts 2021-08-10T17:59:52,230 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data 2021-08-10T17:59:52,230 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,231 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,233 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,235 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,237 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,239 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,241 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts 2021-08-10T17:59:52,243 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/deepspeed.pt to 755 2021-08-10T17:59:52,243 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/ds_report to 755 2021-08-10T17:59:52,243 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/ds_elastic to 755 2021-08-10T17:59:52,244 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/deepspeed to 755 2021-08-10T17:59:52,244 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/ds_ssh to 755 2021-08-10T17:59:52,244 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.data/scripts/ds to 755 2021-08-10T17:59:52,308 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-08-10T17:59:52,313 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.5.dist-info/WHEEL 2021-08-10T17:59:52,316 creating '/tmp/pip-wheel-vjxjrldf/deepspeed-0.4.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-08-10T17:59:52,320 adding 'deepspeed/__init__.py' 2021-08-10T17:59:52,321 adding 'deepspeed/constants.py' 2021-08-10T17:59:52,323 adding 'deepspeed/env_report.py' 2021-08-10T17:59:52,324 adding 'deepspeed/git_version_info.py' 2021-08-10T17:59:52,325 adding 'deepspeed/git_version_info_installed.py' 2021-08-10T17:59:52,328 adding 'deepspeed/elasticity/__init__.py' 2021-08-10T17:59:52,329 adding 'deepspeed/elasticity/config.py' 2021-08-10T17:59:52,331 adding 'deepspeed/elasticity/constants.py' 2021-08-10T17:59:52,333 adding 'deepspeed/elasticity/elasticity.py' 2021-08-10T17:59:52,335 adding 'deepspeed/inference/__init__.py' 2021-08-10T17:59:52,337 adding 'deepspeed/inference/engine.py' 2021-08-10T17:59:52,339 adding 'deepspeed/launcher/__init__.py' 2021-08-10T17:59:52,340 adding 'deepspeed/launcher/constants.py' 2021-08-10T17:59:52,342 adding 'deepspeed/launcher/launch.py' 2021-08-10T17:59:52,344 adding 'deepspeed/launcher/multinode_runner.py' 2021-08-10T17:59:52,346 adding 'deepspeed/launcher/runner.py' 2021-08-10T17:59:52,349 adding 'deepspeed/module_inject/__init__.py' 2021-08-10T17:59:52,350 adding 'deepspeed/module_inject/inject.py' 2021-08-10T17:59:52,352 adding 'deepspeed/module_inject/module_quantize.py' 2021-08-10T17:59:52,354 adding 'deepspeed/module_inject/replace_module.py' 2021-08-10T17:59:52,356 adding 'deepspeed/module_inject/replace_policy.py' 2021-08-10T17:59:52,358 adding 'deepspeed/ops/__init__.py' 2021-08-10T17:59:52,360 adding 'deepspeed/ops/adam/__init__.py' 2021-08-10T17:59:52,362 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-08-10T17:59:52,363 adding 'deepspeed/ops/adam/fused_adam.py' 2021-08-10T17:59:52,365 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-08-10T17:59:52,366 adding 'deepspeed/ops/aio/__init__.py' 2021-08-10T17:59:52,369 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-08-10T17:59:52,372 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-08-10T17:59:52,374 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-08-10T17:59:52,375 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-08-10T17:59:52,376 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-08-10T17:59:52,378 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-08-10T17:59:52,382 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-08-10T17:59:52,383 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-08-10T17:59:52,384 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-08-10T17:59:52,386 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-08-10T17:59:52,387 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-08-10T17:59:52,389 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-08-10T17:59:52,391 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-08-10T17:59:52,392 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-08-10T17:59:52,394 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-08-10T17:59:52,395 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-08-10T17:59:52,397 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-08-10T17:59:52,398 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-08-10T17:59:52,400 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-08-10T17:59:52,401 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-08-10T17:59:52,403 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-08-10T17:59:52,405 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-08-10T17:59:52,406 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-08-10T17:59:52,408 adding 'deepspeed/ops/csrc/includes/context.h' 2021-08-10T17:59:52,409 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-08-10T17:59:52,411 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-08-10T17:59:52,412 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-08-10T17:59:52,414 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-08-10T17:59:52,415 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-08-10T17:59:52,416 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-08-10T17:59:52,418 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-08-10T17:59:52,419 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-08-10T17:59:52,421 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-08-10T17:59:52,422 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-08-10T17:59:52,423 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-08-10T17:59:52,425 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-08-10T17:59:52,426 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-08-10T17:59:52,428 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-08-10T17:59:52,430 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-08-10T17:59:52,432 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-08-10T17:59:52,434 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-08-10T17:59:52,437 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-08-10T17:59:52,440 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-08-10T17:59:52,442 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-08-10T17:59:52,445 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-08-10T17:59:52,450 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-08-10T17:59:52,452 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-08-10T17:59:52,454 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-08-10T17:59:52,459 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-08-10T17:59:52,461 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-08-10T17:59:52,464 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-08-10T17:59:52,467 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-08-10T17:59:52,469 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-08-10T17:59:52,471 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-08-10T17:59:52,473 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-08-10T17:59:52,475 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-08-10T17:59:52,478 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-08-10T17:59:52,479 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-08-10T17:59:52,481 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-08-10T17:59:52,483 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-08-10T17:59:52,484 adding 'deepspeed/ops/lamb/__init__.py' 2021-08-10T17:59:52,486 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-08-10T17:59:52,488 adding 'deepspeed/ops/op_builder/__init__.py' 2021-08-10T17:59:52,490 adding 'deepspeed/ops/op_builder/async_io.py' 2021-08-10T17:59:52,492 adding 'deepspeed/ops/op_builder/builder.py' 2021-08-10T17:59:52,493 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-08-10T17:59:52,495 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-08-10T17:59:52,496 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-08-10T17:59:52,497 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-08-10T17:59:52,499 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-08-10T17:59:52,500 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-08-10T17:59:52,501 adding 'deepspeed/ops/op_builder/transformer.py' 2021-08-10T17:59:52,502 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-08-10T17:59:52,503 adding 'deepspeed/ops/op_builder/utils.py' 2021-08-10T17:59:52,505 adding 'deepspeed/ops/quantizer/__init__.py' 2021-08-10T17:59:52,506 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-08-10T17:59:52,509 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-08-10T17:59:52,510 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-08-10T17:59:52,513 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-08-10T17:59:52,515 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-08-10T17:59:52,518 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-08-10T17:59:52,519 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-08-10T17:59:52,523 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-08-10T17:59:52,525 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-08-10T17:59:52,527 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-08-10T17:59:52,528 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-08-10T17:59:52,529 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-08-10T17:59:52,531 adding 'deepspeed/ops/transformer/__init__.py' 2021-08-10T17:59:52,534 adding 'deepspeed/ops/transformer/transformer.py' 2021-08-10T17:59:52,536 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-08-10T17:59:52,539 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-08-10T17:59:52,540 adding 'deepspeed/pipe/__init__.py' 2021-08-10T17:59:52,542 adding 'deepspeed/profiling/__init__.py' 2021-08-10T17:59:52,543 adding 'deepspeed/profiling/config.py' 2021-08-10T17:59:52,545 adding 'deepspeed/profiling/constants.py' 2021-08-10T17:59:52,546 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-08-10T17:59:52,551 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-08-10T17:59:52,553 adding 'deepspeed/runtime/__init__.py' 2021-08-10T17:59:52,557 adding 'deepspeed/runtime/config.py' 2021-08-10T17:59:52,558 adding 'deepspeed/runtime/config_utils.py' 2021-08-10T17:59:52,560 adding 'deepspeed/runtime/constants.py' 2021-08-10T17:59:52,562 adding 'deepspeed/runtime/csr_tensor.py' 2021-08-10T17:59:52,563 adding 'deepspeed/runtime/dataloader.py' 2021-08-10T17:59:52,565 adding 'deepspeed/runtime/eigenvalue.py' 2021-08-10T17:59:52,576 adding 'deepspeed/runtime/engine.py' 2021-08-10T17:59:52,581 adding 'deepspeed/runtime/lr_schedules.py' 2021-08-10T17:59:52,582 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-08-10T17:59:52,584 adding 'deepspeed/runtime/quantize.py' 2021-08-10T17:59:52,586 adding 'deepspeed/runtime/state_dict_factory.py' 2021-08-10T17:59:52,589 adding 'deepspeed/runtime/utils.py' 2021-08-10T17:59:52,591 adding 'deepspeed/runtime/weight_quantizer.py' 2021-08-10T17:59:52,593 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-08-10T17:59:52,597 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-08-10T17:59:52,598 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-08-10T17:59:52,600 adding 'deepspeed/runtime/comm/__init__.py' 2021-08-10T17:59:52,602 adding 'deepspeed/runtime/comm/mpi.py' 2021-08-10T17:59:52,603 adding 'deepspeed/runtime/comm/nccl.py' 2021-08-10T17:59:52,605 adding 'deepspeed/runtime/compression/__init__.py' 2021-08-10T17:59:52,606 adding 'deepspeed/runtime/compression/cupy.py' 2021-08-10T17:59:52,608 adding 'deepspeed/runtime/fp16/__init__.py' 2021-08-10T17:59:52,610 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-08-10T17:59:52,612 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-08-10T17:59:52,614 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-08-10T17:59:52,616 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-08-10T17:59:52,619 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-08-10T17:59:52,622 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-08-10T17:59:52,624 adding 'deepspeed/runtime/pipe/__init__.py' 2021-08-10T17:59:52,630 adding 'deepspeed/runtime/pipe/engine.py' 2021-08-10T17:59:52,634 adding 'deepspeed/runtime/pipe/module.py' 2021-08-10T17:59:52,635 adding 'deepspeed/runtime/pipe/p2p.py' 2021-08-10T17:59:52,638 adding 'deepspeed/runtime/pipe/schedule.py' 2021-08-10T17:59:52,640 adding 'deepspeed/runtime/pipe/topology.py' 2021-08-10T17:59:52,642 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-08-10T17:59:52,643 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-08-10T17:59:52,645 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-08-10T17:59:52,646 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-08-10T17:59:52,649 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-08-10T17:59:52,651 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-08-10T17:59:52,653 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-08-10T17:59:52,655 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-08-10T17:59:52,657 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-08-10T17:59:52,659 adding 'deepspeed/runtime/zero/__init__.py' 2021-08-10T17:59:52,660 adding 'deepspeed/runtime/zero/config.py' 2021-08-10T17:59:52,662 adding 'deepspeed/runtime/zero/constants.py' 2021-08-10T17:59:52,664 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-08-10T17:59:52,665 adding 'deepspeed/runtime/zero/linear.py' 2021-08-10T17:59:52,667 adding 'deepspeed/runtime/zero/offload_config.py' 2021-08-10T17:59:52,668 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-08-10T17:59:52,674 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-08-10T17:59:52,680 adding 'deepspeed/runtime/zero/stage1.py' 2021-08-10T17:59:52,691 adding 'deepspeed/runtime/zero/stage2.py' 2021-08-10T17:59:52,710 adding 'deepspeed/runtime/zero/stage3.py' 2021-08-10T17:59:52,712 adding 'deepspeed/runtime/zero/test.py' 2021-08-10T17:59:52,714 adding 'deepspeed/runtime/zero/tiling.py' 2021-08-10T17:59:52,715 adding 'deepspeed/runtime/zero/utils.py' 2021-08-10T17:59:52,716 adding 'deepspeed/utils/__init__.py' 2021-08-10T17:59:52,718 adding 'deepspeed/utils/debug.py' 2021-08-10T17:59:52,719 adding 'deepspeed/utils/distributed.py' 2021-08-10T17:59:52,721 adding 'deepspeed/utils/logging.py' 2021-08-10T17:59:52,722 adding 'deepspeed/utils/timer.py' 2021-08-10T17:59:52,724 adding 'deepspeed/utils/zero_to_fp32.py' 2021-08-10T17:59:52,727 adding 'deepspeed-0.4.5.data/scripts/deepspeed' 2021-08-10T17:59:52,729 adding 'deepspeed-0.4.5.data/scripts/deepspeed.pt' 2021-08-10T17:59:52,730 adding 'deepspeed-0.4.5.data/scripts/ds' 2021-08-10T17:59:52,732 adding 'deepspeed-0.4.5.data/scripts/ds_elastic' 2021-08-10T17:59:52,734 adding 'deepspeed-0.4.5.data/scripts/ds_report' 2021-08-10T17:59:52,735 adding 'deepspeed-0.4.5.data/scripts/ds_ssh' 2021-08-10T17:59:52,738 adding 'op_builder/__init__.py' 2021-08-10T17:59:52,740 adding 'op_builder/async_io.py' 2021-08-10T17:59:52,742 adding 'op_builder/builder.py' 2021-08-10T17:59:52,744 adding 'op_builder/cpu_adam.py' 2021-08-10T17:59:52,745 adding 'op_builder/fused_adam.py' 2021-08-10T17:59:52,746 adding 'op_builder/fused_lamb.py' 2021-08-10T17:59:52,747 adding 'op_builder/quantizer.py' 2021-08-10T17:59:52,749 adding 'op_builder/sparse_attn.py' 2021-08-10T17:59:52,750 adding 'op_builder/stochastic_transformer.py' 2021-08-10T17:59:52,751 adding 'op_builder/transformer.py' 2021-08-10T17:59:52,752 adding 'op_builder/transformer_inference.py' 2021-08-10T17:59:52,754 adding 'op_builder/utils.py' 2021-08-10T17:59:52,755 adding 'deepspeed-0.4.5.dist-info/LICENSE' 2021-08-10T17:59:52,757 adding 'deepspeed-0.4.5.dist-info/METADATA' 2021-08-10T17:59:52,759 adding 'deepspeed-0.4.5.dist-info/WHEEL' 2021-08-10T17:59:52,760 adding 'deepspeed-0.4.5.dist-info/entry_points.txt' 2021-08-10T17:59:52,761 adding 'deepspeed-0.4.5.dist-info/top_level.txt' 2021-08-10T17:59:52,763 adding 'deepspeed-0.4.5.dist-info/RECORD' 2021-08-10T17:59:52,775 removing build/bdist.linux-armv7l/wheel 2021-08-10T17:59:52,862 deepspeed build time = 3.189311981201172 secs 2021-08-10T17:59:52,943 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-08-10T17:59:52,950 Created wheel for deepspeed: filename=deepspeed-0.4.5-py3-none-any.whl size=458843 sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 2021-08-10T17:59:52,950 Stored in directory: /tmp/pip-ephem-wheel-cache-cm7dra7m/wheels/9f/f2/cd/086553975e34195ae73057e8fc67ef2ecf6d555bd9d7a89df0 2021-08-10T17:59:52,968 Successfully built deepspeed 2021-08-10T17:59:52,987 Removed build tracker: '/tmp/pip-req-tracker-sjdfl53m'