2021-08-17T05:41:22,496 Created temporary directory: /tmp/pip-ephem-wheel-cache-bazsa2r8 2021-08-17T05:41:22,499 Created temporary directory: /tmp/pip-req-tracker-dpjkh9sp 2021-08-17T05:41:22,499 Initialized build tracking at /tmp/pip-req-tracker-dpjkh9sp 2021-08-17T05:41:22,499 Created build tracker: /tmp/pip-req-tracker-dpjkh9sp 2021-08-17T05:41:22,499 Entered build tracker: /tmp/pip-req-tracker-dpjkh9sp 2021-08-17T05:41:22,500 Created temporary directory: /tmp/pip-wheel-4c14ffdi 2021-08-17T05:41:22,532 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2021-08-17T05:41:22,535 2 location(s) to search for versions of deepspeed: 2021-08-17T05:41:22,535 * https://pypi.org/simple/deepspeed/ 2021-08-17T05:41:22,535 * https://www.piwheels.org/simple/deepspeed/ 2021-08-17T05:41:22,535 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-08-17T05:41:22,536 Getting page https://pypi.org/simple/deepspeed/ 2021-08-17T05:41:22,537 Found index url https://pypi.org/simple 2021-08-17T05:41:22,644 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2021-08-17T05:41:22,645 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-08-17T05:41:22,645 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2021-08-17T05:41:22,645 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-08-17T05:41:22,646 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2021-08-17T05:41:22,646 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-08-17T05:41:22,646 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2021-08-17T05:41:22,646 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-08-17T05:41:22,647 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2021-08-17T05:41:22,647 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-08-17T05:41:22,647 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-08-17T05:41:22,648 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-08-17T05:41:22,648 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-08-17T05:41:22,648 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-08-17T05:41:22,649 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-08-17T05:41:22,649 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-08-17T05:41:22,649 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-08-17T05:41:22,649 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-08-17T05:41:22,650 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-08-17T05:41:22,650 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-08-17T05:41:22,650 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-08-17T05:41:22,651 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-08-17T05:41:22,651 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-08-17T05:41:22,651 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-08-17T05:41:22,651 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-08-17T05:41:22,652 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-08-17T05:41:22,652 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-08-17T05:41:22,652 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-08-17T05:41:22,653 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-08-17T05:41:22,653 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-08-17T05:41:22,653 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-08-17T05:41:22,654 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-08-17T05:41:22,654 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2021-08-17T05:41:22,654 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2021-08-17T05:41:22,654 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2021-08-17T05:41:22,655 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2021-08-17T05:41:22,655 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2021-08-17T05:41:22,655 Getting page https://www.piwheels.org/simple/deepspeed/ 2021-08-17T05:41:22,656 Found index url https://www.piwheels.org/simple 2021-08-17T05:41:22,756 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,757 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,757 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,757 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,758 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,758 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,758 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,758 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,759 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,759 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2021-08-17T05:41:22,759 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2021-08-17T05:41:22,759 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-08-17T05:41:22,778 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-08-17T05:41:22,792 Collecting deepspeed==0.5.0 2021-08-17T05:41:22,794 Created temporary directory: /tmp/pip-unpack-dc0bzhv2 2021-08-17T05:41:22,834 Downloading deepspeed-0.5.0.tar.gz (475 kB) 2021-08-17T05:41:23,739 Added deepspeed==0.5.0 from https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca to build tracker '/tmp/pip-req-tracker-dpjkh9sp' 2021-08-17T05:41:23,740 Running setup.py (path:/tmp/pip-wheel-4c14ffdi/deepspeed_a8e09f76b58d401787e159f34342cb8c/setup.py) egg_info for package deepspeed 2021-08-17T05:41:23,741 Created temporary directory: /tmp/pip-pip-egg-info-slv4_2ol 2021-08-17T05:41:23,741 Running command python setup.py egg_info 2021-08-17T05:41:24,961 fatal: not a git repository (or any of the parent directories): .git 2021-08-17T05:41:25,238 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-08-17T05:41:25,238 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-08-17T05:41:25,238 DS_BUILD_OPS=0 2021-08-17T05:41:25,239 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-08-17T05:41:25,239 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-08-17T05:41:25,239 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-08-17T05:41:25,239 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-08-17T05:41:25,239 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-08-17T05:41:25,239 version=0.5.0, git_hash=unknown, git_branch=unknown 2021-08-17T05:41:25,240 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-08-17T05:41:25,240 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-08-17T05:41:25,240 ext_modules=[] 2021-08-17T05:41:25,240 running egg_info 2021-08-17T05:41:25,241 creating /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info 2021-08-17T05:41:25,241 writing /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/PKG-INFO 2021-08-17T05:41:25,245 writing dependency_links to /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/dependency_links.txt 2021-08-17T05:41:25,246 writing entry points to /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/entry_points.txt 2021-08-17T05:41:25,248 writing requirements to /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/requires.txt 2021-08-17T05:41:25,249 writing top-level names to /tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/top_level.txt 2021-08-17T05:41:25,251 writing manifest file '/tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/SOURCES.txt' 2021-08-17T05:41:25,433 reading manifest file '/tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/SOURCES.txt' 2021-08-17T05:41:25,436 reading manifest template 'MANIFEST.in' 2021-08-17T05:41:26,152 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-08-17T05:41:26,303 warning: no files found matching '*.tr' under directory 'csrc' 2021-08-17T05:41:26,375 warning: no files found matching '*.cc' under directory 'csrc' 2021-08-17T05:41:26,375 adding license file 'LICENSE' 2021-08-17T05:41:26,392 writing manifest file '/tmp/pip-pip-egg-info-slv4_2ol/deepspeed.egg-info/SOURCES.txt' 2021-08-17T05:41:26,395 deepspeed build time = 1.4277029037475586 secs 2021-08-17T05:41:26,467 Source in /tmp/pip-wheel-4c14ffdi/deepspeed_a8e09f76b58d401787e159f34342cb8c has version 0.5.0, which satisfies requirement deepspeed==0.5.0 from https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca 2021-08-17T05:41:26,469 Removed deepspeed==0.5.0 from https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca from build tracker '/tmp/pip-req-tracker-dpjkh9sp' 2021-08-17T05:41:26,474 Created temporary directory: /tmp/pip-unpack-5n4eaew_ 2021-08-17T05:41:26,475 Building wheels for collected packages: deepspeed 2021-08-17T05:41:26,479 Created temporary directory: /tmp/pip-wheel-4ma42vcl 2021-08-17T05:41:26,480 Building wheel for deepspeed (setup.py): started 2021-08-17T05:41:26,480 Destination directory: /tmp/pip-wheel-4ma42vcl 2021-08-17T05:41:26,480 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-4c14ffdi/deepspeed_a8e09f76b58d401787e159f34342cb8c/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-4c14ffdi/deepspeed_a8e09f76b58d401787e159f34342cb8c/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-4ma42vcl 2021-08-17T05:41:27,210 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-08-17T05:41:27,223 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-08-17T05:41:27,233 DS_BUILD_OPS=0 2021-08-17T05:41:27,234 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-08-17T05:41:27,389 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-08-17T05:41:27,468 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-08-17T05:41:27,468 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-08-17T05:41:27,469 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-08-17T05:41:27,487 fatal: not a git repository (or any of the parent directories): .git 2021-08-17T05:41:27,489 version=0.5.0, git_hash=unknown, git_branch=unknown 2021-08-17T05:41:27,491 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-08-17T05:41:27,491 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-08-17T05:41:27,492 ext_modules=[] 2021-08-17T05:41:27,761 running bdist_wheel 2021-08-17T05:41:27,766 running build 2021-08-17T05:41:27,766 running build_py 2021-08-17T05:41:27,893 creating build 2021-08-17T05:41:27,893 creating build/lib 2021-08-17T05:41:27,894 creating build/lib/deepspeed 2021-08-17T05:41:27,895 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-08-17T05:41:27,898 copying deepspeed/constants.py -> build/lib/deepspeed 2021-08-17T05:41:27,899 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-08-17T05:41:27,901 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-08-17T05:41:27,903 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-08-17T05:41:27,905 creating build/lib/op_builder 2021-08-17T05:41:27,906 copying op_builder/async_io.py -> build/lib/op_builder 2021-08-17T05:41:27,908 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-08-17T05:41:27,909 copying op_builder/__init__.py -> build/lib/op_builder 2021-08-17T05:41:27,911 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-08-17T05:41:27,913 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-08-17T05:41:27,914 copying op_builder/builder.py -> build/lib/op_builder 2021-08-17T05:41:27,917 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-08-17T05:41:27,918 copying op_builder/quantizer.py -> build/lib/op_builder 2021-08-17T05:41:27,920 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-08-17T05:41:27,922 copying op_builder/utils.py -> build/lib/op_builder 2021-08-17T05:41:27,924 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-08-17T05:41:27,926 copying op_builder/transformer.py -> build/lib/op_builder 2021-08-17T05:41:27,929 creating build/lib/deepspeed/elasticity 2021-08-17T05:41:27,929 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-08-17T05:41:27,932 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-08-17T05:41:27,933 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-08-17T05:41:27,936 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-08-17T05:41:27,939 creating build/lib/deepspeed/profiling 2021-08-17T05:41:27,940 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-08-17T05:41:27,942 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-08-17T05:41:27,943 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-08-17T05:41:27,946 creating build/lib/deepspeed/inference 2021-08-17T05:41:27,947 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-08-17T05:41:27,949 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-08-17T05:41:27,953 creating build/lib/deepspeed/runtime 2021-08-17T05:41:27,954 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,956 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,957 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,960 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,963 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,966 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,970 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,972 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,975 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,977 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,980 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,982 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,985 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,986 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-08-17T05:41:27,993 creating build/lib/deepspeed/moe 2021-08-17T05:41:27,994 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2021-08-17T05:41:27,997 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2021-08-17T05:41:28,000 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2021-08-17T05:41:28,001 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2021-08-17T05:41:28,003 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2021-08-17T05:41:28,006 creating build/lib/deepspeed/ops 2021-08-17T05:41:28,007 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-08-17T05:41:28,010 creating build/lib/deepspeed/module_inject 2021-08-17T05:41:28,011 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-08-17T05:41:28,013 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-08-17T05:41:28,015 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-08-17T05:41:28,017 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-08-17T05:41:28,020 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-08-17T05:41:28,024 creating build/lib/deepspeed/utils 2021-08-17T05:41:28,024 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,027 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,029 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,031 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,034 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,036 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,039 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-08-17T05:41:28,041 creating build/lib/deepspeed/pipe 2021-08-17T05:41:28,042 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-08-17T05:41:28,045 creating build/lib/deepspeed/launcher 2021-08-17T05:41:28,046 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-08-17T05:41:28,048 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-08-17T05:41:28,050 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-08-17T05:41:28,052 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-08-17T05:41:28,055 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-08-17T05:41:28,059 creating build/lib/deepspeed/profiling/flops_profiler 2021-08-17T05:41:28,060 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-08-17T05:41:28,062 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-08-17T05:41:28,066 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:28,067 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:28,069 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:28,071 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:28,075 creating build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,076 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,079 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,081 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,083 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,086 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,088 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,091 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,093 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,095 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,097 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,101 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,106 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,108 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,113 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-08-17T05:41:28,121 creating build/lib/deepspeed/runtime/data_pipeline 2021-08-17T05:41:28,122 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2021-08-17T05:41:28,124 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2021-08-17T05:41:28,127 creating build/lib/deepspeed/runtime/compression 2021-08-17T05:41:28,128 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-08-17T05:41:28,130 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-08-17T05:41:28,132 creating build/lib/deepspeed/runtime/fp16 2021-08-17T05:41:28,133 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-08-17T05:41:28,135 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-08-17T05:41:28,137 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-08-17T05:41:28,140 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-08-17T05:41:28,144 creating build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,145 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,148 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,151 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,153 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,155 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,158 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,161 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,164 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,166 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-08-17T05:41:28,169 creating build/lib/deepspeed/runtime/comm 2021-08-17T05:41:28,170 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-08-17T05:41:28,173 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-08-17T05:41:28,175 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-08-17T05:41:28,179 creating build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,180 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,183 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,185 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,188 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,191 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,195 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-08-17T05:41:28,198 creating build/lib/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:28,199 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:28,201 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:28,204 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:28,208 creating build/lib/deepspeed/ops/transformer 2021-08-17T05:41:28,209 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-08-17T05:41:28,211 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-08-17T05:41:28,215 creating build/lib/deepspeed/ops/aio 2021-08-17T05:41:28,216 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-08-17T05:41:28,219 creating build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,219 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,222 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,225 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,228 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,230 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,234 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,236 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-08-17T05:41:28,240 creating build/lib/deepspeed/ops/quantizer 2021-08-17T05:41:28,241 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-08-17T05:41:28,243 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-08-17T05:41:28,246 creating build/lib/deepspeed/ops/adam 2021-08-17T05:41:28,247 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-08-17T05:41:28,250 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-08-17T05:41:28,252 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-08-17T05:41:28,254 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-08-17T05:41:28,258 creating build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,260 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,262 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,264 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,266 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,269 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,271 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,274 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,276 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,278 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,280 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,283 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,285 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-08-17T05:41:28,288 creating build/lib/deepspeed/ops/lamb 2021-08-17T05:41:28,289 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-08-17T05:41:28,291 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-08-17T05:41:28,294 creating build/lib/deepspeed/ops/transformer/inference 2021-08-17T05:41:28,295 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-08-17T05:41:28,299 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-08-17T05:41:28,301 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:28,302 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:28,305 running egg_info 2021-08-17T05:41:28,320 writing deepspeed.egg-info/PKG-INFO 2021-08-17T05:41:28,323 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-08-17T05:41:28,325 writing entry points to deepspeed.egg-info/entry_points.txt 2021-08-17T05:41:28,326 writing requirements to deepspeed.egg-info/requires.txt 2021-08-17T05:41:28,328 writing top-level names to deepspeed.egg-info/top_level.txt 2021-08-17T05:41:28,370 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-08-17T05:41:28,380 reading manifest template 'MANIFEST.in' 2021-08-17T05:41:29,075 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-08-17T05:41:29,235 warning: no files found matching '*.tr' under directory 'csrc' 2021-08-17T05:41:29,307 warning: no files found matching '*.cc' under directory 'csrc' 2021-08-17T05:41:29,308 adding license file 'LICENSE' 2021-08-17T05:41:29,330 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-08-17T05:41:29,345 creating build/lib/deepspeed/ops/csrc 2021-08-17T05:41:29,346 creating build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,347 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,349 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,353 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,355 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,357 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,360 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-08-17T05:41:29,362 creating build/lib/deepspeed/ops/csrc/aio 2021-08-17T05:41:29,363 creating build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,364 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,367 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,370 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,372 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,375 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,379 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,381 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,382 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,385 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,388 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,391 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,393 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,397 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,400 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,403 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,405 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,408 creating build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,409 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,411 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,414 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,417 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,420 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,422 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,425 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,428 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,431 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,433 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,435 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,438 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,441 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,443 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,446 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,448 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,451 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,453 creating build/lib/deepspeed/ops/csrc/lamb 2021-08-17T05:41:29,454 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-08-17T05:41:29,457 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-08-17T05:41:29,460 creating build/lib/deepspeed/ops/csrc/quantization 2021-08-17T05:41:29,461 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-08-17T05:41:29,464 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-08-17T05:41:29,468 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-08-17T05:41:29,469 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-08-17T05:41:29,471 creating build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,472 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,475 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,479 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,483 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,486 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,490 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,495 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,498 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,502 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-08-17T05:41:29,502 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,503 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,506 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,509 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,512 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,515 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,519 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,519 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,522 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,525 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,528 creating build/lib/deepspeed/ops/csrc/utils 2021-08-17T05:41:29,528 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-08-17T05:41:29,531 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,534 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,537 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,561 running build_scripts 2021-08-17T05:41:29,562 creating build/scripts-3.7 2021-08-17T05:41:29,563 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-08-17T05:41:29,565 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-08-17T05:41:29,566 copying and adjusting bin/ds -> build/scripts-3.7 2021-08-17T05:41:29,568 copying bin/ds_ssh -> build/scripts-3.7 2021-08-17T05:41:29,570 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-08-17T05:41:29,572 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-08-17T05:41:29,572 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-08-17T05:41:29,573 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-08-17T05:41:29,573 changing mode of build/scripts-3.7/ds from 644 to 755 2021-08-17T05:41:29,573 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-08-17T05:41:29,574 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-08-17T05:41:29,580 installing to build/bdist.linux-armv7l/wheel 2021-08-17T05:41:29,580 running install 2021-08-17T05:41:29,581 running install_lib 2021-08-17T05:41:29,585 creating build/bdist.linux-armv7l 2021-08-17T05:41:29,585 creating build/bdist.linux-armv7l/wheel 2021-08-17T05:41:29,587 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:29,588 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-17T05:41:29,589 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-17T05:41:29,591 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-17T05:41:29,593 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-17T05:41:29,595 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-08-17T05:41:29,598 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-17T05:41:29,599 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-17T05:41:29,601 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-17T05:41:29,602 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-08-17T05:41:29,605 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-17T05:41:29,605 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-17T05:41:29,607 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-08-17T05:41:29,611 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-17T05:41:29,612 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-17T05:41:29,614 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-08-17T05:41:29,617 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:29,620 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,621 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,624 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:29,625 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:29,627 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:29,629 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-08-17T05:41:29,632 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,633 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,636 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,637 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,640 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,643 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,645 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,648 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,650 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,652 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,654 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,658 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,663 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,665 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,669 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-08-17T05:41:29,676 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,677 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,680 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-08-17T05:41:29,681 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-08-17T05:41:29,683 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-08-17T05:41:29,686 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,689 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,692 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,695 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,698 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,701 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-17T05:41:29,702 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-17T05:41:29,704 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-08-17T05:41:29,706 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-17T05:41:29,708 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:29,709 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:29,711 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:29,714 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-08-17T05:41:29,717 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-17T05:41:29,719 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-17T05:41:29,721 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-17T05:41:29,724 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-08-17T05:41:29,727 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,729 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,730 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,733 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,735 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,737 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,740 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,742 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,744 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,747 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,750 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-08-17T05:41:29,752 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,755 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-17T05:41:29,756 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-17T05:41:29,759 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-17T05:41:29,761 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-08-17T05:41:29,763 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,766 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,767 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,770 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,771 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,775 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,778 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,781 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-08-17T05:41:29,783 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,786 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,788 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-08-17T05:41:29,793 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:29,796 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,797 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,799 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,802 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,803 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,805 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-08-17T05:41:29,807 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:29,810 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-08-17T05:41:29,811 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-17T05:41:29,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-17T05:41:29,814 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-17T05:41:29,817 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-08-17T05:41:29,819 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-17T05:41:29,821 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-08-17T05:41:29,825 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-08-17T05:41:29,826 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-08-17T05:41:29,828 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-08-17T05:41:29,831 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,831 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,834 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,837 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,840 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,842 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,845 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,848 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-08-17T05:41:29,851 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,852 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,855 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,857 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,859 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-08-17T05:41:29,862 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-17T05:41:29,863 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-17T05:41:29,865 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-08-17T05:41:29,867 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-17T05:41:29,868 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-17T05:41:29,870 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-17T05:41:29,873 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-17T05:41:29,875 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-08-17T05:41:29,878 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-08-17T05:41:29,880 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,881 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,883 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,885 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,887 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,890 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,892 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,894 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,896 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,899 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,901 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,904 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,907 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,910 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,913 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,915 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,917 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,920 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-08-17T05:41:29,924 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,925 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,927 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,931 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-08-17T05:41:29,933 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,933 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,936 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,938 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-08-17T05:41:29,941 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,942 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,945 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,948 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,951 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,954 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-08-17T05:41:29,956 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,959 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,962 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,965 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,969 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,972 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-08-17T05:41:29,977 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-08-17T05:41:29,979 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,981 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,983 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,987 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,990 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,992 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,995 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-08-17T05:41:29,998 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:29,999 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,002 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,004 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,006 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,009 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,011 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,014 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,016 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,019 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-08-17T05:41:30,022 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-08-17T05:41:30,024 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-08-17T05:41:30,027 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,028 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,032 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,035 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,037 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,040 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,043 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-08-17T05:41:30,046 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-08-17T05:41:30,047 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-08-17T05:41:30,050 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-17T05:41:30,052 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-17T05:41:30,056 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-08-17T05:41:30,059 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-17T05:41:30,060 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-17T05:41:30,063 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-08-17T05:41:30,067 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,069 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,071 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,074 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,076 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,079 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,081 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,084 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,087 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,089 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,092 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,094 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,097 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-08-17T05:41:30,100 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-17T05:41:30,100 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-17T05:41:30,103 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-08-17T05:41:30,106 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,107 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,109 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,112 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,114 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,117 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-08-17T05:41:30,120 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,121 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,124 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,126 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,129 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,132 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,135 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,138 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-08-17T05:41:30,141 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-08-17T05:41:30,142 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-08-17T05:41:30,150 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:30,194 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,195 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,202 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,210 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,213 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,219 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-08-17T05:41:30,223 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-08-17T05:41:30,226 creating build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,228 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,231 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,234 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,237 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,240 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,243 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,246 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,248 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,250 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,253 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,255 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,257 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-08-17T05:41:30,259 running install_egg_info 2021-08-17T05:41:30,268 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.5.0-py3.7.egg-info 2021-08-17T05:41:30,284 running install_scripts 2021-08-17T05:41:30,340 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data 2021-08-17T05:41:30,340 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,342 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,344 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,346 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,348 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,350 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,352 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts 2021-08-17T05:41:30,354 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/deepspeed.pt to 755 2021-08-17T05:41:30,354 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/ds_report to 755 2021-08-17T05:41:30,355 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/ds_elastic to 755 2021-08-17T05:41:30,356 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/deepspeed to 755 2021-08-17T05:41:30,356 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/ds_ssh to 755 2021-08-17T05:41:30,357 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.data/scripts/ds to 755 2021-08-17T05:41:30,417 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-08-17T05:41:30,422 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.0.dist-info/WHEEL 2021-08-17T05:41:30,425 creating '/tmp/pip-wheel-4ma42vcl/deepspeed-0.5.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-08-17T05:41:30,428 adding 'deepspeed/__init__.py' 2021-08-17T05:41:30,430 adding 'deepspeed/constants.py' 2021-08-17T05:41:30,432 adding 'deepspeed/env_report.py' 2021-08-17T05:41:30,433 adding 'deepspeed/git_version_info.py' 2021-08-17T05:41:30,434 adding 'deepspeed/git_version_info_installed.py' 2021-08-17T05:41:30,436 adding 'deepspeed/elasticity/__init__.py' 2021-08-17T05:41:30,438 adding 'deepspeed/elasticity/config.py' 2021-08-17T05:41:30,440 adding 'deepspeed/elasticity/constants.py' 2021-08-17T05:41:30,442 adding 'deepspeed/elasticity/elasticity.py' 2021-08-17T05:41:30,444 adding 'deepspeed/inference/__init__.py' 2021-08-17T05:41:30,446 adding 'deepspeed/inference/engine.py' 2021-08-17T05:41:30,448 adding 'deepspeed/launcher/__init__.py' 2021-08-17T05:41:30,450 adding 'deepspeed/launcher/constants.py' 2021-08-17T05:41:30,452 adding 'deepspeed/launcher/launch.py' 2021-08-17T05:41:30,453 adding 'deepspeed/launcher/multinode_runner.py' 2021-08-17T05:41:30,456 adding 'deepspeed/launcher/runner.py' 2021-08-17T05:41:30,458 adding 'deepspeed/module_inject/__init__.py' 2021-08-17T05:41:30,460 adding 'deepspeed/module_inject/inject.py' 2021-08-17T05:41:30,461 adding 'deepspeed/module_inject/module_quantize.py' 2021-08-17T05:41:30,464 adding 'deepspeed/module_inject/replace_module.py' 2021-08-17T05:41:30,466 adding 'deepspeed/module_inject/replace_policy.py' 2021-08-17T05:41:30,469 adding 'deepspeed/moe/__init__.py' 2021-08-17T05:41:30,470 adding 'deepspeed/moe/experts.py' 2021-08-17T05:41:30,472 adding 'deepspeed/moe/layer.py' 2021-08-17T05:41:30,474 adding 'deepspeed/moe/sharded_moe.py' 2021-08-17T05:41:30,476 adding 'deepspeed/moe/utils.py' 2021-08-17T05:41:30,478 adding 'deepspeed/ops/__init__.py' 2021-08-17T05:41:30,480 adding 'deepspeed/ops/adam/__init__.py' 2021-08-17T05:41:30,482 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-08-17T05:41:30,484 adding 'deepspeed/ops/adam/fused_adam.py' 2021-08-17T05:41:30,485 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-08-17T05:41:30,487 adding 'deepspeed/ops/aio/__init__.py' 2021-08-17T05:41:30,490 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-08-17T05:41:30,493 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-08-17T05:41:30,495 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-08-17T05:41:30,497 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-08-17T05:41:30,498 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-08-17T05:41:30,500 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-08-17T05:41:30,504 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-08-17T05:41:30,505 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-08-17T05:41:30,507 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-08-17T05:41:30,509 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-08-17T05:41:30,510 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-08-17T05:41:30,512 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-08-17T05:41:30,514 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-08-17T05:41:30,516 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-08-17T05:41:30,518 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-08-17T05:41:30,519 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-08-17T05:41:30,521 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-08-17T05:41:30,523 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-08-17T05:41:30,524 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-08-17T05:41:30,526 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-08-17T05:41:30,528 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-08-17T05:41:30,530 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-08-17T05:41:30,532 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-08-17T05:41:30,533 adding 'deepspeed/ops/csrc/includes/context.h' 2021-08-17T05:41:30,535 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-08-17T05:41:30,537 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-08-17T05:41:30,539 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-08-17T05:41:30,540 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-08-17T05:41:30,542 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-08-17T05:41:30,544 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-08-17T05:41:30,545 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-08-17T05:41:30,547 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-08-17T05:41:30,549 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-08-17T05:41:30,551 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-08-17T05:41:30,552 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-08-17T05:41:30,553 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-08-17T05:41:30,555 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-08-17T05:41:30,557 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-08-17T05:41:30,559 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-08-17T05:41:30,562 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-08-17T05:41:30,564 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-08-17T05:41:30,567 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-08-17T05:41:30,570 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-08-17T05:41:30,572 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-08-17T05:41:30,575 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-08-17T05:41:30,580 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-08-17T05:41:30,582 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-08-17T05:41:30,584 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-08-17T05:41:30,590 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-08-17T05:41:30,593 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-08-17T05:41:30,596 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-08-17T05:41:30,599 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-08-17T05:41:30,601 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-08-17T05:41:30,603 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-08-17T05:41:30,606 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-08-17T05:41:30,608 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-08-17T05:41:30,611 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-08-17T05:41:30,612 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-08-17T05:41:30,614 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-08-17T05:41:30,616 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-08-17T05:41:30,618 adding 'deepspeed/ops/lamb/__init__.py' 2021-08-17T05:41:30,620 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-08-17T05:41:30,622 adding 'deepspeed/ops/op_builder/__init__.py' 2021-08-17T05:41:30,624 adding 'deepspeed/ops/op_builder/async_io.py' 2021-08-17T05:41:30,627 adding 'deepspeed/ops/op_builder/builder.py' 2021-08-17T05:41:30,629 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-08-17T05:41:30,630 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-08-17T05:41:30,632 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-08-17T05:41:30,633 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-08-17T05:41:30,635 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-08-17T05:41:30,636 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-08-17T05:41:30,638 adding 'deepspeed/ops/op_builder/transformer.py' 2021-08-17T05:41:30,639 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-08-17T05:41:30,641 adding 'deepspeed/ops/op_builder/utils.py' 2021-08-17T05:41:30,642 adding 'deepspeed/ops/quantizer/__init__.py' 2021-08-17T05:41:30,644 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-08-17T05:41:30,646 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-08-17T05:41:30,648 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-08-17T05:41:30,651 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-08-17T05:41:30,654 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-08-17T05:41:30,656 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-08-17T05:41:30,658 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-08-17T05:41:30,662 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-08-17T05:41:30,664 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-08-17T05:41:30,666 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-08-17T05:41:30,667 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-08-17T05:41:30,669 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-08-17T05:41:30,671 adding 'deepspeed/ops/transformer/__init__.py' 2021-08-17T05:41:30,674 adding 'deepspeed/ops/transformer/transformer.py' 2021-08-17T05:41:30,676 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-08-17T05:41:30,680 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-08-17T05:41:30,682 adding 'deepspeed/pipe/__init__.py' 2021-08-17T05:41:30,684 adding 'deepspeed/profiling/__init__.py' 2021-08-17T05:41:30,685 adding 'deepspeed/profiling/config.py' 2021-08-17T05:41:30,687 adding 'deepspeed/profiling/constants.py' 2021-08-17T05:41:30,689 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-08-17T05:41:30,693 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-08-17T05:41:30,696 adding 'deepspeed/runtime/__init__.py' 2021-08-17T05:41:30,700 adding 'deepspeed/runtime/config.py' 2021-08-17T05:41:30,702 adding 'deepspeed/runtime/config_utils.py' 2021-08-17T05:41:30,705 adding 'deepspeed/runtime/constants.py' 2021-08-17T05:41:30,706 adding 'deepspeed/runtime/csr_tensor.py' 2021-08-17T05:41:30,708 adding 'deepspeed/runtime/dataloader.py' 2021-08-17T05:41:30,710 adding 'deepspeed/runtime/eigenvalue.py' 2021-08-17T05:41:30,723 adding 'deepspeed/runtime/engine.py' 2021-08-17T05:41:30,728 adding 'deepspeed/runtime/lr_schedules.py' 2021-08-17T05:41:30,730 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-08-17T05:41:30,732 adding 'deepspeed/runtime/quantize.py' 2021-08-17T05:41:30,734 adding 'deepspeed/runtime/state_dict_factory.py' 2021-08-17T05:41:30,739 adding 'deepspeed/runtime/utils.py' 2021-08-17T05:41:30,741 adding 'deepspeed/runtime/weight_quantizer.py' 2021-08-17T05:41:30,743 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-08-17T05:41:30,747 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-08-17T05:41:30,749 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-08-17T05:41:30,751 adding 'deepspeed/runtime/comm/__init__.py' 2021-08-17T05:41:30,753 adding 'deepspeed/runtime/comm/mpi.py' 2021-08-17T05:41:30,755 adding 'deepspeed/runtime/comm/nccl.py' 2021-08-17T05:41:30,757 adding 'deepspeed/runtime/compression/__init__.py' 2021-08-17T05:41:30,759 adding 'deepspeed/runtime/compression/cupy.py' 2021-08-17T05:41:30,761 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2021-08-17T05:41:30,763 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2021-08-17T05:41:30,765 adding 'deepspeed/runtime/fp16/__init__.py' 2021-08-17T05:41:30,768 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-08-17T05:41:30,770 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-08-17T05:41:30,773 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-08-17T05:41:30,775 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-08-17T05:41:30,778 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-08-17T05:41:30,781 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-08-17T05:41:30,784 adding 'deepspeed/runtime/pipe/__init__.py' 2021-08-17T05:41:30,790 adding 'deepspeed/runtime/pipe/engine.py' 2021-08-17T05:41:30,794 adding 'deepspeed/runtime/pipe/module.py' 2021-08-17T05:41:30,796 adding 'deepspeed/runtime/pipe/p2p.py' 2021-08-17T05:41:30,799 adding 'deepspeed/runtime/pipe/schedule.py' 2021-08-17T05:41:30,802 adding 'deepspeed/runtime/pipe/topology.py' 2021-08-17T05:41:30,804 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-08-17T05:41:30,805 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-08-17T05:41:30,807 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-08-17T05:41:30,809 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-08-17T05:41:30,812 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-08-17T05:41:30,814 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-08-17T05:41:30,817 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-08-17T05:41:30,820 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-08-17T05:41:30,822 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-08-17T05:41:30,824 adding 'deepspeed/runtime/zero/__init__.py' 2021-08-17T05:41:30,826 adding 'deepspeed/runtime/zero/config.py' 2021-08-17T05:41:30,828 adding 'deepspeed/runtime/zero/constants.py' 2021-08-17T05:41:30,830 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-08-17T05:41:30,833 adding 'deepspeed/runtime/zero/linear.py' 2021-08-17T05:41:30,834 adding 'deepspeed/runtime/zero/offload_config.py' 2021-08-17T05:41:30,836 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-08-17T05:41:30,842 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-08-17T05:41:30,849 adding 'deepspeed/runtime/zero/stage1.py' 2021-08-17T05:41:30,862 adding 'deepspeed/runtime/zero/stage2.py' 2021-08-17T05:41:30,879 adding 'deepspeed/runtime/zero/stage3.py' 2021-08-17T05:41:30,882 adding 'deepspeed/runtime/zero/test.py' 2021-08-17T05:41:30,884 adding 'deepspeed/runtime/zero/tiling.py' 2021-08-17T05:41:30,886 adding 'deepspeed/runtime/zero/utils.py' 2021-08-17T05:41:30,888 adding 'deepspeed/utils/__init__.py' 2021-08-17T05:41:30,889 adding 'deepspeed/utils/debug.py' 2021-08-17T05:41:30,891 adding 'deepspeed/utils/distributed.py' 2021-08-17T05:41:30,893 adding 'deepspeed/utils/groups.py' 2021-08-17T05:41:30,895 adding 'deepspeed/utils/logging.py' 2021-08-17T05:41:30,897 adding 'deepspeed/utils/timer.py' 2021-08-17T05:41:30,899 adding 'deepspeed/utils/zero_to_fp32.py' 2021-08-17T05:41:30,902 adding 'deepspeed-0.5.0.data/scripts/deepspeed' 2021-08-17T05:41:30,903 adding 'deepspeed-0.5.0.data/scripts/deepspeed.pt' 2021-08-17T05:41:30,905 adding 'deepspeed-0.5.0.data/scripts/ds' 2021-08-17T05:41:30,906 adding 'deepspeed-0.5.0.data/scripts/ds_elastic' 2021-08-17T05:41:30,908 adding 'deepspeed-0.5.0.data/scripts/ds_report' 2021-08-17T05:41:30,909 adding 'deepspeed-0.5.0.data/scripts/ds_ssh' 2021-08-17T05:41:30,912 adding 'op_builder/__init__.py' 2021-08-17T05:41:30,914 adding 'op_builder/async_io.py' 2021-08-17T05:41:30,917 adding 'op_builder/builder.py' 2021-08-17T05:41:30,919 adding 'op_builder/cpu_adam.py' 2021-08-17T05:41:30,920 adding 'op_builder/fused_adam.py' 2021-08-17T05:41:30,921 adding 'op_builder/fused_lamb.py' 2021-08-17T05:41:30,923 adding 'op_builder/quantizer.py' 2021-08-17T05:41:30,924 adding 'op_builder/sparse_attn.py' 2021-08-17T05:41:30,926 adding 'op_builder/stochastic_transformer.py' 2021-08-17T05:41:30,927 adding 'op_builder/transformer.py' 2021-08-17T05:41:30,929 adding 'op_builder/transformer_inference.py' 2021-08-17T05:41:30,930 adding 'op_builder/utils.py' 2021-08-17T05:41:30,932 adding 'deepspeed-0.5.0.dist-info/LICENSE' 2021-08-17T05:41:30,935 adding 'deepspeed-0.5.0.dist-info/METADATA' 2021-08-17T05:41:30,936 adding 'deepspeed-0.5.0.dist-info/WHEEL' 2021-08-17T05:41:30,937 adding 'deepspeed-0.5.0.dist-info/entry_points.txt' 2021-08-17T05:41:30,939 adding 'deepspeed-0.5.0.dist-info/top_level.txt' 2021-08-17T05:41:30,941 adding 'deepspeed-0.5.0.dist-info/RECORD' 2021-08-17T05:41:30,954 removing build/bdist.linux-armv7l/wheel 2021-08-17T05:41:31,030 deepspeed build time = 3.5374302864074707 secs 2021-08-17T05:41:31,108 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-08-17T05:41:31,116 Created wheel for deepspeed: filename=deepspeed-0.5.0-py3-none-any.whl size=478504 sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 2021-08-17T05:41:31,116 Stored in directory: /tmp/pip-ephem-wheel-cache-bazsa2r8/wheels/73/9d/f5/378e7dc72af79edb76db7651e7f3b8e14442fe72566b6ccd05 2021-08-17T05:41:31,134 Successfully built deepspeed 2021-08-17T05:41:31,163 Removed build tracker: '/tmp/pip-req-tracker-dpjkh9sp'