2021-10-06T21:52:55,847 Created temporary directory: /tmp/pip-ephem-wheel-cache-4pub8w2k 2021-10-06T21:52:55,850 Created temporary directory: /tmp/pip-req-tracker-nelm6vcl 2021-10-06T21:52:55,851 Initialized build tracking at /tmp/pip-req-tracker-nelm6vcl 2021-10-06T21:52:55,851 Created build tracker: /tmp/pip-req-tracker-nelm6vcl 2021-10-06T21:52:55,851 Entered build tracker: /tmp/pip-req-tracker-nelm6vcl 2021-10-06T21:52:55,852 Created temporary directory: /tmp/pip-wheel-1v_yrm96 2021-10-06T21:52:55,885 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2021-10-06T21:52:55,888 2 location(s) to search for versions of deepspeed: 2021-10-06T21:52:55,888 * https://pypi.org/simple/deepspeed/ 2021-10-06T21:52:55,888 * https://www.piwheels.org/simple/deepspeed/ 2021-10-06T21:52:55,888 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-10-06T21:52:55,889 Getting page https://pypi.org/simple/deepspeed/ 2021-10-06T21:52:55,890 Found index url https://pypi.org/simple 2021-10-06T21:52:55,999 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2021-10-06T21:52:55,999 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-10-06T21:52:56,000 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2021-10-06T21:52:56,000 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-10-06T21:52:56,000 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2021-10-06T21:52:56,001 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-10-06T21:52:56,001 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2021-10-06T21:52:56,001 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-10-06T21:52:56,001 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2021-10-06T21:52:56,002 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-10-06T21:52:56,002 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-10-06T21:52:56,002 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-10-06T21:52:56,003 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-10-06T21:52:56,003 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-10-06T21:52:56,003 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-10-06T21:52:56,004 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-10-06T21:52:56,004 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-10-06T21:52:56,004 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-10-06T21:52:56,005 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-10-06T21:52:56,005 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-10-06T21:52:56,005 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-10-06T21:52:56,006 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-10-06T21:52:56,006 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-10-06T21:52:56,007 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-10-06T21:52:56,007 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-10-06T21:52:56,007 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-10-06T21:52:56,008 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-10-06T21:52:56,008 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-10-06T21:52:56,009 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-10-06T21:52:56,009 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-10-06T21:52:56,010 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-10-06T21:52:56,010 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-10-06T21:52:56,010 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2021-10-06T21:52:56,011 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2021-10-06T21:52:56,011 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2021-10-06T21:52:56,011 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2021-10-06T21:52:56,012 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2021-10-06T21:52:56,012 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2021-10-06T21:52:56,012 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz#sha256=f8c083db2bd1594b928458ac4cef5e8f1599e7b764d475d61a3d5aa94563a287 (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2021-10-06T21:52:56,013 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2021-10-06T21:52:56,013 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2021-10-06T21:52:56,014 Getting page https://www.piwheels.org/simple/deepspeed/ 2021-10-06T21:52:56,015 Found index url https://www.piwheels.org/simple 2021-10-06T21:52:56,192 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,192 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,192 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,193 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,193 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,193 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,193 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,194 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,194 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,194 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,194 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,194 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,195 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,195 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2021-10-06T21:52:56,195 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2021-10-06T21:52:56,195 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-10-06T21:52:56,214 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-10-06T21:52:56,228 Collecting deepspeed==0.5.4 2021-10-06T21:52:56,230 Created temporary directory: /tmp/pip-unpack-3_g_xpky 2021-10-06T21:52:56,272 Downloading deepspeed-0.5.4.tar.gz (483 kB) 2021-10-06T21:52:57,140 Added deepspeed==0.5.4 from https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb to build tracker '/tmp/pip-req-tracker-nelm6vcl' 2021-10-06T21:52:57,141 Running setup.py (path:/tmp/pip-wheel-1v_yrm96/deepspeed_6899cee022ae4124a4f10b29c09d0f72/setup.py) egg_info for package deepspeed 2021-10-06T21:52:57,142 Created temporary directory: /tmp/pip-pip-egg-info-fqad9o00 2021-10-06T21:52:57,142 Running command python setup.py egg_info 2021-10-06T21:52:58,353 fatal: not a git repository (or any of the parent directories): .git 2021-10-06T21:52:58,645 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-10-06T21:52:58,645 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-10-06T21:52:58,646 DS_BUILD_OPS=0 2021-10-06T21:52:58,646 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-10-06T21:52:58,646 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-10-06T21:52:58,646 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-10-06T21:52:58,646 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-10-06T21:52:58,646 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-10-06T21:52:58,646 version=0.5.4, git_hash=unknown, git_branch=unknown 2021-10-06T21:52:58,647 install_requires=['torch', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-10-06T21:52:58,647 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-10-06T21:52:58,647 ext_modules=[] 2021-10-06T21:52:58,647 running egg_info 2021-10-06T21:52:58,648 creating /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info 2021-10-06T21:52:58,649 writing /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/PKG-INFO 2021-10-06T21:52:58,652 writing dependency_links to /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/dependency_links.txt 2021-10-06T21:52:58,653 writing entry points to /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/entry_points.txt 2021-10-06T21:52:58,655 writing requirements to /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/requires.txt 2021-10-06T21:52:58,656 writing top-level names to /tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/top_level.txt 2021-10-06T21:52:58,657 writing manifest file '/tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/SOURCES.txt' 2021-10-06T21:52:58,867 reading manifest file '/tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/SOURCES.txt' 2021-10-06T21:52:58,870 reading manifest template 'MANIFEST.in' 2021-10-06T21:52:59,485 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-10-06T21:52:59,617 warning: no files found matching '*.tr' under directory 'csrc' 2021-10-06T21:52:59,681 warning: no files found matching '*.cc' under directory 'csrc' 2021-10-06T21:52:59,681 adding license file 'LICENSE' 2021-10-06T21:52:59,694 writing manifest file '/tmp/pip-pip-egg-info-fqad9o00/deepspeed.egg-info/SOURCES.txt' 2021-10-06T21:52:59,696 deepspeed build time = 1.337606430053711 secs 2021-10-06T21:52:59,770 Source in /tmp/pip-wheel-1v_yrm96/deepspeed_6899cee022ae4124a4f10b29c09d0f72 has version 0.5.4, which satisfies requirement deepspeed==0.5.4 from https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb 2021-10-06T21:52:59,771 Removed deepspeed==0.5.4 from https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb from build tracker '/tmp/pip-req-tracker-nelm6vcl' 2021-10-06T21:52:59,777 Created temporary directory: /tmp/pip-unpack-jb3ios6o 2021-10-06T21:52:59,778 Building wheels for collected packages: deepspeed 2021-10-06T21:52:59,782 Created temporary directory: /tmp/pip-wheel-h5ebej74 2021-10-06T21:52:59,783 Building wheel for deepspeed (setup.py): started 2021-10-06T21:52:59,783 Destination directory: /tmp/pip-wheel-h5ebej74 2021-10-06T21:52:59,783 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-1v_yrm96/deepspeed_6899cee022ae4124a4f10b29c09d0f72/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-1v_yrm96/deepspeed_6899cee022ae4124a4f10b29c09d0f72/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-h5ebej74 2021-10-06T21:53:00,514 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-10-06T21:53:00,528 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-10-06T21:53:00,539 DS_BUILD_OPS=0 2021-10-06T21:53:00,540 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-10-06T21:53:00,683 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-10-06T21:53:00,754 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-10-06T21:53:00,754 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-10-06T21:53:00,755 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-10-06T21:53:00,775 fatal: not a git repository (or any of the parent directories): .git 2021-10-06T21:53:00,778 version=0.5.4, git_hash=unknown, git_branch=unknown 2021-10-06T21:53:00,779 install_requires=['torch', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-10-06T21:53:00,779 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-10-06T21:53:00,779 ext_modules=[] 2021-10-06T21:53:01,057 running bdist_wheel 2021-10-06T21:53:01,062 running build 2021-10-06T21:53:01,062 running build_py 2021-10-06T21:53:01,192 creating build 2021-10-06T21:53:01,192 creating build/lib 2021-10-06T21:53:01,193 creating build/lib/deepspeed 2021-10-06T21:53:01,194 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-10-06T21:53:01,197 copying deepspeed/constants.py -> build/lib/deepspeed 2021-10-06T21:53:01,198 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-10-06T21:53:01,200 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-10-06T21:53:01,202 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-10-06T21:53:01,204 creating build/lib/op_builder 2021-10-06T21:53:01,205 copying op_builder/async_io.py -> build/lib/op_builder 2021-10-06T21:53:01,207 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-10-06T21:53:01,209 copying op_builder/__init__.py -> build/lib/op_builder 2021-10-06T21:53:01,211 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-10-06T21:53:01,213 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-10-06T21:53:01,214 copying op_builder/builder.py -> build/lib/op_builder 2021-10-06T21:53:01,217 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-10-06T21:53:01,218 copying op_builder/quantizer.py -> build/lib/op_builder 2021-10-06T21:53:01,220 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-10-06T21:53:01,222 copying op_builder/utils.py -> build/lib/op_builder 2021-10-06T21:53:01,223 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-10-06T21:53:01,225 copying op_builder/transformer.py -> build/lib/op_builder 2021-10-06T21:53:01,228 creating build/lib/deepspeed/elasticity 2021-10-06T21:53:01,228 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-10-06T21:53:01,230 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-10-06T21:53:01,232 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-10-06T21:53:01,234 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-10-06T21:53:01,238 creating build/lib/deepspeed/profiling 2021-10-06T21:53:01,238 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-10-06T21:53:01,240 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-10-06T21:53:01,241 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-10-06T21:53:01,243 creating build/lib/deepspeed/inference 2021-10-06T21:53:01,244 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-10-06T21:53:01,246 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-10-06T21:53:01,249 creating build/lib/deepspeed/runtime 2021-10-06T21:53:01,250 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,252 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,253 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,256 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,258 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,261 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,265 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,267 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,270 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,272 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,278 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,280 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,282 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,284 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-10-06T21:53:01,290 creating build/lib/deepspeed/moe 2021-10-06T21:53:01,291 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2021-10-06T21:53:01,294 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2021-10-06T21:53:01,297 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2021-10-06T21:53:01,299 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2021-10-06T21:53:01,301 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2021-10-06T21:53:01,303 creating build/lib/deepspeed/ops 2021-10-06T21:53:01,304 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-10-06T21:53:01,307 creating build/lib/deepspeed/module_inject 2021-10-06T21:53:01,308 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-10-06T21:53:01,310 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-10-06T21:53:01,313 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-10-06T21:53:01,315 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-10-06T21:53:01,318 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-10-06T21:53:01,322 creating build/lib/deepspeed/utils 2021-10-06T21:53:01,322 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,325 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,327 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,329 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,332 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,335 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,337 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-10-06T21:53:01,341 creating build/lib/deepspeed/pipe 2021-10-06T21:53:01,341 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-10-06T21:53:01,345 creating build/lib/deepspeed/launcher 2021-10-06T21:53:01,345 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-10-06T21:53:01,347 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-10-06T21:53:01,350 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-10-06T21:53:01,352 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-10-06T21:53:01,355 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-10-06T21:53:01,358 creating build/lib/deepspeed/profiling/flops_profiler 2021-10-06T21:53:01,359 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-10-06T21:53:01,362 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-10-06T21:53:01,366 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:01,367 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:01,369 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:01,371 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:01,375 creating build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,376 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,379 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,381 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,384 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,387 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,390 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,392 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,394 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,396 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,399 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,403 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,408 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,411 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,414 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-10-06T21:53:01,421 creating build/lib/deepspeed/runtime/data_pipeline 2021-10-06T21:53:01,422 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2021-10-06T21:53:01,424 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2021-10-06T21:53:01,428 creating build/lib/deepspeed/runtime/compression 2021-10-06T21:53:01,429 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-10-06T21:53:01,431 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-10-06T21:53:01,434 creating build/lib/deepspeed/runtime/fp16 2021-10-06T21:53:01,435 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-10-06T21:53:01,436 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-10-06T21:53:01,439 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-10-06T21:53:01,442 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-10-06T21:53:01,445 creating build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,446 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,448 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,451 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,453 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,455 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,458 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,460 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,463 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,466 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-10-06T21:53:01,469 creating build/lib/deepspeed/runtime/comm 2021-10-06T21:53:01,470 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-10-06T21:53:01,473 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-10-06T21:53:01,475 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-10-06T21:53:01,478 creating build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,479 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,486 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,489 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,492 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,495 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,500 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-10-06T21:53:01,503 creating build/lib/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:01,504 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:01,506 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:01,508 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:01,512 creating build/lib/deepspeed/ops/transformer 2021-10-06T21:53:01,513 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-10-06T21:53:01,515 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-10-06T21:53:01,519 creating build/lib/deepspeed/ops/aio 2021-10-06T21:53:01,520 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-10-06T21:53:01,523 creating build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,524 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,527 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,530 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,533 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,535 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,539 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,541 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-10-06T21:53:01,545 creating build/lib/deepspeed/ops/quantizer 2021-10-06T21:53:01,546 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-10-06T21:53:01,549 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-10-06T21:53:01,551 creating build/lib/deepspeed/ops/adam 2021-10-06T21:53:01,552 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-10-06T21:53:01,554 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-10-06T21:53:01,557 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-10-06T21:53:01,559 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-10-06T21:53:01,563 creating build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,564 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,567 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,569 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,571 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,572 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,574 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,578 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,580 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,582 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,584 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,586 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,589 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-10-06T21:53:01,592 creating build/lib/deepspeed/ops/lamb 2021-10-06T21:53:01,593 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-10-06T21:53:01,595 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-10-06T21:53:01,598 creating build/lib/deepspeed/ops/transformer/inference 2021-10-06T21:53:01,599 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-10-06T21:53:01,603 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-10-06T21:53:01,606 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:01,607 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:01,609 running egg_info 2021-10-06T21:53:01,625 writing deepspeed.egg-info/PKG-INFO 2021-10-06T21:53:01,629 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-10-06T21:53:01,631 writing entry points to deepspeed.egg-info/entry_points.txt 2021-10-06T21:53:01,632 writing requirements to deepspeed.egg-info/requires.txt 2021-10-06T21:53:01,634 writing top-level names to deepspeed.egg-info/top_level.txt 2021-10-06T21:53:01,680 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-10-06T21:53:01,689 reading manifest template 'MANIFEST.in' 2021-10-06T21:53:02,283 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-10-06T21:53:02,396 warning: no files found matching '*.tr' under directory 'csrc' 2021-10-06T21:53:02,452 warning: no files found matching '*.cc' under directory 'csrc' 2021-10-06T21:53:02,453 adding license file 'LICENSE' 2021-10-06T21:53:02,470 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-10-06T21:53:02,484 creating build/lib/deepspeed/ops/csrc 2021-10-06T21:53:02,485 creating build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,486 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,489 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,492 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,495 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,497 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,500 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-10-06T21:53:02,502 creating build/lib/deepspeed/ops/csrc/aio 2021-10-06T21:53:02,503 creating build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,504 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,508 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,510 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,513 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,515 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,517 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:02,520 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,521 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,523 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,526 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,528 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,531 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,533 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,535 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,542 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,545 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:02,547 creating build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,548 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,551 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,553 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,556 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,558 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,560 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,563 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,565 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,568 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,571 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,574 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,577 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,579 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,582 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,584 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,586 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,589 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,591 creating build/lib/deepspeed/ops/csrc/lamb 2021-10-06T21:53:02,592 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-10-06T21:53:02,595 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-10-06T21:53:02,598 creating build/lib/deepspeed/ops/csrc/quantization 2021-10-06T21:53:02,599 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-10-06T21:53:02,601 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-10-06T21:53:02,605 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-10-06T21:53:02,606 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-10-06T21:53:02,608 creating build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,609 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,612 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,615 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,618 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,621 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,624 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,629 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,631 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-10-06T21:53:02,634 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-10-06T21:53:02,634 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,635 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,638 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,641 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,644 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,647 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:02,650 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:02,651 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:02,653 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:02,655 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:02,658 creating build/lib/deepspeed/ops/csrc/utils 2021-10-06T21:53:02,658 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-10-06T21:53:02,660 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,663 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,665 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,687 running build_scripts 2021-10-06T21:53:02,687 creating build/scripts-3.7 2021-10-06T21:53:02,689 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-10-06T21:53:02,690 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-10-06T21:53:02,692 copying and adjusting bin/ds -> build/scripts-3.7 2021-10-06T21:53:02,694 copying bin/ds_ssh -> build/scripts-3.7 2021-10-06T21:53:02,696 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-10-06T21:53:02,697 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-10-06T21:53:02,698 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-10-06T21:53:02,699 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-10-06T21:53:02,699 changing mode of build/scripts-3.7/ds from 644 to 755 2021-10-06T21:53:02,699 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-10-06T21:53:02,700 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-10-06T21:53:02,706 installing to build/bdist.linux-armv7l/wheel 2021-10-06T21:53:02,706 running install 2021-10-06T21:53:02,707 running install_lib 2021-10-06T21:53:02,711 creating build/bdist.linux-armv7l 2021-10-06T21:53:02,711 creating build/bdist.linux-armv7l/wheel 2021-10-06T21:53:02,713 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:02,714 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-10-06T21:53:02,715 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-10-06T21:53:02,717 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-10-06T21:53:02,719 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-10-06T21:53:02,722 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-10-06T21:53:02,725 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-10-06T21:53:02,725 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-10-06T21:53:02,727 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-10-06T21:53:02,729 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-10-06T21:53:02,731 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-10-06T21:53:02,732 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-10-06T21:53:02,734 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-10-06T21:53:02,738 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-10-06T21:53:02,738 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-10-06T21:53:02,740 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-10-06T21:53:02,743 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:02,746 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,747 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,750 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:02,750 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:02,752 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:02,754 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-10-06T21:53:02,757 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,758 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,760 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,764 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,766 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,769 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,771 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,774 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,776 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,777 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,780 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,783 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,790 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,792 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,796 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-10-06T21:53:02,801 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,803 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,806 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-10-06T21:53:02,807 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-10-06T21:53:02,808 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-10-06T21:53:02,811 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,814 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,817 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,820 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,822 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,825 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-10-06T21:53:02,826 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-10-06T21:53:02,827 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-10-06T21:53:02,830 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-10-06T21:53:02,831 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:02,832 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:02,834 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:02,837 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-10-06T21:53:02,840 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-10-06T21:53:02,841 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-10-06T21:53:02,844 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-10-06T21:53:02,846 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-10-06T21:53:02,849 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,851 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,852 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,854 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,856 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,858 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,860 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,862 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,865 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,868 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,870 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-10-06T21:53:02,872 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,875 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-10-06T21:53:02,876 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-10-06T21:53:02,878 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-10-06T21:53:02,879 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-10-06T21:53:02,881 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,884 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,884 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,887 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,889 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,892 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,894 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,898 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-10-06T21:53:02,900 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,902 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,904 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-10-06T21:53:02,909 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:02,912 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,913 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,915 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,918 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,919 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,921 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-10-06T21:53:02,923 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:02,925 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-10-06T21:53:02,926 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-10-06T21:53:02,928 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-10-06T21:53:02,929 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-10-06T21:53:02,932 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-10-06T21:53:02,933 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-10-06T21:53:02,935 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-10-06T21:53:02,939 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-10-06T21:53:02,940 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-10-06T21:53:02,942 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-10-06T21:53:02,944 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,945 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,948 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,950 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,953 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,955 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,958 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,960 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-10-06T21:53:02,964 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,965 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,968 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,970 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,973 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-10-06T21:53:02,975 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-10-06T21:53:02,976 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-10-06T21:53:02,978 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-10-06T21:53:02,981 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-10-06T21:53:02,981 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-10-06T21:53:02,984 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-10-06T21:53:02,986 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-10-06T21:53:02,988 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-10-06T21:53:02,991 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-10-06T21:53:02,993 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,994 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,997 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:02,999 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,001 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,003 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,005 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,007 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,009 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,011 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,013 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,016 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,018 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,021 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,023 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,024 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,026 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,028 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-10-06T21:53:03,031 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,032 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,035 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,038 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-10-06T21:53:03,040 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:03,041 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:03,044 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:03,046 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-10-06T21:53:03,049 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,050 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,052 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,055 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,058 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,061 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-10-06T21:53:03,063 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,066 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,069 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,071 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,075 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,077 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-10-06T21:53:03,082 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-10-06T21:53:03,083 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,084 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,087 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,090 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,092 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,094 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,096 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-10-06T21:53:03,099 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,100 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,102 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,104 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,107 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,109 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,110 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,112 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,114 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,116 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-10-06T21:53:03,119 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-10-06T21:53:03,120 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-10-06T21:53:03,123 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,124 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,127 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,129 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,131 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,134 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,136 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-10-06T21:53:03,139 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-10-06T21:53:03,139 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-10-06T21:53:03,142 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-10-06T21:53:03,143 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-10-06T21:53:03,146 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-10-06T21:53:03,148 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-10-06T21:53:03,149 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-10-06T21:53:03,151 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-10-06T21:53:03,155 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,156 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,158 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,160 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,162 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,164 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,166 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,168 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,170 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,172 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,173 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,175 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,177 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-10-06T21:53:03,180 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-10-06T21:53:03,181 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-10-06T21:53:03,183 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-10-06T21:53:03,186 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,188 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,189 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,192 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,193 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,196 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-10-06T21:53:03,199 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,200 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,202 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,203 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,206 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,209 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,211 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,213 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-10-06T21:53:03,216 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-10-06T21:53:03,216 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-10-06T21:53:03,218 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:03,220 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,221 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,223 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,225 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,227 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,230 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-10-06T21:53:03,232 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-10-06T21:53:03,235 creating build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,235 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,237 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,239 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,241 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,242 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,244 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,246 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,248 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,250 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,252 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,254 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,256 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-10-06T21:53:03,258 running install_egg_info 2021-10-06T21:53:03,266 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.5.4-py3.7.egg-info 2021-10-06T21:53:03,280 running install_scripts 2021-10-06T21:53:03,332 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data 2021-10-06T21:53:03,332 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,334 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,336 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,338 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,340 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,342 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,343 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts 2021-10-06T21:53:03,345 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/deepspeed.pt to 755 2021-10-06T21:53:03,345 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/ds_report to 755 2021-10-06T21:53:03,345 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/ds_elastic to 755 2021-10-06T21:53:03,345 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/deepspeed to 755 2021-10-06T21:53:03,346 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/ds_ssh to 755 2021-10-06T21:53:03,346 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.data/scripts/ds to 755 2021-10-06T21:53:03,407 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-10-06T21:53:03,411 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.4.dist-info/WHEEL 2021-10-06T21:53:03,414 creating '/tmp/pip-wheel-h5ebej74/deepspeed-0.5.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-10-06T21:53:03,417 adding 'deepspeed/__init__.py' 2021-10-06T21:53:03,419 adding 'deepspeed/constants.py' 2021-10-06T21:53:03,420 adding 'deepspeed/env_report.py' 2021-10-06T21:53:03,421 adding 'deepspeed/git_version_info.py' 2021-10-06T21:53:03,422 adding 'deepspeed/git_version_info_installed.py' 2021-10-06T21:53:03,424 adding 'deepspeed/elasticity/__init__.py' 2021-10-06T21:53:03,425 adding 'deepspeed/elasticity/config.py' 2021-10-06T21:53:03,427 adding 'deepspeed/elasticity/constants.py' 2021-10-06T21:53:03,429 adding 'deepspeed/elasticity/elasticity.py' 2021-10-06T21:53:03,431 adding 'deepspeed/inference/__init__.py' 2021-10-06T21:53:03,432 adding 'deepspeed/inference/engine.py' 2021-10-06T21:53:03,434 adding 'deepspeed/launcher/__init__.py' 2021-10-06T21:53:03,435 adding 'deepspeed/launcher/constants.py' 2021-10-06T21:53:03,436 adding 'deepspeed/launcher/launch.py' 2021-10-06T21:53:03,438 adding 'deepspeed/launcher/multinode_runner.py' 2021-10-06T21:53:03,440 adding 'deepspeed/launcher/runner.py' 2021-10-06T21:53:03,442 adding 'deepspeed/module_inject/__init__.py' 2021-10-06T21:53:03,443 adding 'deepspeed/module_inject/inject.py' 2021-10-06T21:53:03,444 adding 'deepspeed/module_inject/module_quantize.py' 2021-10-06T21:53:03,447 adding 'deepspeed/module_inject/replace_module.py' 2021-10-06T21:53:03,448 adding 'deepspeed/module_inject/replace_policy.py' 2021-10-06T21:53:03,450 adding 'deepspeed/moe/__init__.py' 2021-10-06T21:53:03,451 adding 'deepspeed/moe/experts.py' 2021-10-06T21:53:03,453 adding 'deepspeed/moe/layer.py' 2021-10-06T21:53:03,455 adding 'deepspeed/moe/sharded_moe.py' 2021-10-06T21:53:03,456 adding 'deepspeed/moe/utils.py' 2021-10-06T21:53:03,458 adding 'deepspeed/ops/__init__.py' 2021-10-06T21:53:03,460 adding 'deepspeed/ops/adam/__init__.py' 2021-10-06T21:53:03,462 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-10-06T21:53:03,463 adding 'deepspeed/ops/adam/fused_adam.py' 2021-10-06T21:53:03,464 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-10-06T21:53:03,466 adding 'deepspeed/ops/aio/__init__.py' 2021-10-06T21:53:03,468 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-10-06T21:53:03,471 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-10-06T21:53:03,472 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-10-06T21:53:03,473 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-10-06T21:53:03,475 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-10-06T21:53:03,476 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-10-06T21:53:03,479 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-10-06T21:53:03,481 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-10-06T21:53:03,482 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-10-06T21:53:03,483 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-10-06T21:53:03,485 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-10-06T21:53:03,486 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-10-06T21:53:03,488 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-10-06T21:53:03,490 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-10-06T21:53:03,491 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-10-06T21:53:03,492 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-10-06T21:53:03,493 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-10-06T21:53:03,495 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-10-06T21:53:03,496 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-10-06T21:53:03,497 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-10-06T21:53:03,498 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-10-06T21:53:03,500 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-10-06T21:53:03,501 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-10-06T21:53:03,503 adding 'deepspeed/ops/csrc/includes/context.h' 2021-10-06T21:53:03,504 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-10-06T21:53:03,506 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-10-06T21:53:03,508 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-10-06T21:53:03,509 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-10-06T21:53:03,511 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-10-06T21:53:03,512 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-10-06T21:53:03,513 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-10-06T21:53:03,515 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-10-06T21:53:03,516 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-10-06T21:53:03,517 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-10-06T21:53:03,518 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-10-06T21:53:03,519 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-10-06T21:53:03,521 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-10-06T21:53:03,522 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-10-06T21:53:03,524 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-10-06T21:53:03,526 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-10-06T21:53:03,528 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-10-06T21:53:03,531 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-10-06T21:53:03,535 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-10-06T21:53:03,537 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-10-06T21:53:03,540 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-10-06T21:53:03,544 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-10-06T21:53:03,546 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-10-06T21:53:03,548 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-10-06T21:53:03,552 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-10-06T21:53:03,555 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-10-06T21:53:03,558 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-10-06T21:53:03,561 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-10-06T21:53:03,563 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-10-06T21:53:03,565 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-10-06T21:53:03,567 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-10-06T21:53:03,569 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-10-06T21:53:03,572 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-10-06T21:53:03,573 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-10-06T21:53:03,574 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-10-06T21:53:03,576 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-10-06T21:53:03,578 adding 'deepspeed/ops/lamb/__init__.py' 2021-10-06T21:53:03,579 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-10-06T21:53:03,581 adding 'deepspeed/ops/op_builder/__init__.py' 2021-10-06T21:53:03,582 adding 'deepspeed/ops/op_builder/async_io.py' 2021-10-06T21:53:03,585 adding 'deepspeed/ops/op_builder/builder.py' 2021-10-06T21:53:03,586 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-10-06T21:53:03,588 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-10-06T21:53:03,589 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-10-06T21:53:03,590 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-10-06T21:53:03,591 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-10-06T21:53:03,593 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-10-06T21:53:03,594 adding 'deepspeed/ops/op_builder/transformer.py' 2021-10-06T21:53:03,595 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-10-06T21:53:03,596 adding 'deepspeed/ops/op_builder/utils.py' 2021-10-06T21:53:03,598 adding 'deepspeed/ops/quantizer/__init__.py' 2021-10-06T21:53:03,599 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-10-06T21:53:03,601 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-10-06T21:53:03,602 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-10-06T21:53:03,606 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-10-06T21:53:03,608 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-10-06T21:53:03,610 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-10-06T21:53:03,612 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-10-06T21:53:03,615 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-10-06T21:53:03,617 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-10-06T21:53:03,619 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-10-06T21:53:03,620 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-10-06T21:53:03,621 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-10-06T21:53:03,623 adding 'deepspeed/ops/transformer/__init__.py' 2021-10-06T21:53:03,625 adding 'deepspeed/ops/transformer/transformer.py' 2021-10-06T21:53:03,627 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-10-06T21:53:03,630 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-10-06T21:53:03,632 adding 'deepspeed/pipe/__init__.py' 2021-10-06T21:53:03,633 adding 'deepspeed/profiling/__init__.py' 2021-10-06T21:53:03,634 adding 'deepspeed/profiling/config.py' 2021-10-06T21:53:03,636 adding 'deepspeed/profiling/constants.py' 2021-10-06T21:53:03,637 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-10-06T21:53:03,642 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-10-06T21:53:03,644 adding 'deepspeed/runtime/__init__.py' 2021-10-06T21:53:03,647 adding 'deepspeed/runtime/config.py' 2021-10-06T21:53:03,649 adding 'deepspeed/runtime/config_utils.py' 2021-10-06T21:53:03,651 adding 'deepspeed/runtime/constants.py' 2021-10-06T21:53:03,652 adding 'deepspeed/runtime/csr_tensor.py' 2021-10-06T21:53:03,653 adding 'deepspeed/runtime/dataloader.py' 2021-10-06T21:53:03,655 adding 'deepspeed/runtime/eigenvalue.py' 2021-10-06T21:53:03,667 adding 'deepspeed/runtime/engine.py' 2021-10-06T21:53:03,672 adding 'deepspeed/runtime/lr_schedules.py' 2021-10-06T21:53:03,673 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-10-06T21:53:03,675 adding 'deepspeed/runtime/quantize.py' 2021-10-06T21:53:03,677 adding 'deepspeed/runtime/state_dict_factory.py' 2021-10-06T21:53:03,681 adding 'deepspeed/runtime/utils.py' 2021-10-06T21:53:03,683 adding 'deepspeed/runtime/weight_quantizer.py' 2021-10-06T21:53:03,684 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-10-06T21:53:03,689 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-10-06T21:53:03,690 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-10-06T21:53:03,692 adding 'deepspeed/runtime/comm/__init__.py' 2021-10-06T21:53:03,694 adding 'deepspeed/runtime/comm/mpi.py' 2021-10-06T21:53:03,695 adding 'deepspeed/runtime/comm/nccl.py' 2021-10-06T21:53:03,697 adding 'deepspeed/runtime/compression/__init__.py' 2021-10-06T21:53:03,698 adding 'deepspeed/runtime/compression/cupy.py' 2021-10-06T21:53:03,700 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2021-10-06T21:53:03,702 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2021-10-06T21:53:03,704 adding 'deepspeed/runtime/fp16/__init__.py' 2021-10-06T21:53:03,706 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-10-06T21:53:03,708 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-10-06T21:53:03,710 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-10-06T21:53:03,712 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-10-06T21:53:03,714 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-10-06T21:53:03,717 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-10-06T21:53:03,719 adding 'deepspeed/runtime/pipe/__init__.py' 2021-10-06T21:53:03,724 adding 'deepspeed/runtime/pipe/engine.py' 2021-10-06T21:53:03,728 adding 'deepspeed/runtime/pipe/module.py' 2021-10-06T21:53:03,730 adding 'deepspeed/runtime/pipe/p2p.py' 2021-10-06T21:53:03,732 adding 'deepspeed/runtime/pipe/schedule.py' 2021-10-06T21:53:03,735 adding 'deepspeed/runtime/pipe/topology.py' 2021-10-06T21:53:03,737 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-10-06T21:53:03,738 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-10-06T21:53:03,740 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-10-06T21:53:03,741 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-10-06T21:53:03,743 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-10-06T21:53:03,745 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-10-06T21:53:03,748 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-10-06T21:53:03,750 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-10-06T21:53:03,751 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-10-06T21:53:03,753 adding 'deepspeed/runtime/zero/__init__.py' 2021-10-06T21:53:03,755 adding 'deepspeed/runtime/zero/config.py' 2021-10-06T21:53:03,756 adding 'deepspeed/runtime/zero/constants.py' 2021-10-06T21:53:03,758 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-10-06T21:53:03,760 adding 'deepspeed/runtime/zero/linear.py' 2021-10-06T21:53:03,761 adding 'deepspeed/runtime/zero/offload_config.py' 2021-10-06T21:53:03,763 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-10-06T21:53:03,769 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-10-06T21:53:03,775 adding 'deepspeed/runtime/zero/stage1.py' 2021-10-06T21:53:03,787 adding 'deepspeed/runtime/zero/stage2.py' 2021-10-06T21:53:03,804 adding 'deepspeed/runtime/zero/stage3.py' 2021-10-06T21:53:03,807 adding 'deepspeed/runtime/zero/test.py' 2021-10-06T21:53:03,809 adding 'deepspeed/runtime/zero/tiling.py' 2021-10-06T21:53:03,810 adding 'deepspeed/runtime/zero/utils.py' 2021-10-06T21:53:03,812 adding 'deepspeed/utils/__init__.py' 2021-10-06T21:53:03,814 adding 'deepspeed/utils/debug.py' 2021-10-06T21:53:03,815 adding 'deepspeed/utils/distributed.py' 2021-10-06T21:53:03,818 adding 'deepspeed/utils/groups.py' 2021-10-06T21:53:03,819 adding 'deepspeed/utils/logging.py' 2021-10-06T21:53:03,821 adding 'deepspeed/utils/timer.py' 2021-10-06T21:53:03,823 adding 'deepspeed/utils/zero_to_fp32.py' 2021-10-06T21:53:03,825 adding 'deepspeed-0.5.4.data/scripts/deepspeed' 2021-10-06T21:53:03,826 adding 'deepspeed-0.5.4.data/scripts/deepspeed.pt' 2021-10-06T21:53:03,827 adding 'deepspeed-0.5.4.data/scripts/ds' 2021-10-06T21:53:03,829 adding 'deepspeed-0.5.4.data/scripts/ds_elastic' 2021-10-06T21:53:03,830 adding 'deepspeed-0.5.4.data/scripts/ds_report' 2021-10-06T21:53:03,831 adding 'deepspeed-0.5.4.data/scripts/ds_ssh' 2021-10-06T21:53:03,834 adding 'op_builder/__init__.py' 2021-10-06T21:53:03,835 adding 'op_builder/async_io.py' 2021-10-06T21:53:03,838 adding 'op_builder/builder.py' 2021-10-06T21:53:03,839 adding 'op_builder/cpu_adam.py' 2021-10-06T21:53:03,841 adding 'op_builder/fused_adam.py' 2021-10-06T21:53:03,842 adding 'op_builder/fused_lamb.py' 2021-10-06T21:53:03,843 adding 'op_builder/quantizer.py' 2021-10-06T21:53:03,845 adding 'op_builder/sparse_attn.py' 2021-10-06T21:53:03,846 adding 'op_builder/stochastic_transformer.py' 2021-10-06T21:53:03,847 adding 'op_builder/transformer.py' 2021-10-06T21:53:03,848 adding 'op_builder/transformer_inference.py' 2021-10-06T21:53:03,849 adding 'op_builder/utils.py' 2021-10-06T21:53:03,850 adding 'deepspeed-0.5.4.dist-info/LICENSE' 2021-10-06T21:53:03,853 adding 'deepspeed-0.5.4.dist-info/METADATA' 2021-10-06T21:53:03,854 adding 'deepspeed-0.5.4.dist-info/WHEEL' 2021-10-06T21:53:03,855 adding 'deepspeed-0.5.4.dist-info/entry_points.txt' 2021-10-06T21:53:03,855 adding 'deepspeed-0.5.4.dist-info/top_level.txt' 2021-10-06T21:53:03,858 adding 'deepspeed-0.5.4.dist-info/RECORD' 2021-10-06T21:53:03,870 removing build/bdist.linux-armv7l/wheel 2021-10-06T21:53:03,942 deepspeed build time = 3.1616101264953613 secs 2021-10-06T21:53:04,019 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-10-06T21:53:04,028 Created wheel for deepspeed: filename=deepspeed-0.5.4-py3-none-any.whl size=485549 sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 2021-10-06T21:53:04,028 Stored in directory: /tmp/pip-ephem-wheel-cache-4pub8w2k/wheels/97/a6/31/9c9c0e9ae03ad5de4928479b93ae035b59f85fc35f1687e55e 2021-10-06T21:53:04,046 Successfully built deepspeed 2021-10-06T21:53:04,069 Removed build tracker: '/tmp/pip-req-tracker-nelm6vcl'