2021-09-14T23:10:45,418 Created temporary directory: /tmp/pip-ephem-wheel-cache-lek4127q
2021-09-14T23:10:45,421 Created temporary directory: /tmp/pip-req-tracker-ph965e56
2021-09-14T23:10:45,422 Initialized build tracking at /tmp/pip-req-tracker-ph965e56
2021-09-14T23:10:45,422 Created build tracker: /tmp/pip-req-tracker-ph965e56
2021-09-14T23:10:45,422 Entered build tracker: /tmp/pip-req-tracker-ph965e56
2021-09-14T23:10:45,423 Created temporary directory: /tmp/pip-wheel-0037lw6m
2021-09-14T23:10:45,456 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2021-09-14T23:10:45,459 2 location(s) to search for versions of deepspeed:
2021-09-14T23:10:45,459 * https://pypi.org/simple/deepspeed/
2021-09-14T23:10:45,459 * https://www.piwheels.org/simple/deepspeed/
2021-09-14T23:10:45,459 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2021-09-14T23:10:45,460 Getting page https://pypi.org/simple/deepspeed/
2021-09-14T23:10:45,461 Found index url https://pypi.org/simple
2021-09-14T23:10:45,582   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/)
2021-09-14T23:10:45,582   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2021-09-14T23:10:45,582   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/)
2021-09-14T23:10:45,583   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2021-09-14T23:10:45,583   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/)
2021-09-14T23:10:45,583   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2021-09-14T23:10:45,583   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/)
2021-09-14T23:10:45,584   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2021-09-14T23:10:45,584   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/)
2021-09-14T23:10:45,584   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2021-09-14T23:10:45,585   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2021-09-14T23:10:45,585   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2021-09-14T23:10:45,585   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2021-09-14T23:10:45,585   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2021-09-14T23:10:45,586   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2021-09-14T23:10:45,586   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2021-09-14T23:10:45,586   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2021-09-14T23:10:45,587   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2021-09-14T23:10:45,587   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2021-09-14T23:10:45,587   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2021-09-14T23:10:45,587   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2021-09-14T23:10:45,588   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2021-09-14T23:10:45,588   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2021-09-14T23:10:45,588   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2021-09-14T23:10:45,589   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2021-09-14T23:10:45,589   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2021-09-14T23:10:45,589   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2021-09-14T23:10:45,590   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2021-09-14T23:10:45,590   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2021-09-14T23:10:45,590   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2021-09-14T23:10:45,590   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2021-09-14T23:10:45,591   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2021-09-14T23:10:45,591   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2021-09-14T23:10:45,591   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2021-09-14T23:10:45,591   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2021-09-14T23:10:45,592   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2021-09-14T23:10:45,592   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2021-09-14T23:10:45,592   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2021-09-14T23:10:45,593 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2021-09-14T23:10:45,593 Getting page https://www.piwheels.org/simple/deepspeed/
2021-09-14T23:10:45,594 Found index url https://www.piwheels.org/simple
2021-09-14T23:10:45,696   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,696   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,696   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,697   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,697   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,697   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,698   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,698   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,698   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,699   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,699   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,699   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2021-09-14T23:10:45,699 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2021-09-14T23:10:45,700 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2021-09-14T23:10:45,720 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2021-09-14T23:10:45,734 Collecting deepspeed==0.5.2
2021-09-14T23:10:45,736   Created temporary directory: /tmp/pip-unpack-eg5t8k1j
2021-09-14T23:10:45,777   Downloading deepspeed-0.5.2.tar.gz (477 kB)
2021-09-14T23:10:46,688   Added deepspeed==0.5.2 from https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d to build tracker '/tmp/pip-req-tracker-ph965e56'
2021-09-14T23:10:46,689     Running setup.py (path:/tmp/pip-wheel-0037lw6m/deepspeed_c80f4a823a804b14b542f09999f84183/setup.py) egg_info for package deepspeed
2021-09-14T23:10:46,690     Created temporary directory: /tmp/pip-pip-egg-info-dj3imxmy
2021-09-14T23:10:46,690     Running command python setup.py egg_info
2021-09-14T23:10:47,743     fatal: not a git repository (or any of the parent directories): .git
2021-09-14T23:10:48,024     [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2021-09-14T23:10:48,024     �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2021-09-14T23:10:48,024     DS_BUILD_OPS=0
2021-09-14T23:10:48,024     �[93m [WARNING] �[0m unable to import torch, please install it first
2021-09-14T23:10:48,024     �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2021-09-14T23:10:48,024     �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2021-09-14T23:10:48,025     �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2021-09-14T23:10:48,025     Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2021-09-14T23:10:48,025     version=0.5.2, git_hash=unknown, git_branch=unknown
2021-09-14T23:10:48,025     install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging']
2021-09-14T23:10:48,025     compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2021-09-14T23:10:48,025     ext_modules=[]
2021-09-14T23:10:48,025     running egg_info
2021-09-14T23:10:48,026     creating /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info
2021-09-14T23:10:48,027     writing /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/PKG-INFO
2021-09-14T23:10:48,031     writing dependency_links to /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/dependency_links.txt
2021-09-14T23:10:48,032     writing entry points to /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/entry_points.txt
2021-09-14T23:10:48,034     writing requirements to /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/requires.txt
2021-09-14T23:10:48,035     writing top-level names to /tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/top_level.txt
2021-09-14T23:10:48,037     writing manifest file '/tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/SOURCES.txt'
2021-09-14T23:10:48,203     reading manifest file '/tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/SOURCES.txt'
2021-09-14T23:10:48,205     reading manifest template 'MANIFEST.in'
2021-09-14T23:10:48,810     warning: no files found matching '*.cc' under directory 'deepspeed'
2021-09-14T23:10:48,945     warning: no files found matching '*.tr' under directory 'csrc'
2021-09-14T23:10:49,009     warning: no files found matching '*.cc' under directory 'csrc'
2021-09-14T23:10:49,010     adding license file 'LICENSE'
2021-09-14T23:10:49,025     writing manifest file '/tmp/pip-pip-egg-info-dj3imxmy/deepspeed.egg-info/SOURCES.txt'
2021-09-14T23:10:49,028     deepspeed build time = 1.2773082256317139 secs
2021-09-14T23:10:49,094   Source in /tmp/pip-wheel-0037lw6m/deepspeed_c80f4a823a804b14b542f09999f84183 has version 0.5.2, which satisfies requirement deepspeed==0.5.2 from https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d
2021-09-14T23:10:49,095   Removed deepspeed==0.5.2 from https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d from build tracker '/tmp/pip-req-tracker-ph965e56'
2021-09-14T23:10:49,101 Created temporary directory: /tmp/pip-unpack-n6zcrafn
2021-09-14T23:10:49,101 Building wheels for collected packages: deepspeed
2021-09-14T23:10:49,106   Created temporary directory: /tmp/pip-wheel-n62vudxl
2021-09-14T23:10:49,106   Building wheel for deepspeed (setup.py): started
2021-09-14T23:10:49,106   Destination directory: /tmp/pip-wheel-n62vudxl
2021-09-14T23:10:49,107   Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-0037lw6m/deepspeed_c80f4a823a804b14b542f09999f84183/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-0037lw6m/deepspeed_c80f4a823a804b14b542f09999f84183/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-n62vudxl
2021-09-14T23:10:49,786   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2021-09-14T23:10:49,800   �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2021-09-14T23:10:49,810   DS_BUILD_OPS=0
2021-09-14T23:10:49,811   �[93m [WARNING] �[0m unable to import torch, please install it first
2021-09-14T23:10:49,961   �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2021-09-14T23:10:50,043   �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2021-09-14T23:10:50,043   �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2021-09-14T23:10:50,043   Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2021-09-14T23:10:50,062   fatal: not a git repository (or any of the parent directories): .git
2021-09-14T23:10:50,065   version=0.5.2, git_hash=unknown, git_branch=unknown
2021-09-14T23:10:50,067   install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging']
2021-09-14T23:10:50,067   compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2021-09-14T23:10:50,067   ext_modules=[]
2021-09-14T23:10:50,331   running bdist_wheel
2021-09-14T23:10:50,335   running build
2021-09-14T23:10:50,336   running build_py
2021-09-14T23:10:50,462   creating build
2021-09-14T23:10:50,463   creating build/lib
2021-09-14T23:10:50,463   creating build/lib/deepspeed
2021-09-14T23:10:50,465   copying deepspeed/env_report.py -> build/lib/deepspeed
2021-09-14T23:10:50,467   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2021-09-14T23:10:50,469   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2021-09-14T23:10:50,470   copying deepspeed/constants.py -> build/lib/deepspeed
2021-09-14T23:10:50,472   copying deepspeed/__init__.py -> build/lib/deepspeed
2021-09-14T23:10:50,476   creating build/lib/op_builder
2021-09-14T23:10:50,477   copying op_builder/cpu_adam.py -> build/lib/op_builder
2021-09-14T23:10:50,479   copying op_builder/stochastic_transformer.py -> build/lib/op_builder
2021-09-14T23:10:50,481   copying op_builder/async_io.py -> build/lib/op_builder
2021-09-14T23:10:50,483   copying op_builder/sparse_attn.py -> build/lib/op_builder
2021-09-14T23:10:50,485   copying op_builder/fused_adam.py -> build/lib/op_builder
2021-09-14T23:10:50,487   copying op_builder/transformer_inference.py -> build/lib/op_builder
2021-09-14T23:10:50,489   copying op_builder/builder.py -> build/lib/op_builder
2021-09-14T23:10:50,492   copying op_builder/__init__.py -> build/lib/op_builder
2021-09-14T23:10:50,494   copying op_builder/fused_lamb.py -> build/lib/op_builder
2021-09-14T23:10:50,496   copying op_builder/transformer.py -> build/lib/op_builder
2021-09-14T23:10:50,498   copying op_builder/utils.py -> build/lib/op_builder
2021-09-14T23:10:50,500   copying op_builder/quantizer.py -> build/lib/op_builder
2021-09-14T23:10:50,503   creating build/lib/deepspeed/ops
2021-09-14T23:10:50,504   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2021-09-14T23:10:50,507   creating build/lib/deepspeed/module_inject
2021-09-14T23:10:50,508   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2021-09-14T23:10:50,510   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2021-09-14T23:10:50,514   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2021-09-14T23:10:50,516   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2021-09-14T23:10:50,518   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2021-09-14T23:10:50,522   creating build/lib/deepspeed/runtime
2021-09-14T23:10:50,523   copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,525   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,527   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,532   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,536   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,539   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,542   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,544   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,547   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,550   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,553   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,555   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,559   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,562   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2021-09-14T23:10:50,566   creating build/lib/deepspeed/elasticity
2021-09-14T23:10:50,568   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2021-09-14T23:10:50,571   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2021-09-14T23:10:50,574   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2021-09-14T23:10:50,576   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2021-09-14T23:10:50,580   creating build/lib/deepspeed/profiling
2021-09-14T23:10:50,581   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2021-09-14T23:10:50,584   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2021-09-14T23:10:50,586   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2021-09-14T23:10:50,589   creating build/lib/deepspeed/inference
2021-09-14T23:10:50,590   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2021-09-14T23:10:50,594   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2021-09-14T23:10:50,597   creating build/lib/deepspeed/launcher
2021-09-14T23:10:50,598   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2021-09-14T23:10:50,601   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2021-09-14T23:10:50,604   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2021-09-14T23:10:50,607   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2021-09-14T23:10:50,609   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2021-09-14T23:10:50,612   creating build/lib/deepspeed/moe
2021-09-14T23:10:50,613   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2021-09-14T23:10:50,616   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2021-09-14T23:10:50,618   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2021-09-14T23:10:50,621   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2021-09-14T23:10:50,623   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2021-09-14T23:10:50,626   creating build/lib/deepspeed/pipe
2021-09-14T23:10:50,627   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2021-09-14T23:10:50,630   creating build/lib/deepspeed/utils
2021-09-14T23:10:50,632   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,635   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,638   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,640   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,643   copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,646   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,649   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2021-09-14T23:10:50,652   creating build/lib/deepspeed/ops/adam
2021-09-14T23:10:50,653   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2021-09-14T23:10:50,656   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2021-09-14T23:10:50,659   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2021-09-14T23:10:50,662   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2021-09-14T23:10:50,666   creating build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,667   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,670   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,672   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,675   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,677   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,679   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,682   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,685   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,687   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,689   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,692   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,694   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2021-09-14T23:10:50,697   creating build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,698   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,702   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,705   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,708   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,710   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,712   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,714   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2021-09-14T23:10:50,719   creating build/lib/deepspeed/ops/transformer
2021-09-14T23:10:50,720   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2021-09-14T23:10:50,722   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2021-09-14T23:10:50,726   creating build/lib/deepspeed/ops/aio
2021-09-14T23:10:50,727   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2021-09-14T23:10:50,730   creating build/lib/deepspeed/ops/quantizer
2021-09-14T23:10:50,731   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2021-09-14T23:10:50,733   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2021-09-14T23:10:50,736   creating build/lib/deepspeed/ops/lamb
2021-09-14T23:10:50,737   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2021-09-14T23:10:50,739   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2021-09-14T23:10:50,743   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:50,744   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:50,746   creating build/lib/deepspeed/ops/transformer/inference
2021-09-14T23:10:50,747   copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference
2021-09-14T23:10:50,751   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2021-09-14T23:10:50,753   creating build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,754   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,757   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,760   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,762   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,765   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,768   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,770   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,772   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,775   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2021-09-14T23:10:50,777   creating build/lib/deepspeed/runtime/fp16
2021-09-14T23:10:50,778   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2021-09-14T23:10:50,782   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2021-09-14T23:10:50,785   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2021-09-14T23:10:50,786   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2021-09-14T23:10:50,791   creating build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,792   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,795   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,797   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,800   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,802   copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,804   copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,810   copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,812   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,814   copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,818   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,821   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,828   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,830   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,832   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2021-09-14T23:10:50,837   creating build/lib/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:50,838   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:50,841   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:50,843   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:50,846   creating build/lib/deepspeed/runtime/compression
2021-09-14T23:10:50,846   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2021-09-14T23:10:50,848   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2021-09-14T23:10:50,851   creating build/lib/deepspeed/runtime/comm
2021-09-14T23:10:50,852   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2021-09-14T23:10:50,854   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2021-09-14T23:10:50,856   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2021-09-14T23:10:50,859   creating build/lib/deepspeed/runtime/data_pipeline
2021-09-14T23:10:50,860   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2021-09-14T23:10:50,862   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2021-09-14T23:10:50,865   creating build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,866   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,871   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,874   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,877   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,881   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,883   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2021-09-14T23:10:50,885   creating build/lib/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:50,886   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:50,889   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:50,892   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:50,894   creating build/lib/deepspeed/profiling/flops_profiler
2021-09-14T23:10:50,895   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2021-09-14T23:10:50,899   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2021-09-14T23:10:50,901   running egg_info
2021-09-14T23:10:50,916   writing deepspeed.egg-info/PKG-INFO
2021-09-14T23:10:50,919   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2021-09-14T23:10:50,921   writing entry points to deepspeed.egg-info/entry_points.txt
2021-09-14T23:10:50,922   writing requirements to deepspeed.egg-info/requires.txt
2021-09-14T23:10:50,923   writing top-level names to deepspeed.egg-info/top_level.txt
2021-09-14T23:10:50,947   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2021-09-14T23:10:50,957   reading manifest template 'MANIFEST.in'
2021-09-14T23:10:51,622   warning: no files found matching '*.cc' under directory 'deepspeed'
2021-09-14T23:10:51,764   warning: no files found matching '*.tr' under directory 'csrc'
2021-09-14T23:10:51,832   warning: no files found matching '*.cc' under directory 'csrc'
2021-09-14T23:10:51,832   adding license file 'LICENSE'
2021-09-14T23:10:51,853   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2021-09-14T23:10:51,868   creating build/lib/deepspeed/ops/csrc
2021-09-14T23:10:51,868   creating build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,870   copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,872   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,876   copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,878   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,880   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,883   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2021-09-14T23:10:51,885   creating build/lib/deepspeed/ops/csrc/aio
2021-09-14T23:10:51,886   creating build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,887   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,890   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,893   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,895   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,897   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,900   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:51,902   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,903   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,906   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,908   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,912   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,914   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,920   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,923   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,925   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:51,928   creating build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,929   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,932   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,934   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,937   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,940   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,943   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,946   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,949   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,952   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,954   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,957   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,960   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,962   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,965   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,968   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,970   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,973   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2021-09-14T23:10:51,976   creating build/lib/deepspeed/ops/csrc/lamb
2021-09-14T23:10:51,977   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2021-09-14T23:10:51,980   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2021-09-14T23:10:51,983   creating build/lib/deepspeed/ops/csrc/quantization
2021-09-14T23:10:51,984   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2021-09-14T23:10:51,987   copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2021-09-14T23:10:51,991   creating build/lib/deepspeed/ops/csrc/sparse_attention
2021-09-14T23:10:51,991   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2021-09-14T23:10:51,994   creating build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:51,995   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:51,999   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,002   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,007   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,010   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,013   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,019   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,022   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,026   creating build/lib/deepspeed/ops/csrc/transformer/inference
2021-09-14T23:10:52,026   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,027   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,030   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,033   copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,037   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,040   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,044   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,044   copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,047   copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,050   copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,053   creating build/lib/deepspeed/ops/csrc/utils
2021-09-14T23:10:52,054   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2021-09-14T23:10:52,056   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,059   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,062   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,087   running build_scripts
2021-09-14T23:10:52,088   creating build/scripts-3.7
2021-09-14T23:10:52,089   copying and adjusting bin/deepspeed -> build/scripts-3.7
2021-09-14T23:10:52,091   copying and adjusting bin/deepspeed.pt -> build/scripts-3.7
2021-09-14T23:10:52,093   copying and adjusting bin/ds -> build/scripts-3.7
2021-09-14T23:10:52,094   copying bin/ds_ssh -> build/scripts-3.7
2021-09-14T23:10:52,097   copying and adjusting bin/ds_report -> build/scripts-3.7
2021-09-14T23:10:52,098   copying and adjusting bin/ds_elastic -> build/scripts-3.7
2021-09-14T23:10:52,099   changing mode of build/scripts-3.7/deepspeed from 644 to 755
2021-09-14T23:10:52,099   changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755
2021-09-14T23:10:52,100   changing mode of build/scripts-3.7/ds from 644 to 755
2021-09-14T23:10:52,100   changing mode of build/scripts-3.7/ds_report from 644 to 755
2021-09-14T23:10:52,100   changing mode of build/scripts-3.7/ds_elastic from 644 to 755
2021-09-14T23:10:52,106   installing to build/bdist.linux-armv7l/wheel
2021-09-14T23:10:52,106   running install
2021-09-14T23:10:52,107   running install_lib
2021-09-14T23:10:52,111   creating build/bdist.linux-armv7l
2021-09-14T23:10:52,112   creating build/bdist.linux-armv7l/wheel
2021-09-14T23:10:52,114   creating build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,116   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2021-09-14T23:10:52,117   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-09-14T23:10:52,119   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-09-14T23:10:52,122   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-09-14T23:10:52,124   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-09-14T23:10:52,126   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-09-14T23:10:52,129   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2021-09-14T23:10:52,131   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,132   copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,134   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,137   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,139   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,143   copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,145   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-09-14T23:10:52,148   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,149   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,152   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,154   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,156   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,159   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,162   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,164   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,166   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,169   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,172   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,175   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,177   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,179   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,182   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,184   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,187   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,189   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-09-14T23:10:52,192   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-09-14T23:10:52,193   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-09-14T23:10:52,196   copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-09-14T23:10:52,200   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2021-09-14T23:10:52,201   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2021-09-14T23:10:52,205   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,206   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,209   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,212   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,216   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,219   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,224   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,228   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2021-09-14T23:10:52,230   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,231   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,234   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,236   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,239   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,242   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-09-14T23:10:52,245   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,246   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,248   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,251   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-09-14T23:10:52,253   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,256   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-09-14T23:10:52,259   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2021-09-14T23:10:52,261   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,262   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,264   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,266   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,269   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,271   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,273   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,276   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,278   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,280   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-09-14T23:10:52,283   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,284   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,287   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,289   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,291   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,293   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,295   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-09-14T23:10:52,298   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-09-14T23:10:52,299   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-09-14T23:10:52,302   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-09-14T23:10:52,305   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2021-09-14T23:10:52,306   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2021-09-14T23:10:52,309   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,310   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,312   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,314   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,316   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,318   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,321   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,323   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,326   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,328   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,330   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,332   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,334   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-09-14T23:10:52,337   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,338   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,341   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,344   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,347   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,349   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,352   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,354   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-09-14T23:10:52,358   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,359   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,362   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,364   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,366   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-09-14T23:10:52,369   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-09-14T23:10:52,371   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-09-14T23:10:52,372   copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-09-14T23:10:52,375   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-09-14T23:10:52,378   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-09-14T23:10:52,380   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-09-14T23:10:52,383   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2021-09-14T23:10:52,384   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2021-09-14T23:10:52,387   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-09-14T23:10:52,388   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-09-14T23:10:52,390   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-09-14T23:10:52,393   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-09-14T23:10:52,394   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-09-14T23:10:52,396   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-09-14T23:10:52,399   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2021-09-14T23:10:52,401   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,404   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,405   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,408   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,411   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,414   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,416   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-09-14T23:10:52,418   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,421   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,422   copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,424   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,427   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,433   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,434   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,437   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,440   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,443   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,446   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,448   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,451   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,453   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,455   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-09-14T23:10:52,457   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,461   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,463   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,467   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-09-14T23:10:52,468   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-09-14T23:10:52,472   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:52,473   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:52,476   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:52,479   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-09-14T23:10:52,480   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-09-14T23:10:52,483   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-09-14T23:10:52,485   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-09-14T23:10:52,487   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,490   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,491   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,494   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,497   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,500   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,502   copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,504   copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,509   copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,512   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,513   copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,518   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,521   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,528   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,530   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,532   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-09-14T23:10:52,536   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,539   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:52,539   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:52,543   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:52,544   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-09-14T23:10:52,547   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-09-14T23:10:52,548   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-09-14T23:10:52,550   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-09-14T23:10:52,552   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,555   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-09-14T23:10:52,555   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-09-14T23:10:52,558   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-09-14T23:10:52,560   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-09-14T23:10:52,563   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2021-09-14T23:10:52,564   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2021-09-14T23:10:52,566   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2021-09-14T23:10:52,568   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,571   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,573   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,577   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,578   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,582   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,585   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,587   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,591   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,593   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-09-14T23:10:52,595   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,598   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-09-14T23:10:52,601   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-09-14T23:10:52,602   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-09-14T23:10:52,605   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-09-14T23:10:52,608   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-09-14T23:10:52,610   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-09-14T23:10:52,614   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-09-14T23:10:52,615   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-09-14T23:10:52,616   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-09-14T23:10:52,620   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-09-14T23:10:52,622   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-09-14T23:10:52,624   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-09-14T23:10:52,625   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-09-14T23:10:52,627   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,630   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-09-14T23:10:52,631   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-09-14T23:10:52,634   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-09-14T23:10:52,636   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,638   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-09-14T23:10:52,641   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,642   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,645   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,648   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,650   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,652   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-09-14T23:10:52,654   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,655   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,657   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,660   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,662   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,664   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2021-09-14T23:10:52,666   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2021-09-14T23:10:52,667   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2021-09-14T23:10:52,670   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,671   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,674   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,676   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,678   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,681   copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,684   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,686   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-09-14T23:10:52,689   creating build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,689   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,692   copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,694   copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,695   copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,697   copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,700   copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,701   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,704   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,706   copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,708   copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,710   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,712   copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-09-14T23:10:52,714   running install_egg_info
2021-09-14T23:10:52,723   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.5.2-py3.7.egg-info
2021-09-14T23:10:52,737   running install_scripts
2021-09-14T23:10:52,791   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data
2021-09-14T23:10:52,791   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,792   copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,794   copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,795   copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,797   copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,799   copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,800   copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts
2021-09-14T23:10:52,802   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/deepspeed to 755
2021-09-14T23:10:52,802   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/deepspeed.pt to 755
2021-09-14T23:10:52,802   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/ds_report to 755
2021-09-14T23:10:52,803   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/ds to 755
2021-09-14T23:10:52,803   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/ds_ssh to 755
2021-09-14T23:10:52,803   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.data/scripts/ds_elastic to 755
2021-09-14T23:10:52,864   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2021-09-14T23:10:52,868   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.2.dist-info/WHEEL
2021-09-14T23:10:52,870   creating '/tmp/pip-wheel-n62vudxl/deepspeed-0.5.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2021-09-14T23:10:52,874   adding 'deepspeed/__init__.py'
2021-09-14T23:10:52,875   adding 'deepspeed/constants.py'
2021-09-14T23:10:52,877   adding 'deepspeed/env_report.py'
2021-09-14T23:10:52,878   adding 'deepspeed/git_version_info.py'
2021-09-14T23:10:52,879   adding 'deepspeed/git_version_info_installed.py'
2021-09-14T23:10:52,881   adding 'deepspeed/elasticity/__init__.py'
2021-09-14T23:10:52,882   adding 'deepspeed/elasticity/config.py'
2021-09-14T23:10:52,883   adding 'deepspeed/elasticity/constants.py'
2021-09-14T23:10:52,885   adding 'deepspeed/elasticity/elasticity.py'
2021-09-14T23:10:52,887   adding 'deepspeed/inference/__init__.py'
2021-09-14T23:10:52,889   adding 'deepspeed/inference/engine.py'
2021-09-14T23:10:52,891   adding 'deepspeed/launcher/__init__.py'
2021-09-14T23:10:52,892   adding 'deepspeed/launcher/constants.py'
2021-09-14T23:10:52,893   adding 'deepspeed/launcher/launch.py'
2021-09-14T23:10:52,895   adding 'deepspeed/launcher/multinode_runner.py'
2021-09-14T23:10:52,897   adding 'deepspeed/launcher/runner.py'
2021-09-14T23:10:52,899   adding 'deepspeed/module_inject/__init__.py'
2021-09-14T23:10:52,901   adding 'deepspeed/module_inject/inject.py'
2021-09-14T23:10:52,902   adding 'deepspeed/module_inject/module_quantize.py'
2021-09-14T23:10:52,905   adding 'deepspeed/module_inject/replace_module.py'
2021-09-14T23:10:52,907   adding 'deepspeed/module_inject/replace_policy.py'
2021-09-14T23:10:52,908   adding 'deepspeed/moe/__init__.py'
2021-09-14T23:10:52,910   adding 'deepspeed/moe/experts.py'
2021-09-14T23:10:52,911   adding 'deepspeed/moe/layer.py'
2021-09-14T23:10:52,913   adding 'deepspeed/moe/sharded_moe.py'
2021-09-14T23:10:52,915   adding 'deepspeed/moe/utils.py'
2021-09-14T23:10:52,917   adding 'deepspeed/ops/__init__.py'
2021-09-14T23:10:52,919   adding 'deepspeed/ops/adam/__init__.py'
2021-09-14T23:10:52,921   adding 'deepspeed/ops/adam/cpu_adam.py'
2021-09-14T23:10:52,922   adding 'deepspeed/ops/adam/fused_adam.py'
2021-09-14T23:10:52,923   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2021-09-14T23:10:52,925   adding 'deepspeed/ops/aio/__init__.py'
2021-09-14T23:10:52,927   adding 'deepspeed/ops/csrc/adam/compat.h'
2021-09-14T23:10:52,931   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2021-09-14T23:10:53,150   adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu'
2021-09-14T23:10:53,153   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2021-09-14T23:10:53,156   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2021-09-14T23:10:53,159   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2021-09-14T23:10:53,165   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2021-09-14T23:10:53,168   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2021-09-14T23:10:53,170   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2021-09-14T23:10:53,172   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2021-09-14T23:10:53,174   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2021-09-14T23:10:53,175   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2021-09-14T23:10:53,177   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2021-09-14T23:10:53,178   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2021-09-14T23:10:53,180   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2021-09-14T23:10:53,181   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2021-09-14T23:10:53,183   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2021-09-14T23:10:53,184   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2021-09-14T23:10:53,186   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2021-09-14T23:10:53,187   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2021-09-14T23:10:53,188   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2021-09-14T23:10:53,190   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2021-09-14T23:10:53,191   adding 'deepspeed/ops/csrc/includes/Timer.h'
2021-09-14T23:10:53,193   adding 'deepspeed/ops/csrc/includes/context.h'
2021-09-14T23:10:53,195   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2021-09-14T23:10:53,196   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2021-09-14T23:10:53,198   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2021-09-14T23:10:53,199   adding 'deepspeed/ops/csrc/includes/dropout.h'
2021-09-14T23:10:53,201   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2021-09-14T23:10:53,202   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2021-09-14T23:10:53,203   adding 'deepspeed/ops/csrc/includes/gelu.h'
2021-09-14T23:10:53,205   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2021-09-14T23:10:53,206   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2021-09-14T23:10:53,208   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2021-09-14T23:10:53,209   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2021-09-14T23:10:53,211   adding 'deepspeed/ops/csrc/includes/softmax.h'
2021-09-14T23:10:53,212   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2021-09-14T23:10:53,214   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2021-09-14T23:10:53,216   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2021-09-14T23:10:53,218   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2021-09-14T23:10:53,220   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2021-09-14T23:10:53,223   adding 'deepspeed/ops/csrc/quantization/quantizer.cu'
2021-09-14T23:10:53,226   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2021-09-14T23:10:53,228   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2021-09-14T23:10:53,231   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2021-09-14T23:10:53,235   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2021-09-14T23:10:53,238   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2021-09-14T23:10:53,240   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2021-09-14T23:10:53,245   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2021-09-14T23:10:53,248   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2021-09-14T23:10:53,251   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2021-09-14T23:10:53,254   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2021-09-14T23:10:53,255   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2021-09-14T23:10:53,257   adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu'
2021-09-14T23:10:53,259   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2021-09-14T23:10:53,262   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2021-09-14T23:10:53,264   adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h'
2021-09-14T23:10:53,265   adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h'
2021-09-14T23:10:53,267   adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h'
2021-09-14T23:10:53,268   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2021-09-14T23:10:53,270   adding 'deepspeed/ops/lamb/__init__.py'
2021-09-14T23:10:53,272   adding 'deepspeed/ops/lamb/fused_lamb.py'
2021-09-14T23:10:53,274   adding 'deepspeed/ops/op_builder/__init__.py'
2021-09-14T23:10:53,275   adding 'deepspeed/ops/op_builder/async_io.py'
2021-09-14T23:10:53,278   adding 'deepspeed/ops/op_builder/builder.py'
2021-09-14T23:10:53,279   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2021-09-14T23:10:53,281   adding 'deepspeed/ops/op_builder/fused_adam.py'
2021-09-14T23:10:53,282   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2021-09-14T23:10:53,283   adding 'deepspeed/ops/op_builder/quantizer.py'
2021-09-14T23:10:53,284   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2021-09-14T23:10:53,286   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2021-09-14T23:10:53,287   adding 'deepspeed/ops/op_builder/transformer.py'
2021-09-14T23:10:53,288   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2021-09-14T23:10:53,289   adding 'deepspeed/ops/op_builder/utils.py'
2021-09-14T23:10:53,291   adding 'deepspeed/ops/quantizer/__init__.py'
2021-09-14T23:10:53,292   adding 'deepspeed/ops/quantizer/quantizer.py'
2021-09-14T23:10:53,294   adding 'deepspeed/ops/sparse_attention/__init__.py'
2021-09-14T23:10:53,295   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2021-09-14T23:10:53,298   adding 'deepspeed/ops/sparse_attention/matmul.py'
2021-09-14T23:10:53,301   adding 'deepspeed/ops/sparse_attention/softmax.py'
2021-09-14T23:10:53,303   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2021-09-14T23:10:53,305   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2021-09-14T23:10:53,308   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2021-09-14T23:10:53,310   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2021-09-14T23:10:53,312   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2021-09-14T23:10:53,313   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2021-09-14T23:10:53,315   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2021-09-14T23:10:53,316   adding 'deepspeed/ops/transformer/__init__.py'
2021-09-14T23:10:53,319   adding 'deepspeed/ops/transformer/transformer.py'
2021-09-14T23:10:53,321   adding 'deepspeed/ops/transformer/inference/__init__.py'
2021-09-14T23:10:53,324   adding 'deepspeed/ops/transformer/inference/transformer_inference.py'
2021-09-14T23:10:53,326   adding 'deepspeed/pipe/__init__.py'
2021-09-14T23:10:53,327   adding 'deepspeed/profiling/__init__.py'
2021-09-14T23:10:53,328   adding 'deepspeed/profiling/config.py'
2021-09-14T23:10:53,330   adding 'deepspeed/profiling/constants.py'
2021-09-14T23:10:53,331   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2021-09-14T23:10:53,336   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2021-09-14T23:10:53,338   adding 'deepspeed/runtime/__init__.py'
2021-09-14T23:10:53,342   adding 'deepspeed/runtime/config.py'
2021-09-14T23:10:53,343   adding 'deepspeed/runtime/config_utils.py'
2021-09-14T23:10:53,345   adding 'deepspeed/runtime/constants.py'
2021-09-14T23:10:53,346   adding 'deepspeed/runtime/csr_tensor.py'
2021-09-14T23:10:53,348   adding 'deepspeed/runtime/dataloader.py'
2021-09-14T23:10:53,350   adding 'deepspeed/runtime/eigenvalue.py'
2021-09-14T23:10:53,362   adding 'deepspeed/runtime/engine.py'
2021-09-14T23:10:53,367   adding 'deepspeed/runtime/lr_schedules.py'
2021-09-14T23:10:53,368   adding 'deepspeed/runtime/progressive_layer_drop.py'
2021-09-14T23:10:53,370   adding 'deepspeed/runtime/quantize.py'
2021-09-14T23:10:53,372   adding 'deepspeed/runtime/state_dict_factory.py'
2021-09-14T23:10:53,376   adding 'deepspeed/runtime/utils.py'
2021-09-14T23:10:53,378   adding 'deepspeed/runtime/weight_quantizer.py'
2021-09-14T23:10:53,379   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2021-09-14T23:10:53,384   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2021-09-14T23:10:53,385   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2021-09-14T23:10:53,387   adding 'deepspeed/runtime/comm/__init__.py'
2021-09-14T23:10:53,388   adding 'deepspeed/runtime/comm/mpi.py'
2021-09-14T23:10:53,390   adding 'deepspeed/runtime/comm/nccl.py'
2021-09-14T23:10:53,392   adding 'deepspeed/runtime/compression/__init__.py'
2021-09-14T23:10:53,393   adding 'deepspeed/runtime/compression/cupy.py'
2021-09-14T23:10:53,394   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2021-09-14T23:10:53,396   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2021-09-14T23:10:53,398   adding 'deepspeed/runtime/fp16/__init__.py'
2021-09-14T23:10:53,400   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2021-09-14T23:10:53,402   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2021-09-14T23:10:53,405   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2021-09-14T23:10:53,407   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2021-09-14T23:10:53,409   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2021-09-14T23:10:53,412   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2021-09-14T23:10:53,414   adding 'deepspeed/runtime/pipe/__init__.py'
2021-09-14T23:10:53,420   adding 'deepspeed/runtime/pipe/engine.py'
2021-09-14T23:10:53,424   adding 'deepspeed/runtime/pipe/module.py'
2021-09-14T23:10:53,426   adding 'deepspeed/runtime/pipe/p2p.py'
2021-09-14T23:10:53,428   adding 'deepspeed/runtime/pipe/schedule.py'
2021-09-14T23:10:53,430   adding 'deepspeed/runtime/pipe/topology.py'
2021-09-14T23:10:53,432   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2021-09-14T23:10:53,433   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2021-09-14T23:10:53,435   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2021-09-14T23:10:53,436   adding 'deepspeed/runtime/swap_tensor/constants.py'
2021-09-14T23:10:53,439   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2021-09-14T23:10:53,441   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2021-09-14T23:10:53,443   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2021-09-14T23:10:53,445   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2021-09-14T23:10:53,447   adding 'deepspeed/runtime/swap_tensor/utils.py'
2021-09-14T23:10:53,449   adding 'deepspeed/runtime/zero/__init__.py'
2021-09-14T23:10:53,450   adding 'deepspeed/runtime/zero/config.py'
2021-09-14T23:10:53,452   adding 'deepspeed/runtime/zero/constants.py'
2021-09-14T23:10:53,454   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2021-09-14T23:10:53,455   adding 'deepspeed/runtime/zero/linear.py'
2021-09-14T23:10:53,457   adding 'deepspeed/runtime/zero/offload_config.py'
2021-09-14T23:10:53,458   adding 'deepspeed/runtime/zero/offload_constants.py'
2021-09-14T23:10:53,464   adding 'deepspeed/runtime/zero/partition_parameters.py'
2021-09-14T23:10:53,470   adding 'deepspeed/runtime/zero/stage1.py'
2021-09-14T23:10:53,483   adding 'deepspeed/runtime/zero/stage2.py'
2021-09-14T23:10:53,501   adding 'deepspeed/runtime/zero/stage3.py'
2021-09-14T23:10:53,503   adding 'deepspeed/runtime/zero/test.py'
2021-09-14T23:10:53,505   adding 'deepspeed/runtime/zero/tiling.py'
2021-09-14T23:10:53,506   adding 'deepspeed/runtime/zero/utils.py'
2021-09-14T23:10:53,508   adding 'deepspeed/utils/__init__.py'
2021-09-14T23:10:53,509   adding 'deepspeed/utils/debug.py'
2021-09-14T23:10:53,510   adding 'deepspeed/utils/distributed.py'
2021-09-14T23:10:53,512   adding 'deepspeed/utils/groups.py'
2021-09-14T23:10:53,514   adding 'deepspeed/utils/logging.py'
2021-09-14T23:10:53,515   adding 'deepspeed/utils/timer.py'
2021-09-14T23:10:53,517   adding 'deepspeed/utils/zero_to_fp32.py'
2021-09-14T23:10:53,520   adding 'deepspeed-0.5.2.data/scripts/deepspeed'
2021-09-14T23:10:53,521   adding 'deepspeed-0.5.2.data/scripts/deepspeed.pt'
2021-09-14T23:10:53,522   adding 'deepspeed-0.5.2.data/scripts/ds'
2021-09-14T23:10:53,523   adding 'deepspeed-0.5.2.data/scripts/ds_elastic'
2021-09-14T23:10:53,524   adding 'deepspeed-0.5.2.data/scripts/ds_report'
2021-09-14T23:10:53,525   adding 'deepspeed-0.5.2.data/scripts/ds_ssh'
2021-09-14T23:10:53,528   adding 'op_builder/__init__.py'
2021-09-14T23:10:53,529   adding 'op_builder/async_io.py'
2021-09-14T23:10:53,532   adding 'op_builder/builder.py'
2021-09-14T23:10:53,534   adding 'op_builder/cpu_adam.py'
2021-09-14T23:10:53,535   adding 'op_builder/fused_adam.py'
2021-09-14T23:10:53,536   adding 'op_builder/fused_lamb.py'
2021-09-14T23:10:53,537   adding 'op_builder/quantizer.py'
2021-09-14T23:10:53,538   adding 'op_builder/sparse_attn.py'
2021-09-14T23:10:53,539   adding 'op_builder/stochastic_transformer.py'
2021-09-14T23:10:53,541   adding 'op_builder/transformer.py'
2021-09-14T23:10:53,542   adding 'op_builder/transformer_inference.py'
2021-09-14T23:10:53,543   adding 'op_builder/utils.py'
2021-09-14T23:10:53,544   adding 'deepspeed-0.5.2.dist-info/LICENSE'
2021-09-14T23:10:53,547   adding 'deepspeed-0.5.2.dist-info/METADATA'
2021-09-14T23:10:53,548   adding 'deepspeed-0.5.2.dist-info/WHEEL'
2021-09-14T23:10:53,548   adding 'deepspeed-0.5.2.dist-info/entry_points.txt'
2021-09-14T23:10:53,549   adding 'deepspeed-0.5.2.dist-info/top_level.txt'
2021-09-14T23:10:53,552   adding 'deepspeed-0.5.2.dist-info/RECORD'
2021-09-14T23:10:53,563   removing build/bdist.linux-armv7l/wheel
2021-09-14T23:10:53,643   deepspeed build time = 3.575214147567749 secs
2021-09-14T23:10:53,719   Building wheel for deepspeed (setup.py): finished with status 'done'
2021-09-14T23:10:53,726   Created wheel for deepspeed: filename=deepspeed-0.5.2-py3-none-any.whl size=479845 sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06
2021-09-14T23:10:53,726   Stored in directory: /tmp/pip-ephem-wheel-cache-lek4127q/wheels/fe/57/72/d7669268042846842d93c36e1447bc7cd8603f77bbbd8ee62b
2021-09-14T23:10:53,744 Successfully built deepspeed
2021-09-14T23:10:53,762 Removed build tracker: '/tmp/pip-req-tracker-ph965e56'