2022-09-19T16:52:51,767 Created temporary directory: /tmp/pip-ephem-wheel-cache-tko1fgtg 2022-09-19T16:52:51,773 Created temporary directory: /tmp/pip-build-tracker-l4r9gjfa 2022-09-19T16:52:51,774 Initialized build tracking at /tmp/pip-build-tracker-l4r9gjfa 2022-09-19T16:52:51,774 Created build tracker: /tmp/pip-build-tracker-l4r9gjfa 2022-09-19T16:52:51,774 Entered build tracker: /tmp/pip-build-tracker-l4r9gjfa 2022-09-19T16:52:51,776 Created temporary directory: /tmp/pip-wheel-d72ysxr0 2022-09-19T16:52:51,842 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-09-19T16:52:51,850 2 location(s) to search for versions of deepspeed: 2022-09-19T16:52:51,850 * https://pypi.org/simple/deepspeed/ 2022-09-19T16:52:51,850 * https://www.piwheels.org/simple/deepspeed/ 2022-09-19T16:52:51,851 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2022-09-19T16:52:51,853 Getting page https://pypi.org/simple/deepspeed/ 2022-09-19T16:52:51,856 Found index url https://pypi.org/simple 2022-09-19T16:52:52,079 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2022-09-19T16:52:52,080 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2022-09-19T16:52:52,081 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2022-09-19T16:52:52,081 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2022-09-19T16:52:52,082 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2022-09-19T16:52:52,083 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2022-09-19T16:52:52,084 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2022-09-19T16:52:52,084 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2022-09-19T16:52:52,085 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2022-09-19T16:52:52,085 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2022-09-19T16:52:52,086 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2022-09-19T16:52:52,087 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2022-09-19T16:52:52,088 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2022-09-19T16:52:52,089 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2022-09-19T16:52:52,089 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2022-09-19T16:52:52,090 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2022-09-19T16:52:52,091 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2022-09-19T16:52:52,092 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2022-09-19T16:52:52,092 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2022-09-19T16:52:52,093 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2022-09-19T16:52:52,094 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2022-09-19T16:52:52,094 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2022-09-19T16:52:52,095 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2022-09-19T16:52:52,096 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2022-09-19T16:52:52,097 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2022-09-19T16:52:52,097 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2022-09-19T16:52:52,098 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2022-09-19T16:52:52,099 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2022-09-19T16:52:52,100 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2022-09-19T16:52:52,100 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2022-09-19T16:52:52,101 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2022-09-19T16:52:52,102 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2022-09-19T16:52:52,102 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2022-09-19T16:52:52,103 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2022-09-19T16:52:52,104 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2022-09-19T16:52:52,105 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2022-09-19T16:52:52,105 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2022-09-19T16:52:52,106 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2022-09-19T16:52:52,107 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz#sha256=f8c083db2bd1594b928458ac4cef5e8f1599e7b764d475d61a3d5aa94563a287 (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2022-09-19T16:52:52,107 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2022-09-19T16:52:52,109 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz#sha256=03fc7c89b00cfb8abad2af98c662f22032bb9550813908548dbd47499be75a06 (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2022-09-19T16:52:52,109 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz#sha256=5db284052e17f937500b1700ce93aec1bde4527ad2f9acb0b85e9db979e438c1 (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2022-09-19T16:52:52,110 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz#sha256=f078ddd22e14925e147509baae702727ea38c1c2e878c72583f0891c5abf956f (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2022-09-19T16:52:52,111 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2022-09-19T16:52:52,112 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090 (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2022-09-19T16:52:52,112 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz#sha256=871623ee95b2655595195b99a59f1eb3cf2eeb395fb3418d824eb62a350f7b83 (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2022-09-19T16:52:52,113 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz#sha256=98502df63dc53332cde601d644b29f2cf0234ea9d4d21c65b0d1d6db892e5fe1 (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2022-09-19T16:52:52,114 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz#sha256=b3143b593f1b63c067aaaebd120e9d97915effbf4bf4f593840546cec2514ff1 (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2022-09-19T16:52:52,114 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz#sha256=eb5ed5a12ad8a1388ad15358204f05d833ade1e9af0530e6e6aa613bead67a49 (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2022-09-19T16:52:52,115 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz#sha256=ad2de46d6609798fa3525ef8eb0e1ddfb66e06983b0af967b462b1511f21cc9c (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2022-09-19T16:52:52,116 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz#sha256=97bf7b8966f264de38508057af28c768bccaba7aecd5778d5cf5f2bc97d36957 (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2022-09-19T16:52:52,117 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz#sha256=14ffd0c5a9d20d6535fe650c15e0bdd1265890df7ae6dbbd202311c9caa7a47c (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2022-09-19T16:52:52,117 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz#sha256=85824e1901b02bf0ebf5902c17e2dad2377f50904a4927f59308f73230c162f4 (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2022-09-19T16:52:52,118 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz#sha256=0ee39e1b01fe4ecbd89e7c4358db6327cee6fe52a201157999e1c995985453a4 (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2022-09-19T16:52:52,119 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz#sha256=630923825a38d10096e3eb53bafc62f7ec20b6b95e6dbdd4dc2eec26b1be42ae (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2022-09-19T16:52:52,120 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz#sha256=862b2e5261ecd38fc8a110fd26b76bb223470fabac6a682af73bb54b5624c231 (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2022-09-19T16:52:52,120 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz#sha256=871399d1430022c31da3f3eac6ba603182b99feae6607c27b7a81a36c31e846d (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2022-09-19T16:52:52,121 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2022-09-19T16:52:52,122 Getting page https://www.piwheels.org/simple/deepspeed/ 2022-09-19T16:52:52,124 Found index url https://www.piwheels.org/simple 2022-09-19T16:52:52,356 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,357 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,358 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,358 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,359 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,359 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,360 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,361 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,361 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,362 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,362 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,363 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,363 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,364 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,364 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,365 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,366 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,366 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,367 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,367 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,368 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,368 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,369 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,369 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,370 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,370 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,371 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2022-09-19T16:52:52,372 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2022-09-19T16:52:52,372 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2022-09-19T16:52:52,424 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2022-09-19T16:52:52,457 Collecting deepspeed==0.7.3 2022-09-19T16:52:52,462 Created temporary directory: /tmp/pip-unpack-xvqh71yf 2022-09-19T16:52:52,709 Downloading deepspeed-0.7.3.tar.gz (717 kB) 2022-09-19T16:52:55,202 Added deepspeed==0.7.3 from https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz#sha256=871399d1430022c31da3f3eac6ba603182b99feae6607c27b7a81a36c31e846d to build tracker '/tmp/pip-build-tracker-l4r9gjfa' 2022-09-19T16:52:55,205 Running setup.py (path:/tmp/pip-wheel-d72ysxr0/deepspeed_2342b224618c4e799674cc6232bcf770/setup.py) egg_info for package deepspeed 2022-09-19T16:52:55,207 Created temporary directory: /tmp/pip-pip-egg-info-gm9e_6a8 2022-09-19T16:52:55,207 Preparing metadata (setup.py): started 2022-09-19T16:52:55,209 Running command python setup.py egg_info 2022-09-19T16:52:58,492 fatal: not a git repository (or any of the parent directories): .git 2022-09-19T16:53:04,654 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-09-19T16:53:04,655  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-09-19T16:53:04,655 DS_BUILD_OPS=0 2022-09-19T16:53:04,656  [WARNING]  unable to import torch, please install it first 2022-09-19T16:53:04,656  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-09-19T16:53:04,656  [WARNING]  async_io: please install the libaio-dev package with apt 2022-09-19T16:53:04,657  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-09-19T16:53:04,657  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-09-19T16:53:04,657 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-09-19T16:53:04,658 version=0.7.3, git_hash=unknown, git_branch=unknown 2022-09-19T16:53:04,658 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-09-19T16:53:04,659 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-09-19T16:53:04,659 ext_modules=[] 2022-09-19T16:53:04,659 running egg_info 2022-09-19T16:53:04,660 creating /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info 2022-09-19T16:53:05,384 writing /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/PKG-INFO 2022-09-19T16:53:05,997 writing dependency_links to /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/dependency_links.txt 2022-09-19T16:53:07,816 writing entry points to /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/entry_points.txt 2022-09-19T16:53:09,029 writing requirements to /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/requires.txt 2022-09-19T16:53:09,637 writing top-level names to /tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/top_level.txt 2022-09-19T16:53:09,641 writing manifest file '/tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/SOURCES.txt' 2022-09-19T16:53:10,909 reading manifest file '/tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/SOURCES.txt' 2022-09-19T16:53:10,912 reading manifest template 'MANIFEST.in' 2022-09-19T16:53:11,945 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-09-19T16:53:12,688 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-09-19T16:53:13,199 warning: no files found matching '*.tr' under directory 'csrc' 2022-09-19T16:53:13,325 warning: no files found matching '*.cc' under directory 'csrc' 2022-09-19T16:53:13,362 adding license file 'LICENSE' 2022-09-19T16:53:13,400 writing manifest file '/tmp/pip-pip-egg-info-gm9e_6a8/deepspeed.egg-info/SOURCES.txt' 2022-09-19T16:53:13,404 deepspeed build time = 14.90184760093689 secs 2022-09-19T16:53:13,637 Preparing metadata (setup.py): finished with status 'done' 2022-09-19T16:53:13,652 Source in /tmp/pip-wheel-d72ysxr0/deepspeed_2342b224618c4e799674cc6232bcf770 has version 0.7.3, which satisfies requirement deepspeed==0.7.3 from https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz#sha256=871399d1430022c31da3f3eac6ba603182b99feae6607c27b7a81a36c31e846d 2022-09-19T16:53:13,654 Removed deepspeed==0.7.3 from https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz#sha256=871399d1430022c31da3f3eac6ba603182b99feae6607c27b7a81a36c31e846d from build tracker '/tmp/pip-build-tracker-l4r9gjfa' 2022-09-19T16:53:13,666 Created temporary directory: /tmp/pip-unpack-bsf2tak7 2022-09-19T16:53:13,667 Building wheels for collected packages: deepspeed 2022-09-19T16:53:13,677 Created temporary directory: /tmp/pip-wheel-a8s51rvo 2022-09-19T16:53:13,678 Building wheel for deepspeed (setup.py): started 2022-09-19T16:53:13,680 Destination directory: /tmp/pip-wheel-a8s51rvo 2022-09-19T16:53:13,681 Running command python setup.py bdist_wheel 2022-09-19T16:53:16,254 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-09-19T16:53:16,272  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-09-19T16:53:16,316 DS_BUILD_OPS=0 2022-09-19T16:53:16,319  [WARNING]  unable to import torch, please install it first 2022-09-19T16:53:16,622  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-09-19T16:53:16,787  [WARNING]  async_io: please install the libaio-dev package with apt 2022-09-19T16:53:16,788  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-09-19T16:53:16,792  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-09-19T16:53:16,792 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-09-19T16:53:16,834 fatal: not a git repository (or any of the parent directories): .git 2022-09-19T16:53:16,840 version=0.7.3, git_hash=unknown, git_branch=unknown 2022-09-19T16:53:16,842 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-09-19T16:53:16,843 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-09-19T16:53:16,843 ext_modules=[] 2022-09-19T16:53:22,394 running bdist_wheel 2022-09-19T16:53:22,770 running build 2022-09-19T16:53:22,771 running build_py 2022-09-19T16:53:23,494 creating build 2022-09-19T16:53:23,495 creating build/lib 2022-09-19T16:53:23,496 creating build/lib/benchmarks 2022-09-19T16:53:23,498 copying benchmarks/__init__.py -> build/lib/benchmarks 2022-09-19T16:53:23,503 creating build/lib/deepspeed 2022-09-19T16:53:23,505 copying deepspeed/__init__.py -> build/lib/deepspeed 2022-09-19T16:53:23,510 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2022-09-19T16:53:23,513 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2022-09-19T16:53:23,516 copying deepspeed/constants.py -> build/lib/deepspeed 2022-09-19T16:53:23,520 copying deepspeed/env_report.py -> build/lib/deepspeed 2022-09-19T16:53:23,526 creating build/lib/benchmarks/communication 2022-09-19T16:53:23,527 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,531 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,534 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,538 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,543 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,546 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,550 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,554 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,558 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2022-09-19T16:53:23,564 creating build/lib/deepspeed/runtime 2022-09-19T16:53:23,566 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,570 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,574 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,578 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,582 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,587 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,594 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,600 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,604 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,608 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,615 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,619 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,622 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,634 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,639 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2022-09-19T16:53:23,644 creating build/lib/deepspeed/compression 2022-09-19T16:53:23,646 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,650 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,653 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,658 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,662 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,666 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,673 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,677 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2022-09-19T16:53:23,684 creating build/lib/deepspeed/moe 2022-09-19T16:53:23,686 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,689 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,692 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,696 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,699 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,704 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2022-09-19T16:53:23,710 creating build/lib/deepspeed/elasticity 2022-09-19T16:53:23,711 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,715 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,720 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,724 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,727 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,730 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2022-09-19T16:53:23,735 creating build/lib/deepspeed/launcher 2022-09-19T16:53:23,737 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2022-09-19T16:53:23,740 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2022-09-19T16:53:23,745 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2022-09-19T16:53:23,748 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2022-09-19T16:53:23,753 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2022-09-19T16:53:23,759 creating build/lib/deepspeed/pipe 2022-09-19T16:53:23,760 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2022-09-19T16:53:23,765 creating build/lib/deepspeed/ops 2022-09-19T16:53:23,767 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2022-09-19T16:53:23,771 creating build/lib/deepspeed/profiling 2022-09-19T16:53:23,773 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2022-09-19T16:53:23,776 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2022-09-19T16:53:23,779 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2022-09-19T16:53:23,783 creating build/lib/deepspeed/inference 2022-09-19T16:53:23,785 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2022-09-19T16:53:23,788 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2022-09-19T16:53:23,796 creating build/lib/deepspeed/monitor 2022-09-19T16:53:23,797 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,801 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,803 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,807 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,811 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,814 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,817 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,820 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2022-09-19T16:53:23,826 creating build/lib/deepspeed/utils 2022-09-19T16:53:23,828 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,832 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,835 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,840 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,843 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,847 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,851 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,854 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,858 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,862 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,866 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,870 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,873 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2022-09-19T16:53:23,878 creating build/lib/deepspeed/module_inject 2022-09-19T16:53:23,879 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,884 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,888 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,891 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,896 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,900 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,907 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2022-09-19T16:53:23,912 creating build/lib/deepspeed/autotuning 2022-09-19T16:53:23,914 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,919 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,922 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,930 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,934 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,939 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2022-09-19T16:53:23,944 creating build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,946 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,949 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,954 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,958 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,961 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,964 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,967 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,972 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,976 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2022-09-19T16:53:23,981 creating build/lib/deepspeed/nebula 2022-09-19T16:53:23,982 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2022-09-19T16:53:23,985 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2022-09-19T16:53:23,988 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2022-09-19T16:53:23,993 creating build/lib/deepspeed/comm 2022-09-19T16:53:23,994 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2022-09-19T16:53:23,998 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,002 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,008 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,011 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,014 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,018 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2022-09-19T16:53:24,023 creating build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,024 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,028 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,033 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,037 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,041 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,044 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,049 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,052 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,056 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-09-19T16:53:24,063 creating build/lib/deepspeed/runtime/compression 2022-09-19T16:53:24,064 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2022-09-19T16:53:24,067 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2022-09-19T16:53:24,071 creating build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,073 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,076 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,080 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,086 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,090 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,095 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2022-09-19T16:53:24,103 creating build/lib/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:24,105 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:24,108 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:24,110 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:24,114 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:24,119 creating build/lib/deepspeed/runtime/fp16 2022-09-19T16:53:24,120 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2022-09-19T16:53:24,123 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-09-19T16:53:24,128 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-09-19T16:53:24,133 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2022-09-19T16:53:24,138 creating build/lib/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:24,139 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:24,142 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:24,148 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:24,152 creating build/lib/deepspeed/runtime/comm 2022-09-19T16:53:24,154 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2022-09-19T16:53:24,159 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2022-09-19T16:53:24,161 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2022-09-19T16:53:24,164 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2022-09-19T16:53:24,169 creating build/lib/deepspeed/runtime/data_pipeline 2022-09-19T16:53:24,171 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2022-09-19T16:53:24,173 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2022-09-19T16:53:24,180 creating build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,181 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,185 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,188 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,193 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,201 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,206 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,210 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,220 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,224 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,228 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,231 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,241 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,245 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2022-09-19T16:53:24,249 creating build/lib/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:24,250 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:24,253 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:24,257 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:24,263 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:24,268 creating build/lib/deepspeed/ops/lamb 2022-09-19T16:53:24,270 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2022-09-19T16:53:24,273 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2022-09-19T16:53:24,279 creating build/lib/deepspeed/ops/adam 2022-09-19T16:53:24,281 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2022-09-19T16:53:24,284 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2022-09-19T16:53:24,288 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2022-09-19T16:53:24,291 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2022-09-19T16:53:24,296 creating build/lib/deepspeed/ops/aio 2022-09-19T16:53:24,297 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2022-09-19T16:53:24,304 creating build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,305 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,309 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,312 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,315 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,318 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,321 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,325 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,328 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,331 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,336 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,340 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,343 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,346 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2022-09-19T16:53:24,350 creating build/lib/deepspeed/ops/quantizer 2022-09-19T16:53:24,352 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2022-09-19T16:53:24,355 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2022-09-19T16:53:24,359 creating build/lib/deepspeed/ops/adagrad 2022-09-19T16:53:24,361 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2022-09-19T16:53:24,364 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2022-09-19T16:53:24,370 creating build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,371 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,376 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,386 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,389 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,394 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,400 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,403 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-09-19T16:53:24,409 creating build/lib/deepspeed/ops/transformer 2022-09-19T16:53:24,410 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2022-09-19T16:53:24,414 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2022-09-19T16:53:24,421 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:24,422 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:24,427 creating build/lib/deepspeed/ops/transformer/inference 2022-09-19T16:53:24,428 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2022-09-19T16:53:24,432 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-09-19T16:53:24,439 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-09-19T16:53:24,445 creating build/lib/deepspeed/profiling/flops_profiler 2022-09-19T16:53:24,447 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2022-09-19T16:53:24,454 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2022-09-19T16:53:24,458 creating build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,460 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,463 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,467 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,470 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,474 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,477 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-09-19T16:53:24,481 running egg_info 2022-09-19T16:53:25,932 writing deepspeed.egg-info/PKG-INFO 2022-09-19T16:53:26,538 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2022-09-19T16:53:28,325 writing entry points to deepspeed.egg-info/entry_points.txt 2022-09-19T16:53:29,518 writing requirements to deepspeed.egg-info/requires.txt 2022-09-19T16:53:30,116 writing top-level names to deepspeed.egg-info/top_level.txt 2022-09-19T16:53:30,318 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-09-19T16:53:30,408 reading manifest template 'MANIFEST.in' 2022-09-19T16:53:31,419 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-09-19T16:53:32,126 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-09-19T16:53:32,630 warning: no files found matching '*.tr' under directory 'csrc' 2022-09-19T16:53:32,752 warning: no files found matching '*.cc' under directory 'csrc' 2022-09-19T16:53:32,786 adding license file 'LICENSE' 2022-09-19T16:53:32,841 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-09-19T16:53:32,847 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,848 ############################ 2022-09-19T16:53:32,848 # Package would be ignored # 2022-09-19T16:53:32,849 ############################ 2022-09-19T16:53:32,849 Python recognizes 'benchmarks.inference' as an importable package, however it is 2022-09-19T16:53:32,849 included in the distribution as "data". 2022-09-19T16:53:32,849 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,850 therefore is considered deprecated). 2022-09-19T16:53:32,850 Please make sure that 'benchmarks.inference' is included as a package by using 2022-09-19T16:53:32,851 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,851 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,852 documentation page. 2022-09-19T16:53:32,852 !! 2022-09-19T16:53:32,853 check.warn(importable) 2022-09-19T16:53:32,854 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,855 ############################ 2022-09-19T16:53:32,855 # Package would be ignored # 2022-09-19T16:53:32,856 ############################ 2022-09-19T16:53:32,856 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, however it is 2022-09-19T16:53:32,856 included in the distribution as "data". 2022-09-19T16:53:32,857 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,857 therefore is considered deprecated). 2022-09-19T16:53:32,857 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2022-09-19T16:53:32,858 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,858 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,859 documentation page. 2022-09-19T16:53:32,860 !! 2022-09-19T16:53:32,860 check.warn(importable) 2022-09-19T16:53:32,861 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,862 ############################ 2022-09-19T16:53:32,862 # Package would be ignored # 2022-09-19T16:53:32,862 ############################ 2022-09-19T16:53:32,862 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, however it is 2022-09-19T16:53:32,863 included in the distribution as "data". 2022-09-19T16:53:32,863 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,863 therefore is considered deprecated). 2022-09-19T16:53:32,864 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2022-09-19T16:53:32,864 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,865 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,865 documentation page. 2022-09-19T16:53:32,866 !! 2022-09-19T16:53:32,867 check.warn(importable) 2022-09-19T16:53:32,867 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,868 ############################ 2022-09-19T16:53:32,868 # Package would be ignored # 2022-09-19T16:53:32,868 ############################ 2022-09-19T16:53:32,869 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, however it is 2022-09-19T16:53:32,869 included in the distribution as "data". 2022-09-19T16:53:32,869 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,870 therefore is considered deprecated). 2022-09-19T16:53:32,870 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2022-09-19T16:53:32,870 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,871 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,871 documentation page. 2022-09-19T16:53:32,872 !! 2022-09-19T16:53:32,873 check.warn(importable) 2022-09-19T16:53:32,873 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,874 ############################ 2022-09-19T16:53:32,874 # Package would be ignored # 2022-09-19T16:53:32,874 ############################ 2022-09-19T16:53:32,875 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, however it is 2022-09-19T16:53:32,875 included in the distribution as "data". 2022-09-19T16:53:32,875 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,876 therefore is considered deprecated). 2022-09-19T16:53:32,876 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2022-09-19T16:53:32,877 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,877 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,878 documentation page. 2022-09-19T16:53:32,879 !! 2022-09-19T16:53:32,879 check.warn(importable) 2022-09-19T16:53:32,879 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,880 ############################ 2022-09-19T16:53:32,881 # Package would be ignored # 2022-09-19T16:53:32,881 ############################ 2022-09-19T16:53:32,881 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, however it is 2022-09-19T16:53:32,881 included in the distribution as "data". 2022-09-19T16:53:32,882 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,882 therefore is considered deprecated). 2022-09-19T16:53:32,883 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2022-09-19T16:53:32,883 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,884 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,884 documentation page. 2022-09-19T16:53:32,885 !! 2022-09-19T16:53:32,885 check.warn(importable) 2022-09-19T16:53:32,886 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,887 ############################ 2022-09-19T16:53:32,887 # Package would be ignored # 2022-09-19T16:53:32,887 ############################ 2022-09-19T16:53:32,887 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, however it is 2022-09-19T16:53:32,888 included in the distribution as "data". 2022-09-19T16:53:32,888 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,888 therefore is considered deprecated). 2022-09-19T16:53:32,889 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2022-09-19T16:53:32,889 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,890 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,890 documentation page. 2022-09-19T16:53:32,891 !! 2022-09-19T16:53:32,892 check.warn(importable) 2022-09-19T16:53:32,892 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,893 ############################ 2022-09-19T16:53:32,893 # Package would be ignored # 2022-09-19T16:53:32,893 ############################ 2022-09-19T16:53:32,894 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, however it is 2022-09-19T16:53:32,894 included in the distribution as "data". 2022-09-19T16:53:32,894 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,894 therefore is considered deprecated). 2022-09-19T16:53:32,895 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2022-09-19T16:53:32,895 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,896 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,896 documentation page. 2022-09-19T16:53:32,897 !! 2022-09-19T16:53:32,898 check.warn(importable) 2022-09-19T16:53:32,898 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,899 ############################ 2022-09-19T16:53:32,899 # Package would be ignored # 2022-09-19T16:53:32,899 ############################ 2022-09-19T16:53:32,900 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, however it is 2022-09-19T16:53:32,900 included in the distribution as "data". 2022-09-19T16:53:32,900 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,901 therefore is considered deprecated). 2022-09-19T16:53:32,901 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2022-09-19T16:53:32,901 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,902 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,902 documentation page. 2022-09-19T16:53:32,903 !! 2022-09-19T16:53:32,904 check.warn(importable) 2022-09-19T16:53:32,904 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,905 ############################ 2022-09-19T16:53:32,906 # Package would be ignored # 2022-09-19T16:53:32,906 ############################ 2022-09-19T16:53:32,906 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, however it is 2022-09-19T16:53:32,907 included in the distribution as "data". 2022-09-19T16:53:32,907 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,907 therefore is considered deprecated). 2022-09-19T16:53:32,908 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2022-09-19T16:53:32,908 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,909 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,909 documentation page. 2022-09-19T16:53:32,910 !! 2022-09-19T16:53:32,911 check.warn(importable) 2022-09-19T16:53:32,911 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,912 ############################ 2022-09-19T16:53:32,912 # Package would be ignored # 2022-09-19T16:53:32,913 ############################ 2022-09-19T16:53:32,913 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, however it is 2022-09-19T16:53:32,913 included in the distribution as "data". 2022-09-19T16:53:32,914 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,914 therefore is considered deprecated). 2022-09-19T16:53:32,915 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2022-09-19T16:53:32,915 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,916 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,916 documentation page. 2022-09-19T16:53:32,917 !! 2022-09-19T16:53:32,917 check.warn(importable) 2022-09-19T16:53:32,918 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,919 ############################ 2022-09-19T16:53:32,919 # Package would be ignored # 2022-09-19T16:53:32,920 ############################ 2022-09-19T16:53:32,920 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, however it is 2022-09-19T16:53:32,920 included in the distribution as "data". 2022-09-19T16:53:32,920 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,921 therefore is considered deprecated). 2022-09-19T16:53:32,921 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2022-09-19T16:53:32,922 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,922 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,923 documentation page. 2022-09-19T16:53:32,924 !! 2022-09-19T16:53:32,924 check.warn(importable) 2022-09-19T16:53:32,925 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,926 ############################ 2022-09-19T16:53:32,926 # Package would be ignored # 2022-09-19T16:53:32,926 ############################ 2022-09-19T16:53:32,927 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, however it is 2022-09-19T16:53:32,927 included in the distribution as "data". 2022-09-19T16:53:32,928 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,928 therefore is considered deprecated). 2022-09-19T16:53:32,929 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2022-09-19T16:53:32,929 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,930 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,930 documentation page. 2022-09-19T16:53:32,931 !! 2022-09-19T16:53:32,932 check.warn(importable) 2022-09-19T16:53:32,932 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,933 ############################ 2022-09-19T16:53:32,933 # Package would be ignored # 2022-09-19T16:53:32,934 ############################ 2022-09-19T16:53:32,934 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, however it is 2022-09-19T16:53:32,934 included in the distribution as "data". 2022-09-19T16:53:32,935 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,935 therefore is considered deprecated). 2022-09-19T16:53:32,936 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2022-09-19T16:53:32,936 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,937 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,938 documentation page. 2022-09-19T16:53:32,939 !! 2022-09-19T16:53:32,939 check.warn(importable) 2022-09-19T16:53:32,940 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,940 ############################ 2022-09-19T16:53:32,941 # Package would be ignored # 2022-09-19T16:53:32,941 ############################ 2022-09-19T16:53:32,942 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, however it is 2022-09-19T16:53:32,943 included in the distribution as "data". 2022-09-19T16:53:32,943 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,943 therefore is considered deprecated). 2022-09-19T16:53:32,944 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2022-09-19T16:53:32,944 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,945 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,945 documentation page. 2022-09-19T16:53:32,946 !! 2022-09-19T16:53:32,947 check.warn(importable) 2022-09-19T16:53:32,947 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-09-19T16:53:32,948 ############################ 2022-09-19T16:53:32,948 # Package would be ignored # 2022-09-19T16:53:32,949 ############################ 2022-09-19T16:53:32,949 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, however it is 2022-09-19T16:53:32,949 included in the distribution as "data". 2022-09-19T16:53:32,951 This behavior is likely to change in future versions of setuptools (and 2022-09-19T16:53:32,951 therefore is considered deprecated). 2022-09-19T16:53:32,952 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2022-09-19T16:53:32,952 setuptools' `packages` configuration field or the proper discovery methods. 2022-09-19T16:53:32,953 You can read more about "package discovery" and "data files" on setuptools 2022-09-19T16:53:32,953 documentation page. 2022-09-19T16:53:32,954 !! 2022-09-19T16:53:32,955 check.warn(importable) 2022-09-19T16:53:32,955 creating build/lib/benchmarks/inference 2022-09-19T16:53:32,956 copying benchmarks/inference/collect_results.py -> build/lib/benchmarks/inference 2022-09-19T16:53:32,956 copying benchmarks/inference/gpt-bench.py -> build/lib/benchmarks/inference 2022-09-19T16:53:32,956 creating build/lib/deepspeed/ops/csrc 2022-09-19T16:53:32,957 creating build/lib/deepspeed/ops/csrc/adagrad 2022-09-19T16:53:32,957 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2022-09-19T16:53:32,957 creating build/lib/deepspeed/ops/csrc/adam 2022-09-19T16:53:32,958 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-09-19T16:53:32,958 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-09-19T16:53:32,959 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2022-09-19T16:53:32,959 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2022-09-19T16:53:32,960 creating build/lib/deepspeed/ops/csrc/aio 2022-09-19T16:53:32,960 creating build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,960 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,961 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,961 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,962 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,966 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,971 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:32,975 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,977 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,981 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,985 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,990 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,994 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:32,999 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:33,004 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:33,008 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:33,012 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:33,016 creating build/lib/deepspeed/ops/csrc/aio/py_test 2022-09-19T16:53:33,018 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2022-09-19T16:53:33,023 creating build/lib/deepspeed/ops/csrc/common 2022-09-19T16:53:33,024 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2022-09-19T16:53:33,028 creating build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,030 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,034 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,038 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,042 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,047 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,052 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,056 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,060 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,065 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,069 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,074 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,078 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,082 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,087 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,091 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,097 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,102 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,105 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,110 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,114 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,119 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2022-09-19T16:53:33,123 creating build/lib/deepspeed/ops/csrc/lamb 2022-09-19T16:53:33,125 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2022-09-19T16:53:33,130 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2022-09-19T16:53:33,135 creating build/lib/deepspeed/ops/csrc/quantization 2022-09-19T16:53:33,136 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2022-09-19T16:53:33,141 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-09-19T16:53:33,148 creating build/lib/deepspeed/ops/csrc/sparse_attention 2022-09-19T16:53:33,149 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2022-09-19T16:53:33,154 creating build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,155 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,161 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,167 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,175 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,180 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,185 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,195 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,201 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-09-19T16:53:33,207 creating build/lib/deepspeed/ops/csrc/transformer/inference 2022-09-19T16:53:33,208 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,210 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,216 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,221 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,227 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,234 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,242 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,246 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,252 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:33,259 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:33,260 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:33,280 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:33,286 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:33,290 creating build/lib/deepspeed/ops/csrc/utils 2022-09-19T16:53:33,292 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2022-09-19T16:53:33,296 creating build/lib/deepspeed/autotuning/config_templates 2022-09-19T16:53:33,298 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2022-09-19T16:53:33,302 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2022-09-19T16:53:33,306 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2022-09-19T16:53:33,310 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2022-09-19T16:53:33,314 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:33,319 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:33,323 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:33,388 running build_scripts 2022-09-19T16:53:33,389 creating build/scripts-3.7 2022-09-19T16:53:33,392 copying and adjusting bin/deepspeed -> build/scripts-3.7 2022-09-19T16:53:33,395 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2022-09-19T16:53:33,398 copying and adjusting bin/ds -> build/scripts-3.7 2022-09-19T16:53:33,401 copying bin/ds_ssh -> build/scripts-3.7 2022-09-19T16:53:33,405 copying and adjusting bin/ds_report -> build/scripts-3.7 2022-09-19T16:53:33,408 copying and adjusting bin/ds_bench -> build/scripts-3.7 2022-09-19T16:53:33,411 copying and adjusting bin/dsr -> build/scripts-3.7 2022-09-19T16:53:33,414 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2022-09-19T16:53:33,416 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2022-09-19T16:53:33,416 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2022-09-19T16:53:33,417 changing mode of build/scripts-3.7/ds from 644 to 755 2022-09-19T16:53:33,417 changing mode of build/scripts-3.7/ds_report from 644 to 755 2022-09-19T16:53:33,418 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2022-09-19T16:53:33,419 changing mode of build/scripts-3.7/dsr from 644 to 755 2022-09-19T16:53:33,419 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2022-09-19T16:53:34,144 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2022-09-19T16:53:34,145 setuptools.SetuptoolsDeprecationWarning, 2022-09-19T16:53:34,869 installing to build/bdist.linux-armv7l/wheel 2022-09-19T16:53:34,869 running install 2022-09-19T16:53:34,932 running install_lib 2022-09-19T16:53:35,710 creating build/bdist.linux-armv7l 2022-09-19T16:53:35,710 creating build/bdist.linux-armv7l/wheel 2022-09-19T16:53:35,714 creating build/bdist.linux-armv7l/wheel/benchmarks 2022-09-19T16:53:35,715 copying build/lib/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks 2022-09-19T16:53:35,721 creating build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-09-19T16:53:35,722 copying build/lib/benchmarks/inference/collect_results.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-09-19T16:53:35,727 copying build/lib/benchmarks/inference/gpt-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-09-19T16:53:35,732 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,734 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,737 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,741 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,745 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,750 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,753 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,757 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,762 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,766 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-09-19T16:53:35,771 creating build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:35,775 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,778 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,780 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,784 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,789 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,794 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,798 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,802 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,807 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,811 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,815 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-09-19T16:53:35,822 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-09-19T16:53:35,823 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-09-19T16:53:35,827 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-09-19T16:53:35,831 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,833 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,836 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,840 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,846 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,851 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,856 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-09-19T16:53:35,864 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,868 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,872 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,876 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:35,878 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:35,882 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:35,884 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:35,889 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-09-19T16:53:35,892 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,896 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,903 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-09-19T16:53:35,905 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-09-19T16:53:35,908 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-09-19T16:53:35,914 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-09-19T16:53:35,921 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:35,922 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:35,925 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:35,931 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:35,937 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-09-19T16:53:35,942 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-09-19T16:53:35,947 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,953 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,958 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,964 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:35,965 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:35,969 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:35,975 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-09-19T16:53:35,979 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,983 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,989 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:35,995 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-09-19T16:53:35,997 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-09-19T16:53:36,003 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-09-19T16:53:36,006 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-09-19T16:53:36,009 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-09-19T16:53:36,014 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:36,019 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-09-19T16:53:36,020 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-09-19T16:53:36,023 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-09-19T16:53:36,028 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:36,043 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:36,052 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,053 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,057 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,060 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,066 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,075 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,081 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,085 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,097 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,101 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,106 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,109 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,120 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,124 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-09-19T16:53:36,128 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-09-19T16:53:36,133 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,134 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,139 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,142 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,147 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,151 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,155 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,162 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,166 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-09-19T16:53:36,173 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,174 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,177 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,182 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,186 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,189 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,194 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-09-19T16:53:36,200 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,202 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,205 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,211 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,215 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,218 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,222 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-09-19T16:53:36,227 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,228 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,231 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,236 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,240 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,244 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-09-19T16:53:36,250 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-09-19T16:53:36,251 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-09-19T16:53:36,255 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:36,260 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-09-19T16:53:36,263 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-09-19T16:53:36,265 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-09-19T16:53:36,269 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-09-19T16:53:36,273 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-09-19T16:53:36,277 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-09-19T16:53:36,279 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-09-19T16:53:36,282 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-09-19T16:53:36,287 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-09-19T16:53:36,290 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-09-19T16:53:36,296 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-09-19T16:53:36,297 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-09-19T16:53:36,303 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,304 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,309 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,312 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,316 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,320 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,323 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,327 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,331 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,334 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,340 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,343 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,347 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,351 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-09-19T16:53:36,355 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-09-19T16:53:36,357 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-09-19T16:53:36,361 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-09-19T16:53:36,365 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-09-19T16:53:36,367 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-09-19T16:53:36,371 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-09-19T16:53:36,377 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,378 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,386 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,393 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,396 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,402 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:36,404 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:36,408 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:36,412 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:36,416 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-09-19T16:53:36,420 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,426 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,430 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-09-19T16:53:36,436 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2022-09-19T16:53:36,439 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-09-19T16:53:36,440 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-09-19T16:53:36,446 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-09-19T16:53:36,450 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-09-19T16:53:36,452 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-09-19T16:53:36,457 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-09-19T16:53:36,460 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-09-19T16:53:36,465 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-09-19T16:53:36,470 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2022-09-19T16:53:36,473 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-09-19T16:53:36,475 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-09-19T16:53:36,480 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,482 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,486 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,491 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,494 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,498 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,501 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-09-19T16:53:36,506 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,508 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,512 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,517 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,521 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,526 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,530 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,534 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,538 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,541 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-09-19T16:53:36,546 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-09-19T16:53:36,548 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-09-19T16:53:36,553 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-09-19T16:53:36,554 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-09-19T16:53:36,558 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-09-19T16:53:36,566 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-09-19T16:53:36,567 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-09-19T16:53:36,572 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-09-19T16:53:36,574 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-09-19T16:53:36,580 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-09-19T16:53:36,582 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-09-19T16:53:36,588 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,589 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,593 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,597 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,602 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,606 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,611 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,615 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,620 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,624 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,627 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,632 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,636 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,640 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,644 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,647 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,652 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,655 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,659 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,663 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,667 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,672 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-09-19T16:53:36,677 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,678 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,684 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,689 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,696 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,703 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2022-09-19T16:53:36,706 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:36,708 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:36,713 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:36,717 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-09-19T16:53:36,723 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,724 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,729 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,737 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,742 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,747 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,753 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,758 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,762 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-09-19T16:53:36,767 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,771 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,781 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,785 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-09-19T16:53:36,792 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-09-19T16:53:36,793 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-09-19T16:53:36,797 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-09-19T16:53:36,803 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-09-19T16:53:36,805 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-09-19T16:53:36,809 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-09-19T16:53:36,816 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-09-19T16:53:36,822 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-09-19T16:53:36,823 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-09-19T16:53:36,828 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-09-19T16:53:36,829 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-09-19T16:53:36,836 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-09-19T16:53:36,840 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-09-19T16:53:36,843 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-09-19T16:53:36,848 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-09-19T16:53:36,850 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-09-19T16:53:36,853 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-09-19T16:53:36,860 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,861 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,865 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,868 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,872 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,875 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,879 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,882 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,886 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-09-19T16:53:36,891 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,893 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,896 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,900 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,904 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,908 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,913 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,916 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,920 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,924 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,928 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,933 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,937 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,940 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-09-19T16:53:36,944 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:36,949 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,951 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,956 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,960 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,964 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,969 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,973 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,981 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-09-19T16:53:36,985 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:36,987 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:36,993 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:36,996 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:37,005 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-09-19T16:53:37,007 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-09-19T16:53:37,011 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-09-19T16:53:37,015 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-09-19T16:53:37,018 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-09-19T16:53:37,023 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,024 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,028 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,033 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,036 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,039 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,042 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-09-19T16:53:37,046 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:37,050 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:37,056 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-09-19T16:53:37,062 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,063 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,067 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,072 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,076 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,079 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,083 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,086 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,090 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,094 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-09-19T16:53:37,098 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:37,101 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:37,105 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-09-19T16:53:37,110 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-09-19T16:53:37,112 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-09-19T16:53:37,115 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-09-19T16:53:37,118 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-09-19T16:53:37,123 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,124 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,128 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,133 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,138 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,142 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,145 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,149 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-09-19T16:53:37,152 running install_egg_info 2022-09-19T16:53:37,884 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.7.3-py3.7.egg-info 2022-09-19T16:53:37,913 running install_scripts 2022-09-19T16:53:38,022 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data 2022-09-19T16:53:38,022 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,025 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,028 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,032 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,035 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,039 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,042 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,046 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,049 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts 2022-09-19T16:53:38,052 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/ds_report to 755 2022-09-19T16:53:38,053 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/ds to 755 2022-09-19T16:53:38,053 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/ds_elastic to 755 2022-09-19T16:53:38,054 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/ds_bench to 755 2022-09-19T16:53:38,054 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/dsr to 755 2022-09-19T16:53:38,054 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/deepspeed to 755 2022-09-19T16:53:38,055 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/ds_ssh to 755 2022-09-19T16:53:38,056 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.data/scripts/deepspeed.pt to 755 2022-09-19T16:53:38,308 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2022-09-19T16:53:38,317 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.3.dist-info/WHEEL 2022-09-19T16:53:38,323 creating '/tmp/pip-wheel-a8s51rvo/deepspeed-0.7.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-09-19T16:53:38,327 adding 'benchmarks/__init__.py' 2022-09-19T16:53:38,331 adding 'benchmarks/communication/__init__.py' 2022-09-19T16:53:38,334 adding 'benchmarks/communication/all_gather.py' 2022-09-19T16:53:38,337 adding 'benchmarks/communication/all_reduce.py' 2022-09-19T16:53:38,340 adding 'benchmarks/communication/all_to_all.py' 2022-09-19T16:53:38,343 adding 'benchmarks/communication/broadcast.py' 2022-09-19T16:53:38,346 adding 'benchmarks/communication/constants.py' 2022-09-19T16:53:38,349 adding 'benchmarks/communication/pt2pt.py' 2022-09-19T16:53:38,351 adding 'benchmarks/communication/run_all.py' 2022-09-19T16:53:38,354 adding 'benchmarks/communication/utils.py' 2022-09-19T16:53:38,359 adding 'benchmarks/inference/collect_results.py' 2022-09-19T16:53:38,362 adding 'benchmarks/inference/gpt-bench.py' 2022-09-19T16:53:38,368 adding 'deepspeed/__init__.py' 2022-09-19T16:53:38,371 adding 'deepspeed/constants.py' 2022-09-19T16:53:38,373 adding 'deepspeed/env_report.py' 2022-09-19T16:53:38,376 adding 'deepspeed/git_version_info.py' 2022-09-19T16:53:38,378 adding 'deepspeed/git_version_info_installed.py' 2022-09-19T16:53:38,381 adding 'deepspeed/autotuning/__init__.py' 2022-09-19T16:53:38,394 adding 'deepspeed/autotuning/autotuner.py' 2022-09-19T16:53:38,397 adding 'deepspeed/autotuning/config.py' 2022-09-19T16:53:38,401 adding 'deepspeed/autotuning/constants.py' 2022-09-19T16:53:38,406 adding 'deepspeed/autotuning/scheduler.py' 2022-09-19T16:53:38,412 adding 'deepspeed/autotuning/utils.py' 2022-09-19T16:53:38,416 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2022-09-19T16:53:38,418 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2022-09-19T16:53:38,420 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2022-09-19T16:53:38,422 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2022-09-19T16:53:38,426 adding 'deepspeed/autotuning/tuner/__init__.py' 2022-09-19T16:53:38,429 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2022-09-19T16:53:38,431 adding 'deepspeed/autotuning/tuner/cost_model.py' 2022-09-19T16:53:38,433 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2022-09-19T16:53:38,436 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2022-09-19T16:53:38,439 adding 'deepspeed/autotuning/tuner/utils.py' 2022-09-19T16:53:38,443 adding 'deepspeed/checkpoint/__init__.py' 2022-09-19T16:53:38,445 adding 'deepspeed/checkpoint/constants.py' 2022-09-19T16:53:38,449 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2022-09-19T16:53:38,452 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2022-09-19T16:53:38,456 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2022-09-19T16:53:38,459 adding 'deepspeed/checkpoint/reshape_utils.py' 2022-09-19T16:53:38,462 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2022-09-19T16:53:38,464 adding 'deepspeed/checkpoint/utils.py' 2022-09-19T16:53:38,467 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2022-09-19T16:53:38,471 adding 'deepspeed/comm/__init__.py' 2022-09-19T16:53:38,473 adding 'deepspeed/comm/backend.py' 2022-09-19T16:53:38,480 adding 'deepspeed/comm/comm.py' 2022-09-19T16:53:38,483 adding 'deepspeed/comm/config.py' 2022-09-19T16:53:38,485 adding 'deepspeed/comm/constants.py' 2022-09-19T16:53:38,488 adding 'deepspeed/comm/torch.py' 2022-09-19T16:53:38,491 adding 'deepspeed/comm/utils.py' 2022-09-19T16:53:38,495 adding 'deepspeed/compression/__init__.py' 2022-09-19T16:53:38,502 adding 'deepspeed/compression/basic_layer.py' 2022-09-19T16:53:38,507 adding 'deepspeed/compression/compress.py' 2022-09-19T16:53:38,511 adding 'deepspeed/compression/config.py' 2022-09-19T16:53:38,514 adding 'deepspeed/compression/constants.py' 2022-09-19T16:53:38,518 adding 'deepspeed/compression/helper.py' 2022-09-19T16:53:38,521 adding 'deepspeed/compression/scheduler.py' 2022-09-19T16:53:38,524 adding 'deepspeed/compression/utils.py' 2022-09-19T16:53:38,528 adding 'deepspeed/elasticity/__init__.py' 2022-09-19T16:53:38,531 adding 'deepspeed/elasticity/config.py' 2022-09-19T16:53:38,534 adding 'deepspeed/elasticity/constants.py' 2022-09-19T16:53:38,537 adding 'deepspeed/elasticity/elastic_agent.py' 2022-09-19T16:53:38,542 adding 'deepspeed/elasticity/elasticity.py' 2022-09-19T16:53:38,545 adding 'deepspeed/elasticity/utils.py' 2022-09-19T16:53:38,548 adding 'deepspeed/inference/__init__.py' 2022-09-19T16:53:38,554 adding 'deepspeed/inference/engine.py' 2022-09-19T16:53:38,558 adding 'deepspeed/launcher/__init__.py' 2022-09-19T16:53:38,560 adding 'deepspeed/launcher/constants.py' 2022-09-19T16:53:38,564 adding 'deepspeed/launcher/launch.py' 2022-09-19T16:53:38,568 adding 'deepspeed/launcher/multinode_runner.py' 2022-09-19T16:53:38,574 adding 'deepspeed/launcher/runner.py' 2022-09-19T16:53:38,578 adding 'deepspeed/module_inject/__init__.py' 2022-09-19T16:53:38,581 adding 'deepspeed/module_inject/inject.py' 2022-09-19T16:53:38,583 adding 'deepspeed/module_inject/layers.py' 2022-09-19T16:53:38,587 adding 'deepspeed/module_inject/load_checkpoint.py' 2022-09-19T16:53:38,590 adding 'deepspeed/module_inject/module_quantize.py' 2022-09-19T16:53:38,602 adding 'deepspeed/module_inject/replace_module.py' 2022-09-19T16:53:38,607 adding 'deepspeed/module_inject/replace_policy.py' 2022-09-19T16:53:38,611 adding 'deepspeed/moe/__init__.py' 2022-09-19T16:53:38,614 adding 'deepspeed/moe/experts.py' 2022-09-19T16:53:38,617 adding 'deepspeed/moe/layer.py' 2022-09-19T16:53:38,620 adding 'deepspeed/moe/mappings.py' 2022-09-19T16:53:38,626 adding 'deepspeed/moe/sharded_moe.py' 2022-09-19T16:53:38,630 adding 'deepspeed/moe/utils.py' 2022-09-19T16:53:38,633 adding 'deepspeed/monitor/__init__.py' 2022-09-19T16:53:38,636 adding 'deepspeed/monitor/config.py' 2022-09-19T16:53:38,639 adding 'deepspeed/monitor/constants.py' 2022-09-19T16:53:38,641 adding 'deepspeed/monitor/csv_monitor.py' 2022-09-19T16:53:38,644 adding 'deepspeed/monitor/monitor.py' 2022-09-19T16:53:38,646 adding 'deepspeed/monitor/tensorboard.py' 2022-09-19T16:53:38,648 adding 'deepspeed/monitor/utils.py' 2022-09-19T16:53:38,651 adding 'deepspeed/monitor/wandb.py' 2022-09-19T16:53:38,654 adding 'deepspeed/nebula/__init__.py' 2022-09-19T16:53:38,656 adding 'deepspeed/nebula/config.py' 2022-09-19T16:53:38,659 adding 'deepspeed/nebula/constants.py' 2022-09-19T16:53:38,663 adding 'deepspeed/ops/__init__.py' 2022-09-19T16:53:38,667 adding 'deepspeed/ops/adagrad/__init__.py' 2022-09-19T16:53:38,669 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2022-09-19T16:53:38,673 adding 'deepspeed/ops/adam/__init__.py' 2022-09-19T16:53:38,677 adding 'deepspeed/ops/adam/cpu_adam.py' 2022-09-19T16:53:38,680 adding 'deepspeed/ops/adam/fused_adam.py' 2022-09-19T16:53:38,683 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2022-09-19T16:53:38,686 adding 'deepspeed/ops/aio/__init__.py' 2022-09-19T16:53:38,692 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2022-09-19T16:53:38,697 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2022-09-19T16:53:38,699 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2022-09-19T16:53:38,702 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2022-09-19T16:53:38,706 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2022-09-19T16:53:38,712 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2022-09-19T16:53:38,715 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2022-09-19T16:53:38,717 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2022-09-19T16:53:38,720 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2022-09-19T16:53:38,723 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2022-09-19T16:53:38,725 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2022-09-19T16:53:38,729 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2022-09-19T16:53:38,732 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2022-09-19T16:53:38,735 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2022-09-19T16:53:38,737 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2022-09-19T16:53:38,740 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2022-09-19T16:53:38,743 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2022-09-19T16:53:38,746 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2022-09-19T16:53:38,748 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2022-09-19T16:53:38,750 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2022-09-19T16:53:38,754 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2022-09-19T16:53:38,757 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2022-09-19T16:53:38,761 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2022-09-19T16:53:38,764 adding 'deepspeed/ops/csrc/includes/Timer.h' 2022-09-19T16:53:38,766 adding 'deepspeed/ops/csrc/includes/compat.h' 2022-09-19T16:53:38,769 adding 'deepspeed/ops/csrc/includes/context.h' 2022-09-19T16:53:38,772 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2022-09-19T16:53:38,775 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2022-09-19T16:53:38,778 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2022-09-19T16:53:38,782 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2022-09-19T16:53:38,784 adding 'deepspeed/ops/csrc/includes/dropout.h' 2022-09-19T16:53:38,787 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2022-09-19T16:53:38,790 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2022-09-19T16:53:38,792 adding 'deepspeed/ops/csrc/includes/gelu.h' 2022-09-19T16:53:38,795 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2022-09-19T16:53:38,798 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2022-09-19T16:53:38,803 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2022-09-19T16:53:38,806 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2022-09-19T16:53:38,808 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2022-09-19T16:53:38,811 adding 'deepspeed/ops/csrc/includes/simd.h' 2022-09-19T16:53:38,814 adding 'deepspeed/ops/csrc/includes/softmax.h' 2022-09-19T16:53:38,816 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2022-09-19T16:53:38,820 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2022-09-19T16:53:38,824 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2022-09-19T16:53:38,828 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2022-09-19T16:53:38,832 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2022-09-19T16:53:38,839 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2022-09-19T16:53:38,843 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2022-09-19T16:53:38,848 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2022-09-19T16:53:38,854 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2022-09-19T16:53:38,864 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2022-09-19T16:53:38,868 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2022-09-19T16:53:38,872 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2022-09-19T16:53:38,882 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2022-09-19T16:53:38,889 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2022-09-19T16:53:38,895 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2022-09-19T16:53:38,902 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2022-09-19T16:53:38,905 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2022-09-19T16:53:38,910 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2022-09-19T16:53:38,914 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2022-09-19T16:53:38,924 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2022-09-19T16:53:38,927 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2022-09-19T16:53:38,932 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2022-09-19T16:53:38,938 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2022-09-19T16:53:38,943 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2022-09-19T16:53:38,946 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2022-09-19T16:53:38,950 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2022-09-19T16:53:38,953 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2022-09-19T16:53:38,956 adding 'deepspeed/ops/lamb/__init__.py' 2022-09-19T16:53:38,960 adding 'deepspeed/ops/lamb/fused_lamb.py' 2022-09-19T16:53:38,964 adding 'deepspeed/ops/op_builder/__init__.py' 2022-09-19T16:53:38,967 adding 'deepspeed/ops/op_builder/async_io.py' 2022-09-19T16:53:38,974 adding 'deepspeed/ops/op_builder/builder.py' 2022-09-19T16:53:38,977 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2022-09-19T16:53:38,979 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2022-09-19T16:53:38,982 adding 'deepspeed/ops/op_builder/fused_adam.py' 2022-09-19T16:53:38,984 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2022-09-19T16:53:38,986 adding 'deepspeed/ops/op_builder/quantizer.py' 2022-09-19T16:53:38,989 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2022-09-19T16:53:38,991 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2022-09-19T16:53:38,994 adding 'deepspeed/ops/op_builder/transformer.py' 2022-09-19T16:53:38,996 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2022-09-19T16:53:38,998 adding 'deepspeed/ops/op_builder/utils.py' 2022-09-19T16:53:39,001 adding 'deepspeed/ops/quantizer/__init__.py' 2022-09-19T16:53:39,004 adding 'deepspeed/ops/quantizer/quantizer.py' 2022-09-19T16:53:39,007 adding 'deepspeed/ops/sparse_attention/__init__.py' 2022-09-19T16:53:39,010 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2022-09-19T16:53:39,019 adding 'deepspeed/ops/sparse_attention/matmul.py' 2022-09-19T16:53:39,024 adding 'deepspeed/ops/sparse_attention/softmax.py' 2022-09-19T16:53:39,028 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2022-09-19T16:53:39,032 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2022-09-19T16:53:39,039 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2022-09-19T16:53:39,044 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2022-09-19T16:53:39,047 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2022-09-19T16:53:39,050 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2022-09-19T16:53:39,053 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2022-09-19T16:53:39,056 adding 'deepspeed/ops/transformer/__init__.py' 2022-09-19T16:53:39,062 adding 'deepspeed/ops/transformer/transformer.py' 2022-09-19T16:53:39,066 adding 'deepspeed/ops/transformer/inference/__init__.py' 2022-09-19T16:53:39,071 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2022-09-19T16:53:39,080 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2022-09-19T16:53:39,084 adding 'deepspeed/pipe/__init__.py' 2022-09-19T16:53:39,087 adding 'deepspeed/profiling/__init__.py' 2022-09-19T16:53:39,090 adding 'deepspeed/profiling/config.py' 2022-09-19T16:53:39,092 adding 'deepspeed/profiling/constants.py' 2022-09-19T16:53:39,095 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2022-09-19T16:53:39,107 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2022-09-19T16:53:39,112 adding 'deepspeed/runtime/__init__.py' 2022-09-19T16:53:39,117 adding 'deepspeed/runtime/bf16_optimizer.py' 2022-09-19T16:53:39,126 adding 'deepspeed/runtime/config.py' 2022-09-19T16:53:39,130 adding 'deepspeed/runtime/config_utils.py' 2022-09-19T16:53:39,134 adding 'deepspeed/runtime/constants.py' 2022-09-19T16:53:39,137 adding 'deepspeed/runtime/dataloader.py' 2022-09-19T16:53:39,140 adding 'deepspeed/runtime/eigenvalue.py' 2022-09-19T16:53:39,178 adding 'deepspeed/runtime/engine.py' 2022-09-19T16:53:39,189 adding 'deepspeed/runtime/lr_schedules.py' 2022-09-19T16:53:39,192 adding 'deepspeed/runtime/progressive_layer_drop.py' 2022-09-19T16:53:39,196 adding 'deepspeed/runtime/quantize.py' 2022-09-19T16:53:39,198 adding 'deepspeed/runtime/sparse_tensor.py' 2022-09-19T16:53:39,203 adding 'deepspeed/runtime/state_dict_factory.py' 2022-09-19T16:53:39,213 adding 'deepspeed/runtime/utils.py' 2022-09-19T16:53:39,217 adding 'deepspeed/runtime/weight_quantizer.py' 2022-09-19T16:53:39,220 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2022-09-19T16:53:39,229 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2022-09-19T16:53:39,232 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2022-09-19T16:53:39,235 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2022-09-19T16:53:39,238 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2022-09-19T16:53:39,241 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2022-09-19T16:53:39,243 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2022-09-19T16:53:39,246 adding 'deepspeed/runtime/comm/__init__.py' 2022-09-19T16:53:39,249 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2022-09-19T16:53:39,252 adding 'deepspeed/runtime/comm/mpi.py' 2022-09-19T16:53:39,256 adding 'deepspeed/runtime/comm/nccl.py' 2022-09-19T16:53:39,259 adding 'deepspeed/runtime/compression/__init__.py' 2022-09-19T16:53:39,261 adding 'deepspeed/runtime/compression/cupy.py' 2022-09-19T16:53:39,264 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2022-09-19T16:53:39,267 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2022-09-19T16:53:39,270 adding 'deepspeed/runtime/fp16/__init__.py' 2022-09-19T16:53:39,276 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2022-09-19T16:53:39,280 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2022-09-19T16:53:39,285 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2022-09-19T16:53:39,289 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2022-09-19T16:53:39,293 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2022-09-19T16:53:39,300 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2022-09-19T16:53:39,306 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2022-09-19T16:53:39,310 adding 'deepspeed/runtime/pipe/__init__.py' 2022-09-19T16:53:39,325 adding 'deepspeed/runtime/pipe/engine.py' 2022-09-19T16:53:39,334 adding 'deepspeed/runtime/pipe/module.py' 2022-09-19T16:53:39,337 adding 'deepspeed/runtime/pipe/p2p.py' 2022-09-19T16:53:39,342 adding 'deepspeed/runtime/pipe/schedule.py' 2022-09-19T16:53:39,347 adding 'deepspeed/runtime/pipe/topology.py' 2022-09-19T16:53:39,351 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2022-09-19T16:53:39,353 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2022-09-19T16:53:39,356 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2022-09-19T16:53:39,359 adding 'deepspeed/runtime/swap_tensor/constants.py' 2022-09-19T16:53:39,364 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2022-09-19T16:53:39,369 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2022-09-19T16:53:39,374 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2022-09-19T16:53:39,378 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2022-09-19T16:53:39,382 adding 'deepspeed/runtime/swap_tensor/utils.py' 2022-09-19T16:53:39,386 adding 'deepspeed/runtime/zero/__init__.py' 2022-09-19T16:53:39,389 adding 'deepspeed/runtime/zero/config.py' 2022-09-19T16:53:39,393 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2022-09-19T16:53:39,396 adding 'deepspeed/runtime/zero/linear.py' 2022-09-19T16:53:39,399 adding 'deepspeed/runtime/zero/offload_config.py' 2022-09-19T16:53:39,404 adding 'deepspeed/runtime/zero/parameter_offload.py' 2022-09-19T16:53:39,424 adding 'deepspeed/runtime/zero/partition_parameters.py' 2022-09-19T16:53:39,432 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2022-09-19T16:53:39,463 adding 'deepspeed/runtime/zero/stage3.py' 2022-09-19T16:53:39,494 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2022-09-19T16:53:39,499 adding 'deepspeed/runtime/zero/test.py' 2022-09-19T16:53:39,503 adding 'deepspeed/runtime/zero/tiling.py' 2022-09-19T16:53:39,506 adding 'deepspeed/runtime/zero/utils.py' 2022-09-19T16:53:39,510 adding 'deepspeed/utils/__init__.py' 2022-09-19T16:53:39,513 adding 'deepspeed/utils/comms_logging.py' 2022-09-19T16:53:39,517 adding 'deepspeed/utils/debug.py' 2022-09-19T16:53:39,519 adding 'deepspeed/utils/exceptions.py' 2022-09-19T16:53:39,524 adding 'deepspeed/utils/groups.py' 2022-09-19T16:53:39,527 adding 'deepspeed/utils/init_on_device.py' 2022-09-19T16:53:39,530 adding 'deepspeed/utils/logging.py' 2022-09-19T16:53:39,532 adding 'deepspeed/utils/mixed_precision_linkage.py' 2022-09-19T16:53:39,534 adding 'deepspeed/utils/nvtx.py' 2022-09-19T16:53:39,537 adding 'deepspeed/utils/tensor_fragment.py' 2022-09-19T16:53:39,541 adding 'deepspeed/utils/timer.py' 2022-09-19T16:53:39,543 adding 'deepspeed/utils/types.py' 2022-09-19T16:53:39,549 adding 'deepspeed/utils/zero_to_fp32.py' 2022-09-19T16:53:39,554 adding 'deepspeed-0.7.3.data/scripts/deepspeed' 2022-09-19T16:53:39,556 adding 'deepspeed-0.7.3.data/scripts/deepspeed.pt' 2022-09-19T16:53:39,558 adding 'deepspeed-0.7.3.data/scripts/ds' 2022-09-19T16:53:39,560 adding 'deepspeed-0.7.3.data/scripts/ds_bench' 2022-09-19T16:53:39,563 adding 'deepspeed-0.7.3.data/scripts/ds_elastic' 2022-09-19T16:53:39,565 adding 'deepspeed-0.7.3.data/scripts/ds_report' 2022-09-19T16:53:39,567 adding 'deepspeed-0.7.3.data/scripts/ds_ssh' 2022-09-19T16:53:39,569 adding 'deepspeed-0.7.3.data/scripts/dsr' 2022-09-19T16:53:39,574 adding 'deepspeed-0.7.3.dist-info/LICENSE' 2022-09-19T16:53:39,580 adding 'deepspeed-0.7.3.dist-info/METADATA' 2022-09-19T16:53:39,583 adding 'deepspeed-0.7.3.dist-info/WHEEL' 2022-09-19T16:53:39,584 adding 'deepspeed-0.7.3.dist-info/entry_points.txt' 2022-09-19T16:53:39,586 adding 'deepspeed-0.7.3.dist-info/top_level.txt' 2022-09-19T16:53:39,594 adding 'deepspeed-0.7.3.dist-info/RECORD' 2022-09-19T16:53:39,642 removing build/bdist.linux-armv7l/wheel 2022-09-19T16:53:39,834 deepspeed build time = 22.990257740020752 secs 2022-09-19T16:53:40,087 Building wheel for deepspeed (setup.py): finished with status 'done' 2022-09-19T16:53:40,114 Created wheel for deepspeed: filename=deepspeed-0.7.3-py3-none-any.whl size=658896 sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b 2022-09-19T16:53:40,116 Stored in directory: /tmp/pip-ephem-wheel-cache-tko1fgtg/wheels/7f/d9/0f/fd58adf17bc5e8aba3140070ae57de85d0058404599571ce8a 2022-09-19T16:53:40,172 Successfully built deepspeed 2022-09-19T16:53:40,240 Removed build tracker: '/tmp/pip-build-tracker-l4r9gjfa'