2021-12-01T01:42:10,668 Created temporary directory: /tmp/pip-ephem-wheel-cache-mqavtmi5 2021-12-01T01:42:10,671 Created temporary directory: /tmp/pip-req-tracker-xvt3btue 2021-12-01T01:42:10,671 Initialized build tracking at /tmp/pip-req-tracker-xvt3btue 2021-12-01T01:42:10,672 Created build tracker: /tmp/pip-req-tracker-xvt3btue 2021-12-01T01:42:10,672 Entered build tracker: /tmp/pip-req-tracker-xvt3btue 2021-12-01T01:42:10,673 Created temporary directory: /tmp/pip-wheel-h1z5xpxu 2021-12-01T01:42:10,709 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2021-12-01T01:42:10,712 2 location(s) to search for versions of deepspeed: 2021-12-01T01:42:10,712 * https://pypi.org/simple/deepspeed/ 2021-12-01T01:42:10,712 * https://www.piwheels.org/simple/deepspeed/ 2021-12-01T01:42:10,713 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-12-01T01:42:10,713 Getting page https://pypi.org/simple/deepspeed/ 2021-12-01T01:42:10,715 Found index url https://pypi.org/simple 2021-12-01T01:42:10,825 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2021-12-01T01:42:10,826 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-12-01T01:42:10,826 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2021-12-01T01:42:10,827 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-12-01T01:42:10,827 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2021-12-01T01:42:10,827 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-12-01T01:42:10,827 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2021-12-01T01:42:10,828 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-12-01T01:42:10,828 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2021-12-01T01:42:10,828 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-12-01T01:42:10,828 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-12-01T01:42:10,829 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-12-01T01:42:10,829 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-12-01T01:42:10,829 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-12-01T01:42:10,830 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-12-01T01:42:10,830 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-12-01T01:42:10,830 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-12-01T01:42:10,831 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-12-01T01:42:10,831 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-12-01T01:42:10,831 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-12-01T01:42:10,831 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-12-01T01:42:10,832 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-12-01T01:42:10,832 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-12-01T01:42:10,832 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-12-01T01:42:10,833 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-12-01T01:42:10,833 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-12-01T01:42:10,833 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-12-01T01:42:10,833 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-12-01T01:42:10,834 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-12-01T01:42:10,834 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-12-01T01:42:10,834 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-12-01T01:42:10,835 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-12-01T01:42:10,835 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2021-12-01T01:42:10,835 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2021-12-01T01:42:10,836 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2021-12-01T01:42:10,836 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2021-12-01T01:42:10,836 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2021-12-01T01:42:10,837 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2021-12-01T01:42:10,837 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz#sha256=f8c083db2bd1594b928458ac4cef5e8f1599e7b764d475d61a3d5aa94563a287 (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2021-12-01T01:42:10,837 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2021-12-01T01:42:10,837 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz#sha256=03fc7c89b00cfb8abad2af98c662f22032bb9550813908548dbd47499be75a06 (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2021-12-01T01:42:10,838 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz#sha256=5db284052e17f937500b1700ce93aec1bde4527ad2f9acb0b85e9db979e438c1 (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2021-12-01T01:42:10,838 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz#sha256=f078ddd22e14925e147509baae702727ea38c1c2e878c72583f0891c5abf956f (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2021-12-01T01:42:10,838 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2021-12-01T01:42:10,839 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2021-12-01T01:42:10,839 Getting page https://www.piwheels.org/simple/deepspeed/ 2021-12-01T01:42:10,840 Found index url https://www.piwheels.org/simple 2021-12-01T01:42:11,034 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,034 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,037 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,037 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,037 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,039 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2021-12-01T01:42:11,039 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2021-12-01T01:42:11,039 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-12-01T01:42:11,058 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-12-01T01:42:11,073 Collecting deepspeed==0.5.8 2021-12-01T01:42:11,075 Created temporary directory: /tmp/pip-unpack-ua24vl3j 2021-12-01T01:42:11,148 Downloading deepspeed-0.5.8.tar.gz (517 kB) 2021-12-01T01:42:12,174 Added deepspeed==0.5.8 from https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 to build tracker '/tmp/pip-req-tracker-xvt3btue' 2021-12-01T01:42:12,175 Running setup.py (path:/tmp/pip-wheel-h1z5xpxu/deepspeed_e30eb6bedaf6482d8b2d647032bae1a4/setup.py) egg_info for package deepspeed 2021-12-01T01:42:12,176 Created temporary directory: /tmp/pip-pip-egg-info-l8nui0iq 2021-12-01T01:42:12,176 Running command python setup.py egg_info 2021-12-01T01:42:13,316 fatal: not a git repository (or any of the parent directories): .git 2021-12-01T01:42:13,652 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-12-01T01:42:13,653 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-12-01T01:42:13,653 DS_BUILD_OPS=0 2021-12-01T01:42:13,653 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-12-01T01:42:13,653 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-12-01T01:42:13,653 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-12-01T01:42:13,653 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-12-01T01:42:13,654 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-12-01T01:42:13,654 version=0.5.8, git_hash=unknown, git_branch=unknown 2021-12-01T01:42:13,654 install_requires=['torch', 'tqdm', 'ninja', 'numpy', 'psutil', 'packaging', 'hjson'] 2021-12-01T01:42:13,654 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-12-01T01:42:13,654 ext_modules=[] 2021-12-01T01:42:13,654 running egg_info 2021-12-01T01:42:13,655 creating /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info 2021-12-01T01:42:13,656 writing /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/PKG-INFO 2021-12-01T01:42:13,659 writing dependency_links to /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/dependency_links.txt 2021-12-01T01:42:13,660 writing entry points to /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/entry_points.txt 2021-12-01T01:42:13,662 writing requirements to /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/requires.txt 2021-12-01T01:42:13,663 writing top-level names to /tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/top_level.txt 2021-12-01T01:42:13,664 writing manifest file '/tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/SOURCES.txt' 2021-12-01T01:42:13,829 reading manifest file '/tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/SOURCES.txt' 2021-12-01T01:42:13,831 reading manifest template 'MANIFEST.in' 2021-12-01T01:42:14,620 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-12-01T01:42:14,891 warning: no files found matching '*.tr' under directory 'csrc' 2021-12-01T01:42:14,958 warning: no files found matching '*.cc' under directory 'csrc' 2021-12-01T01:42:14,958 adding license file 'LICENSE' 2021-12-01T01:42:14,975 writing manifest file '/tmp/pip-pip-egg-info-l8nui0iq/deepspeed.egg-info/SOURCES.txt' 2021-12-01T01:42:14,978 deepspeed build time = 1.6539051532745361 secs 2021-12-01T01:42:15,045 Source in /tmp/pip-wheel-h1z5xpxu/deepspeed_e30eb6bedaf6482d8b2d647032bae1a4 has version 0.5.8, which satisfies requirement deepspeed==0.5.8 from https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 2021-12-01T01:42:15,046 Removed deepspeed==0.5.8 from https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 from build tracker '/tmp/pip-req-tracker-xvt3btue' 2021-12-01T01:42:15,052 Created temporary directory: /tmp/pip-unpack-l518ovnw 2021-12-01T01:42:15,052 Building wheels for collected packages: deepspeed 2021-12-01T01:42:15,057 Created temporary directory: /tmp/pip-wheel-anz15wrf 2021-12-01T01:42:15,058 Building wheel for deepspeed (setup.py): started 2021-12-01T01:42:15,058 Destination directory: /tmp/pip-wheel-anz15wrf 2021-12-01T01:42:15,058 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-h1z5xpxu/deepspeed_e30eb6bedaf6482d8b2d647032bae1a4/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-h1z5xpxu/deepspeed_e30eb6bedaf6482d8b2d647032bae1a4/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-anz15wrf 2021-12-01T01:42:15,821 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-12-01T01:42:15,834 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-12-01T01:42:15,848 DS_BUILD_OPS=0 2021-12-01T01:42:15,849 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-12-01T01:42:16,007 �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found. 2021-12-01T01:42:16,087 �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt 2021-12-01T01:42:16,088 �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2021-12-01T01:42:16,088 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-12-01T01:42:16,110 fatal: not a git repository (or any of the parent directories): .git 2021-12-01T01:42:16,113 version=0.5.8, git_hash=unknown, git_branch=unknown 2021-12-01T01:42:16,114 install_requires=['torch', 'tqdm', 'ninja', 'numpy', 'psutil', 'packaging', 'hjson'] 2021-12-01T01:42:16,115 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-12-01T01:42:16,115 ext_modules=[] 2021-12-01T01:42:16,446 running bdist_wheel 2021-12-01T01:42:16,450 running build 2021-12-01T01:42:16,451 running build_py 2021-12-01T01:42:16,578 creating build 2021-12-01T01:42:16,578 creating build/lib 2021-12-01T01:42:16,579 creating build/lib/op_builder 2021-12-01T01:42:16,580 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-12-01T01:42:16,582 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-12-01T01:42:16,584 copying op_builder/__init__.py -> build/lib/op_builder 2021-12-01T01:42:16,586 copying op_builder/transformer.py -> build/lib/op_builder 2021-12-01T01:42:16,587 copying op_builder/cpu_adagrad.py -> build/lib/op_builder 2021-12-01T01:42:16,589 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-12-01T01:42:16,591 copying op_builder/quantizer.py -> build/lib/op_builder 2021-12-01T01:42:16,593 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-12-01T01:42:16,594 copying op_builder/builder.py -> build/lib/op_builder 2021-12-01T01:42:16,597 copying op_builder/utils.py -> build/lib/op_builder 2021-12-01T01:42:16,599 copying op_builder/async_io.py -> build/lib/op_builder 2021-12-01T01:42:16,600 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-12-01T01:42:16,602 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-12-01T01:42:16,605 creating build/lib/deepspeed 2021-12-01T01:42:16,605 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-12-01T01:42:16,608 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-12-01T01:42:16,610 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-12-01T01:42:16,611 copying deepspeed/constants.py -> build/lib/deepspeed 2021-12-01T01:42:16,613 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-12-01T01:42:16,617 creating build/lib/deepspeed/runtime 2021-12-01T01:42:16,617 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,619 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,622 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,623 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,625 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,628 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,632 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,635 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,638 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,642 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,644 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,646 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,655 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,659 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2021-12-01T01:42:16,661 creating build/lib/deepspeed/moe 2021-12-01T01:42:16,662 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2021-12-01T01:42:16,664 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2021-12-01T01:42:16,666 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2021-12-01T01:42:16,668 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2021-12-01T01:42:16,671 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2021-12-01T01:42:16,674 creating build/lib/deepspeed/elasticity 2021-12-01T01:42:16,675 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-12-01T01:42:16,677 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-12-01T01:42:16,681 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-12-01T01:42:16,685 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-12-01T01:42:16,689 creating build/lib/deepspeed/launcher 2021-12-01T01:42:16,689 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-12-01T01:42:16,692 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-12-01T01:42:16,695 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-12-01T01:42:16,697 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-12-01T01:42:16,699 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-12-01T01:42:16,703 creating build/lib/deepspeed/pipe 2021-12-01T01:42:16,704 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-12-01T01:42:16,707 creating build/lib/deepspeed/ops 2021-12-01T01:42:16,708 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-12-01T01:42:16,711 creating build/lib/deepspeed/profiling 2021-12-01T01:42:16,712 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-12-01T01:42:16,714 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-12-01T01:42:16,716 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-12-01T01:42:16,718 creating build/lib/deepspeed/inference 2021-12-01T01:42:16,719 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-12-01T01:42:16,721 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-12-01T01:42:16,725 creating build/lib/deepspeed/utils 2021-12-01T01:42:16,725 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,728 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,731 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,733 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,735 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,738 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,740 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-12-01T01:42:16,743 creating build/lib/deepspeed/module_inject 2021-12-01T01:42:16,744 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-12-01T01:42:16,746 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-12-01T01:42:16,748 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-12-01T01:42:16,751 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-12-01T01:42:16,753 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-12-01T01:42:16,757 creating build/lib/deepspeed/autotuning 2021-12-01T01:42:16,758 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,761 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,763 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,767 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,770 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,773 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2021-12-01T01:42:16,776 creating build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,777 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,779 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,782 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,785 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,787 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,789 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,792 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,794 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,797 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-12-01T01:42:16,800 creating build/lib/deepspeed/runtime/compression 2021-12-01T01:42:16,801 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-12-01T01:42:16,803 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-12-01T01:42:16,806 creating build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,807 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,809 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,811 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,814 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,817 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,820 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-12-01T01:42:16,824 creating build/lib/deepspeed/runtime/fp16 2021-12-01T01:42:16,825 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-12-01T01:42:16,827 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-12-01T01:42:16,830 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-12-01T01:42:16,833 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-12-01T01:42:16,837 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:16,838 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:16,839 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:16,843 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:16,846 creating build/lib/deepspeed/runtime/comm 2021-12-01T01:42:16,847 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-12-01T01:42:16,849 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-12-01T01:42:16,851 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-12-01T01:42:16,854 creating build/lib/deepspeed/runtime/data_pipeline 2021-12-01T01:42:16,855 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2021-12-01T01:42:16,857 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2021-12-01T01:42:16,861 creating build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,862 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,864 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,866 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,868 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,873 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,875 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,878 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,880 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,885 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,887 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,889 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,897 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,903 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,905 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-12-01T01:42:16,908 creating build/lib/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:16,909 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:16,912 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:16,915 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:16,919 creating build/lib/deepspeed/ops/lamb 2021-12-01T01:42:16,920 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-12-01T01:42:16,923 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-12-01T01:42:16,927 creating build/lib/deepspeed/ops/adam 2021-12-01T01:42:16,928 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-12-01T01:42:16,931 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-12-01T01:42:16,934 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-12-01T01:42:16,936 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-12-01T01:42:16,939 creating build/lib/deepspeed/ops/aio 2021-12-01T01:42:16,941 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-12-01T01:42:16,944 creating build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,945 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,948 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,950 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,953 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,955 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,957 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,959 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,961 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,964 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,967 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,969 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,971 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,974 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-12-01T01:42:16,976 creating build/lib/deepspeed/ops/quantizer 2021-12-01T01:42:16,978 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-12-01T01:42:16,980 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-12-01T01:42:16,983 creating build/lib/deepspeed/ops/adagrad 2021-12-01T01:42:16,984 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2021-12-01T01:42:16,987 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2021-12-01T01:42:16,990 creating build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:16,991 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:16,995 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:16,998 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:17,000 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:17,003 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:17,007 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:17,009 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-12-01T01:42:17,012 creating build/lib/deepspeed/ops/transformer 2021-12-01T01:42:17,013 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-12-01T01:42:17,016 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-12-01T01:42:17,020 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:17,021 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:17,024 creating build/lib/deepspeed/ops/transformer/inference 2021-12-01T01:42:17,025 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-12-01T01:42:17,027 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-12-01T01:42:17,031 creating build/lib/deepspeed/profiling/flops_profiler 2021-12-01T01:42:17,032 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-12-01T01:42:17,036 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-12-01T01:42:17,039 creating build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,040 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,042 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,045 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,047 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,049 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,051 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2021-12-01T01:42:17,053 running egg_info 2021-12-01T01:42:17,069 writing deepspeed.egg-info/PKG-INFO 2021-12-01T01:42:17,072 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-12-01T01:42:17,074 writing entry points to deepspeed.egg-info/entry_points.txt 2021-12-01T01:42:17,075 writing requirements to deepspeed.egg-info/requires.txt 2021-12-01T01:42:17,076 writing top-level names to deepspeed.egg-info/top_level.txt 2021-12-01T01:42:17,102 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-12-01T01:42:17,112 reading manifest template 'MANIFEST.in' 2021-12-01T01:42:17,820 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-12-01T01:42:18,065 warning: no files found matching '*.tr' under directory 'csrc' 2021-12-01T01:42:18,131 warning: no files found matching '*.cc' under directory 'csrc' 2021-12-01T01:42:18,132 adding license file 'LICENSE' 2021-12-01T01:42:18,153 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-12-01T01:42:18,170 creating build/lib/deepspeed/ops/csrc 2021-12-01T01:42:18,170 creating build/lib/deepspeed/ops/csrc/adagrad 2021-12-01T01:42:18,171 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2021-12-01T01:42:18,174 creating build/lib/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,175 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,178 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,180 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,182 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,185 creating build/lib/deepspeed/ops/csrc/aio 2021-12-01T01:42:18,185 creating build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,186 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,189 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,191 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,194 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,196 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,199 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,202 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,203 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,205 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,208 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,211 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,213 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,216 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,219 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,222 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,224 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,226 creating build/lib/deepspeed/ops/csrc/aio/py_test 2021-12-01T01:42:18,227 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2021-12-01T01:42:18,230 creating build/lib/deepspeed/ops/csrc/common 2021-12-01T01:42:18,230 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2021-12-01T01:42:18,233 creating build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,234 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,236 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,238 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,241 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,243 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,246 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,249 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,251 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,254 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,256 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,259 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,261 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,264 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,266 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,269 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,271 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,274 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,276 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,279 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,281 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,284 creating build/lib/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,285 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,287 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,290 creating build/lib/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,291 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,293 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,297 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-12-01T01:42:18,297 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-12-01T01:42:18,300 creating build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,301 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,304 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,308 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,312 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,314 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,317 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,322 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,325 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,328 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-12-01T01:42:18,329 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,330 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,332 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,335 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,339 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,342 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,345 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,346 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,349 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,353 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,355 creating build/lib/deepspeed/ops/csrc/utils 2021-12-01T01:42:18,356 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-12-01T01:42:18,358 creating build/lib/deepspeed/autotuning/config_templates 2021-12-01T01:42:18,359 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2021-12-01T01:42:18,362 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2021-12-01T01:42:18,364 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2021-12-01T01:42:18,366 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2021-12-01T01:42:18,369 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,372 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,374 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,398 running build_scripts 2021-12-01T01:42:18,399 creating build/scripts-3.7 2021-12-01T01:42:18,400 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-12-01T01:42:18,402 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-12-01T01:42:18,403 copying and adjusting bin/ds -> build/scripts-3.7 2021-12-01T01:42:18,404 copying bin/ds_ssh -> build/scripts-3.7 2021-12-01T01:42:18,406 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-12-01T01:42:18,408 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-12-01T01:42:18,408 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-12-01T01:42:18,409 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-12-01T01:42:18,409 changing mode of build/scripts-3.7/ds from 644 to 755 2021-12-01T01:42:18,409 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-12-01T01:42:18,410 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-12-01T01:42:18,415 installing to build/bdist.linux-armv7l/wheel 2021-12-01T01:42:18,415 running install 2021-12-01T01:42:18,416 running install_lib 2021-12-01T01:42:18,420 creating build/bdist.linux-armv7l 2021-12-01T01:42:18,420 creating build/bdist.linux-armv7l/wheel 2021-12-01T01:42:18,422 creating build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,423 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,425 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,427 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,429 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,430 copying build/lib/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,432 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,434 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,436 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,438 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,441 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,443 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,445 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,446 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-12-01T01:42:18,449 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:18,451 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,453 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,454 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,456 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,459 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,462 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,464 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,466 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,469 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,471 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,473 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-12-01T01:42:18,477 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-12-01T01:42:18,478 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-12-01T01:42:18,479 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-12-01T01:42:18,482 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,483 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,485 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,487 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,491 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,494 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,497 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-12-01T01:42:18,501 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,502 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,505 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,507 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,509 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,512 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-12-01T01:42:18,513 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-12-01T01:42:18,515 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-12-01T01:42:18,518 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-12-01T01:42:18,522 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:18,522 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:18,524 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:18,527 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-12-01T01:42:18,530 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-12-01T01:42:18,533 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,536 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,539 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:18,540 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:18,542 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:18,545 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-12-01T01:42:18,547 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,550 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,553 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,556 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-12-01T01:42:18,557 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-12-01T01:42:18,560 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-12-01T01:42:18,561 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-12-01T01:42:18,563 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,566 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-12-01T01:42:18,567 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-12-01T01:42:18,568 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2021-12-01T01:42:18,571 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,578 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,583 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,584 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,586 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,587 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,589 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,594 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,597 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,599 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,602 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,606 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,608 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,610 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,619 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,625 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,627 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-12-01T01:42:18,629 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-12-01T01:42:18,632 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,633 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,634 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,636 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,638 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,641 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2021-12-01T01:42:18,644 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-12-01T01:42:18,645 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-12-01T01:42:18,647 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-12-01T01:42:18,649 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-12-01T01:42:18,651 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-12-01T01:42:18,654 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,655 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,656 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,659 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,661 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,664 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-12-01T01:42:18,667 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-12-01T01:42:18,668 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-12-01T01:42:18,670 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:18,673 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-12-01T01:42:18,675 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-12-01T01:42:18,676 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-12-01T01:42:18,678 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-12-01T01:42:18,680 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-12-01T01:42:18,683 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-12-01T01:42:18,684 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-12-01T01:42:18,686 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-12-01T01:42:18,689 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-12-01T01:42:18,692 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-12-01T01:42:18,695 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-12-01T01:42:18,696 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-12-01T01:42:18,698 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,699 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,701 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,703 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,705 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,707 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,709 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,711 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,713 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,714 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,717 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,719 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,721 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,724 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-12-01T01:42:18,726 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-12-01T01:42:18,727 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-12-01T01:42:18,730 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-12-01T01:42:18,733 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2021-12-01T01:42:18,734 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2021-12-01T01:42:18,736 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2021-12-01T01:42:18,739 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,740 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,743 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,747 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,749 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,753 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,754 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,756 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,758 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,760 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-12-01T01:42:18,762 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,766 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,768 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-12-01T01:42:18,772 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-12-01T01:42:18,774 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,775 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,778 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-12-01T01:42:18,781 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,782 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,784 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,786 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,789 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-12-01T01:42:18,792 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-12-01T01:42:18,793 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2021-12-01T01:42:18,794 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2021-12-01T01:42:18,797 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,797 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,800 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,803 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,805 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,808 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,810 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-12-01T01:42:18,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,814 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,817 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,820 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,822 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,825 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,828 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,830 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,833 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,835 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-12-01T01:42:18,838 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2021-12-01T01:42:18,840 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2021-12-01T01:42:18,843 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,844 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,847 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-12-01T01:42:18,851 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-12-01T01:42:18,852 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-12-01T01:42:18,855 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2021-12-01T01:42:18,856 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2021-12-01T01:42:18,860 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-12-01T01:42:18,861 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-12-01T01:42:18,865 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,866 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,868 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,871 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,873 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,876 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,879 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,881 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,884 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,886 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,888 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,891 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,894 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,896 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,898 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,901 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,903 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,906 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,908 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,911 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,914 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-12-01T01:42:18,917 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,918 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,922 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,925 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,929 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,933 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-12-01T01:42:18,934 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,936 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,938 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,941 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-12-01T01:42:18,944 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,945 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,948 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,951 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,955 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,958 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-12-01T01:42:18,961 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,964 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,968 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,971 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-12-01T01:42:18,975 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-12-01T01:42:18,976 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-12-01T01:42:18,979 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-12-01T01:42:18,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-12-01T01:42:18,984 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-12-01T01:42:18,987 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-12-01T01:42:18,991 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-12-01T01:42:18,992 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-12-01T01:42:18,995 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-12-01T01:42:18,996 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-12-01T01:42:19,000 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-12-01T01:42:19,002 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-12-01T01:42:19,004 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-12-01T01:42:19,007 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-12-01T01:42:19,009 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-12-01T01:42:19,011 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-12-01T01:42:19,015 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,016 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,018 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,022 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,025 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,028 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,031 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,034 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-12-01T01:42:19,036 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:19,040 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,041 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,044 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,046 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,049 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,052 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-12-01T01:42:19,057 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,058 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,061 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,063 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,068 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2021-12-01T01:42:19,069 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2021-12-01T01:42:19,071 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2021-12-01T01:42:19,074 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2021-12-01T01:42:19,076 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2021-12-01T01:42:19,079 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,080 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,082 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,085 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,087 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,089 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,091 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2021-12-01T01:42:19,093 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,096 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,099 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2021-12-01T01:42:19,101 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:19,103 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:19,105 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-12-01T01:42:19,107 running install_egg_info 2021-12-01T01:42:19,117 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.5.8-py3.7.egg-info 2021-12-01T01:42:19,132 running install_scripts 2021-12-01T01:42:19,186 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data 2021-12-01T01:42:19,186 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,187 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,189 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,191 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,192 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,194 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,196 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts 2021-12-01T01:42:19,197 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/ds_report to 755 2021-12-01T01:42:19,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/ds to 755 2021-12-01T01:42:19,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/ds_elastic to 755 2021-12-01T01:42:19,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/deepspeed to 755 2021-12-01T01:42:19,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/ds_ssh to 755 2021-12-01T01:42:19,199 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.data/scripts/deepspeed.pt to 755 2021-12-01T01:42:19,289 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-12-01T01:42:19,294 creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.8.dist-info/WHEEL 2021-12-01T01:42:19,297 creating '/tmp/pip-wheel-anz15wrf/deepspeed-0.5.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-12-01T01:42:19,300 adding 'deepspeed/__init__.py' 2021-12-01T01:42:19,302 adding 'deepspeed/constants.py' 2021-12-01T01:42:19,303 adding 'deepspeed/env_report.py' 2021-12-01T01:42:19,305 adding 'deepspeed/git_version_info.py' 2021-12-01T01:42:19,306 adding 'deepspeed/git_version_info_installed.py' 2021-12-01T01:42:19,308 adding 'deepspeed/autotuning/__init__.py' 2021-12-01T01:42:19,314 adding 'deepspeed/autotuning/autotuner.py' 2021-12-01T01:42:19,316 adding 'deepspeed/autotuning/config.py' 2021-12-01T01:42:19,317 adding 'deepspeed/autotuning/constants.py' 2021-12-01T01:42:19,320 adding 'deepspeed/autotuning/scheduler.py' 2021-12-01T01:42:19,322 adding 'deepspeed/autotuning/utils.py' 2021-12-01T01:42:19,324 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2021-12-01T01:42:19,325 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2021-12-01T01:42:19,326 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2021-12-01T01:42:19,328 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2021-12-01T01:42:19,329 adding 'deepspeed/autotuning/tuner/__init__.py' 2021-12-01T01:42:19,331 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2021-12-01T01:42:19,332 adding 'deepspeed/autotuning/tuner/cost_model.py' 2021-12-01T01:42:19,333 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2021-12-01T01:42:19,335 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2021-12-01T01:42:19,336 adding 'deepspeed/autotuning/tuner/utils.py' 2021-12-01T01:42:19,338 adding 'deepspeed/elasticity/__init__.py' 2021-12-01T01:42:19,339 adding 'deepspeed/elasticity/config.py' 2021-12-01T01:42:19,341 adding 'deepspeed/elasticity/constants.py' 2021-12-01T01:42:19,343 adding 'deepspeed/elasticity/elasticity.py' 2021-12-01T01:42:19,345 adding 'deepspeed/inference/__init__.py' 2021-12-01T01:42:19,346 adding 'deepspeed/inference/engine.py' 2021-12-01T01:42:19,348 adding 'deepspeed/launcher/__init__.py' 2021-12-01T01:42:19,349 adding 'deepspeed/launcher/constants.py' 2021-12-01T01:42:19,351 adding 'deepspeed/launcher/launch.py' 2021-12-01T01:42:19,352 adding 'deepspeed/launcher/multinode_runner.py' 2021-12-01T01:42:19,355 adding 'deepspeed/launcher/runner.py' 2021-12-01T01:42:19,357 adding 'deepspeed/module_inject/__init__.py' 2021-12-01T01:42:19,358 adding 'deepspeed/module_inject/inject.py' 2021-12-01T01:42:19,359 adding 'deepspeed/module_inject/module_quantize.py' 2021-12-01T01:42:19,363 adding 'deepspeed/module_inject/replace_module.py' 2021-12-01T01:42:19,364 adding 'deepspeed/module_inject/replace_policy.py' 2021-12-01T01:42:19,366 adding 'deepspeed/moe/__init__.py' 2021-12-01T01:42:19,367 adding 'deepspeed/moe/experts.py' 2021-12-01T01:42:19,369 adding 'deepspeed/moe/layer.py' 2021-12-01T01:42:19,372 adding 'deepspeed/moe/sharded_moe.py' 2021-12-01T01:42:19,373 adding 'deepspeed/moe/utils.py' 2021-12-01T01:42:19,375 adding 'deepspeed/ops/__init__.py' 2021-12-01T01:42:19,377 adding 'deepspeed/ops/adagrad/__init__.py' 2021-12-01T01:42:19,378 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2021-12-01T01:42:19,380 adding 'deepspeed/ops/adam/__init__.py' 2021-12-01T01:42:19,382 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-12-01T01:42:19,383 adding 'deepspeed/ops/adam/fused_adam.py' 2021-12-01T01:42:19,385 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-12-01T01:42:19,386 adding 'deepspeed/ops/aio/__init__.py' 2021-12-01T01:42:19,389 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2021-12-01T01:42:19,392 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-12-01T01:42:19,393 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-12-01T01:42:19,395 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-12-01T01:42:19,396 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-12-01T01:42:19,400 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-12-01T01:42:19,401 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-12-01T01:42:19,402 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-12-01T01:42:19,404 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-12-01T01:42:19,405 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-12-01T01:42:19,407 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-12-01T01:42:19,409 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-12-01T01:42:19,410 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-12-01T01:42:19,412 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-12-01T01:42:19,413 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-12-01T01:42:19,415 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-12-01T01:42:19,416 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-12-01T01:42:19,418 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-12-01T01:42:19,419 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-12-01T01:42:19,420 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-12-01T01:42:19,422 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2021-12-01T01:42:19,424 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2021-12-01T01:42:19,426 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-12-01T01:42:19,427 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-12-01T01:42:19,428 adding 'deepspeed/ops/csrc/includes/compat.h' 2021-12-01T01:42:19,430 adding 'deepspeed/ops/csrc/includes/context.h' 2021-12-01T01:42:19,432 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2021-12-01T01:42:19,433 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-12-01T01:42:19,434 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-12-01T01:42:19,436 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-12-01T01:42:19,437 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-12-01T01:42:19,439 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-12-01T01:42:19,440 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-12-01T01:42:19,442 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-12-01T01:42:19,443 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-12-01T01:42:19,444 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-12-01T01:42:19,446 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-12-01T01:42:19,447 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-12-01T01:42:19,448 adding 'deepspeed/ops/csrc/includes/simd.h' 2021-12-01T01:42:19,450 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-12-01T01:42:19,451 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-12-01T01:42:19,453 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-12-01T01:42:19,455 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-12-01T01:42:19,457 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-12-01T01:42:19,459 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-12-01T01:42:19,462 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-12-01T01:42:19,464 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-12-01T01:42:19,466 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-12-01T01:42:19,469 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-12-01T01:42:19,473 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-12-01T01:42:19,475 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-12-01T01:42:19,477 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-12-01T01:42:19,482 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-12-01T01:42:19,485 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-12-01T01:42:19,488 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-12-01T01:42:19,491 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-12-01T01:42:19,492 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-12-01T01:42:19,494 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-12-01T01:42:19,497 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-12-01T01:42:19,499 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-12-01T01:42:19,501 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-12-01T01:42:19,503 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-12-01T01:42:19,504 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-12-01T01:42:19,506 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-12-01T01:42:19,507 adding 'deepspeed/ops/lamb/__init__.py' 2021-12-01T01:42:19,509 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-12-01T01:42:19,511 adding 'deepspeed/ops/op_builder/__init__.py' 2021-12-01T01:42:19,512 adding 'deepspeed/ops/op_builder/async_io.py' 2021-12-01T01:42:19,515 adding 'deepspeed/ops/op_builder/builder.py' 2021-12-01T01:42:19,516 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2021-12-01T01:42:19,518 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-12-01T01:42:19,519 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-12-01T01:42:19,520 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-12-01T01:42:19,521 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-12-01T01:42:19,522 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-12-01T01:42:19,523 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-12-01T01:42:19,525 adding 'deepspeed/ops/op_builder/transformer.py' 2021-12-01T01:42:19,526 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-12-01T01:42:19,527 adding 'deepspeed/ops/op_builder/utils.py' 2021-12-01T01:42:19,528 adding 'deepspeed/ops/quantizer/__init__.py' 2021-12-01T01:42:19,530 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-12-01T01:42:19,531 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-12-01T01:42:19,533 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-12-01T01:42:19,537 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-12-01T01:42:19,539 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-12-01T01:42:19,541 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-12-01T01:42:19,543 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-12-01T01:42:19,546 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-12-01T01:42:19,548 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-12-01T01:42:19,550 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-12-01T01:42:19,551 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-12-01T01:42:19,553 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-12-01T01:42:19,554 adding 'deepspeed/ops/transformer/__init__.py' 2021-12-01T01:42:19,557 adding 'deepspeed/ops/transformer/transformer.py' 2021-12-01T01:42:19,559 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-12-01T01:42:19,562 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-12-01T01:42:19,564 adding 'deepspeed/pipe/__init__.py' 2021-12-01T01:42:19,565 adding 'deepspeed/profiling/__init__.py' 2021-12-01T01:42:19,567 adding 'deepspeed/profiling/config.py' 2021-12-01T01:42:19,568 adding 'deepspeed/profiling/constants.py' 2021-12-01T01:42:19,569 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-12-01T01:42:19,574 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-12-01T01:42:19,576 adding 'deepspeed/runtime/__init__.py' 2021-12-01T01:42:19,580 adding 'deepspeed/runtime/config.py' 2021-12-01T01:42:19,582 adding 'deepspeed/runtime/config_utils.py' 2021-12-01T01:42:19,584 adding 'deepspeed/runtime/constants.py' 2021-12-01T01:42:19,585 adding 'deepspeed/runtime/dataloader.py' 2021-12-01T01:42:19,586 adding 'deepspeed/runtime/eigenvalue.py' 2021-12-01T01:42:19,601 adding 'deepspeed/runtime/engine.py' 2021-12-01T01:42:19,606 adding 'deepspeed/runtime/lr_schedules.py' 2021-12-01T01:42:19,608 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-12-01T01:42:19,609 adding 'deepspeed/runtime/quantize.py' 2021-12-01T01:42:19,611 adding 'deepspeed/runtime/sparse_tensor.py' 2021-12-01T01:42:19,613 adding 'deepspeed/runtime/state_dict_factory.py' 2021-12-01T01:42:19,617 adding 'deepspeed/runtime/utils.py' 2021-12-01T01:42:19,618 adding 'deepspeed/runtime/weight_quantizer.py' 2021-12-01T01:42:19,620 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-12-01T01:42:19,624 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-12-01T01:42:19,626 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-12-01T01:42:19,627 adding 'deepspeed/runtime/comm/__init__.py' 2021-12-01T01:42:19,629 adding 'deepspeed/runtime/comm/mpi.py' 2021-12-01T01:42:19,631 adding 'deepspeed/runtime/comm/nccl.py' 2021-12-01T01:42:19,632 adding 'deepspeed/runtime/compression/__init__.py' 2021-12-01T01:42:19,634 adding 'deepspeed/runtime/compression/cupy.py' 2021-12-01T01:42:19,635 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2021-12-01T01:42:19,637 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2021-12-01T01:42:19,638 adding 'deepspeed/runtime/fp16/__init__.py' 2021-12-01T01:42:19,641 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-12-01T01:42:19,643 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-12-01T01:42:19,645 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-12-01T01:42:19,647 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-12-01T01:42:19,649 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-12-01T01:42:19,652 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-12-01T01:42:19,654 adding 'deepspeed/runtime/pipe/__init__.py' 2021-12-01T01:42:19,661 adding 'deepspeed/runtime/pipe/engine.py' 2021-12-01T01:42:19,665 adding 'deepspeed/runtime/pipe/module.py' 2021-12-01T01:42:19,666 adding 'deepspeed/runtime/pipe/p2p.py' 2021-12-01T01:42:19,669 adding 'deepspeed/runtime/pipe/schedule.py' 2021-12-01T01:42:19,671 adding 'deepspeed/runtime/pipe/topology.py' 2021-12-01T01:42:19,673 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-12-01T01:42:19,674 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-12-01T01:42:19,676 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-12-01T01:42:19,677 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-12-01T01:42:19,680 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-12-01T01:42:19,682 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-12-01T01:42:19,684 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-12-01T01:42:19,686 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-12-01T01:42:19,688 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-12-01T01:42:19,690 adding 'deepspeed/runtime/zero/__init__.py' 2021-12-01T01:42:19,691 adding 'deepspeed/runtime/zero/config.py' 2021-12-01T01:42:19,693 adding 'deepspeed/runtime/zero/constants.py' 2021-12-01T01:42:19,695 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-12-01T01:42:19,697 adding 'deepspeed/runtime/zero/linear.py' 2021-12-01T01:42:19,698 adding 'deepspeed/runtime/zero/offload_config.py' 2021-12-01T01:42:19,699 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-12-01T01:42:19,706 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-12-01T01:42:19,712 adding 'deepspeed/runtime/zero/stage1.py' 2021-12-01T01:42:19,725 adding 'deepspeed/runtime/zero/stage2.py' 2021-12-01T01:42:19,743 adding 'deepspeed/runtime/zero/stage3.py' 2021-12-01T01:42:19,745 adding 'deepspeed/runtime/zero/test.py' 2021-12-01T01:42:19,747 adding 'deepspeed/runtime/zero/tiling.py' 2021-12-01T01:42:19,748 adding 'deepspeed/runtime/zero/utils.py' 2021-12-01T01:42:19,750 adding 'deepspeed/utils/__init__.py' 2021-12-01T01:42:19,752 adding 'deepspeed/utils/debug.py' 2021-12-01T01:42:19,753 adding 'deepspeed/utils/distributed.py' 2021-12-01T01:42:19,756 adding 'deepspeed/utils/groups.py' 2021-12-01T01:42:19,757 adding 'deepspeed/utils/logging.py' 2021-12-01T01:42:19,759 adding 'deepspeed/utils/timer.py' 2021-12-01T01:42:19,761 adding 'deepspeed/utils/zero_to_fp32.py' 2021-12-01T01:42:19,763 adding 'deepspeed-0.5.8.data/scripts/deepspeed' 2021-12-01T01:42:19,764 adding 'deepspeed-0.5.8.data/scripts/deepspeed.pt' 2021-12-01T01:42:19,765 adding 'deepspeed-0.5.8.data/scripts/ds' 2021-12-01T01:42:19,767 adding 'deepspeed-0.5.8.data/scripts/ds_elastic' 2021-12-01T01:42:19,768 adding 'deepspeed-0.5.8.data/scripts/ds_report' 2021-12-01T01:42:19,769 adding 'deepspeed-0.5.8.data/scripts/ds_ssh' 2021-12-01T01:42:19,772 adding 'op_builder/__init__.py' 2021-12-01T01:42:19,773 adding 'op_builder/async_io.py' 2021-12-01T01:42:19,776 adding 'op_builder/builder.py' 2021-12-01T01:42:19,778 adding 'op_builder/cpu_adagrad.py' 2021-12-01T01:42:19,779 adding 'op_builder/cpu_adam.py' 2021-12-01T01:42:19,780 adding 'op_builder/fused_adam.py' 2021-12-01T01:42:19,781 adding 'op_builder/fused_lamb.py' 2021-12-01T01:42:19,782 adding 'op_builder/quantizer.py' 2021-12-01T01:42:19,784 adding 'op_builder/sparse_attn.py' 2021-12-01T01:42:19,785 adding 'op_builder/stochastic_transformer.py' 2021-12-01T01:42:19,786 adding 'op_builder/transformer.py' 2021-12-01T01:42:19,787 adding 'op_builder/transformer_inference.py' 2021-12-01T01:42:19,789 adding 'op_builder/utils.py' 2021-12-01T01:42:19,790 adding 'deepspeed-0.5.8.dist-info/LICENSE' 2021-12-01T01:42:19,794 adding 'deepspeed-0.5.8.dist-info/METADATA' 2021-12-01T01:42:19,795 adding 'deepspeed-0.5.8.dist-info/WHEEL' 2021-12-01T01:42:19,796 adding 'deepspeed-0.5.8.dist-info/entry_points.txt' 2021-12-01T01:42:19,798 adding 'deepspeed-0.5.8.dist-info/top_level.txt' 2021-12-01T01:42:19,801 adding 'deepspeed-0.5.8.dist-info/RECORD' 2021-12-01T01:42:19,822 removing build/bdist.linux-armv7l/wheel 2021-12-01T01:42:19,915 deepspeed build time = 3.798842430114746 secs 2021-12-01T01:42:19,995 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-12-01T01:42:20,004 Created wheel for deepspeed: filename=deepspeed-0.5.8-py3-none-any.whl size=532112 sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf 2021-12-01T01:42:20,004 Stored in directory: /tmp/pip-ephem-wheel-cache-mqavtmi5/wheels/8d/c6/82/cabd9a300c582a221591fd2c8c997e1f03f601e748aad44e4e 2021-12-01T01:42:20,023 Successfully built deepspeed 2021-12-01T01:42:20,050 Removed build tracker: '/tmp/pip-req-tracker-xvt3btue'