2022-01-04T23:23:33,508 Created temporary directory: /tmp/pip-ephem-wheel-cache-b5o55jy1
2022-01-04T23:23:33,513 Created temporary directory: /tmp/pip-req-tracker-iyy3o840
2022-01-04T23:23:33,514 Initialized build tracking at /tmp/pip-req-tracker-iyy3o840
2022-01-04T23:23:33,514 Created build tracker: /tmp/pip-req-tracker-iyy3o840
2022-01-04T23:23:33,515 Entered build tracker: /tmp/pip-req-tracker-iyy3o840
2022-01-04T23:23:33,516 Created temporary directory: /tmp/pip-wheel-633lk5sn
2022-01-04T23:23:33,588 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2022-01-04T23:23:33,593 2 location(s) to search for versions of deepspeed:
2022-01-04T23:23:33,593 * https://pypi.org/simple/deepspeed/
2022-01-04T23:23:33,593 * https://www.piwheels.org/simple/deepspeed/
2022-01-04T23:23:33,594 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2022-01-04T23:23:33,596 Getting page https://pypi.org/simple/deepspeed/
2022-01-04T23:23:33,599 Found index url https://pypi.org/simple
2022-01-04T23:23:33,847   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/)
2022-01-04T23:23:33,848   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2022-01-04T23:23:33,849   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/)
2022-01-04T23:23:33,849   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2022-01-04T23:23:33,850   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/)
2022-01-04T23:23:33,851   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2022-01-04T23:23:33,851   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/)
2022-01-04T23:23:33,852   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2022-01-04T23:23:33,852   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/)
2022-01-04T23:23:33,853   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2022-01-04T23:23:33,854   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2022-01-04T23:23:33,854   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2022-01-04T23:23:33,855   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2022-01-04T23:23:33,856   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2022-01-04T23:23:33,856   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2022-01-04T23:23:33,857   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2022-01-04T23:23:33,858   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2022-01-04T23:23:33,858   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2022-01-04T23:23:33,859   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2022-01-04T23:23:33,860   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2022-01-04T23:23:33,860   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2022-01-04T23:23:33,861   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2022-01-04T23:23:33,862   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2022-01-04T23:23:33,862   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2022-01-04T23:23:33,863   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2022-01-04T23:23:33,864   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2022-01-04T23:23:33,864   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2022-01-04T23:23:33,865   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2022-01-04T23:23:33,866   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2022-01-04T23:23:33,867   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2022-01-04T23:23:33,867   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2022-01-04T23:23:33,868   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2022-01-04T23:23:33,869   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2022-01-04T23:23:33,869   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2022-01-04T23:23:33,870   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2022-01-04T23:23:33,871   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2022-01-04T23:23:33,871   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2022-01-04T23:23:33,872   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2022-01-04T23:23:33,873   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz#sha256=f8c083db2bd1594b928458ac4cef5e8f1599e7b764d475d61a3d5aa94563a287 (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2022-01-04T23:23:33,873   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2022-01-04T23:23:33,874   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz#sha256=03fc7c89b00cfb8abad2af98c662f22032bb9550813908548dbd47499be75a06 (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2022-01-04T23:23:33,875   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz#sha256=5db284052e17f937500b1700ce93aec1bde4527ad2f9acb0b85e9db979e438c1 (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2022-01-04T23:23:33,875   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz#sha256=f078ddd22e14925e147509baae702727ea38c1c2e878c72583f0891c5abf956f (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2022-01-04T23:23:33,876   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2022-01-04T23:23:33,876   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090 (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2022-01-04T23:23:33,877 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2022-01-04T23:23:33,878 Getting page https://www.piwheels.org/simple/deepspeed/
2022-01-04T23:23:33,880 Found index url https://www.piwheels.org/simple
2022-01-04T23:23:34,101   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,102   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,102   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,103   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,103   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,104   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,105   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,105   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,106   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,106   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,107   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,107   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,108   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,108   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,109   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,109   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,110   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,110   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,110   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2022-01-04T23:23:34,111 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2022-01-04T23:23:34,112 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2022-01-04T23:23:34,156 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2022-01-04T23:23:34,187 Collecting deepspeed==0.5.9
2022-01-04T23:23:34,190   Created temporary directory: /tmp/pip-unpack-mfx8oez_
2022-01-04T23:23:34,293   Downloading deepspeed-0.5.9.tar.gz (510 kB)
2022-01-04T23:23:36,044   Added deepspeed==0.5.9 from https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090 to build tracker '/tmp/pip-req-tracker-iyy3o840'
2022-01-04T23:23:36,046   Running setup.py (path:/tmp/pip-wheel-633lk5sn/deepspeed_fb641535c2f944058d1eea2e0ff7c6f7/setup.py) egg_info for package deepspeed
2022-01-04T23:23:36,047   Created temporary directory: /tmp/pip-pip-egg-info-tnd9zkm1
2022-01-04T23:23:36,047   Preparing metadata (setup.py): started
2022-01-04T23:23:36,048   Running command python setup.py egg_info
2022-01-04T23:23:38,210   fatal: not a git repository (or any of the parent directories): .git
2022-01-04T23:23:38,899   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2022-01-04T23:23:38,900   �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2022-01-04T23:23:38,900   DS_BUILD_OPS=0
2022-01-04T23:23:38,900   �[93m [WARNING] �[0m unable to import torch, please install it first
2022-01-04T23:23:38,901   �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2022-01-04T23:23:38,901   �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2022-01-04T23:23:38,901   �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2022-01-04T23:23:38,902   Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2022-01-04T23:23:38,902   version=0.5.9, git_hash=unknown, git_branch=unknown
2022-01-04T23:23:38,902   install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'torch', 'tqdm']
2022-01-04T23:23:38,903   compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2022-01-04T23:23:38,903   ext_modules=[]
2022-01-04T23:23:38,903   running egg_info
2022-01-04T23:23:38,904   creating /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info
2022-01-04T23:23:38,906   writing /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/PKG-INFO
2022-01-04T23:23:38,911   writing dependency_links to /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/dependency_links.txt
2022-01-04T23:23:38,914   writing entry points to /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/entry_points.txt
2022-01-04T23:23:38,917   writing requirements to /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/requires.txt
2022-01-04T23:23:38,919   writing top-level names to /tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/top_level.txt
2022-01-04T23:23:38,922   writing manifest file '/tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/SOURCES.txt'
2022-01-04T23:23:38,997   reading manifest file '/tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/SOURCES.txt'
2022-01-04T23:23:39,000   reading manifest template 'MANIFEST.in'
2022-01-04T23:23:40,157   warning: no files found matching '*.cc' under directory 'deepspeed'
2022-01-04T23:23:40,578   warning: no files found matching '*.tr' under directory 'csrc'
2022-01-04T23:23:40,695   warning: no files found matching '*.cc' under directory 'csrc'
2022-01-04T23:23:40,695   adding license file 'LICENSE'
2022-01-04T23:23:40,729   writing manifest file '/tmp/pip-pip-egg-info-tnd9zkm1/deepspeed.egg-info/SOURCES.txt'
2022-01-04T23:23:40,733   deepspeed build time = 2.511079788208008 secs
2022-01-04T23:23:40,841   Preparing metadata (setup.py): finished with status 'done'
2022-01-04T23:23:40,851   Source in /tmp/pip-wheel-633lk5sn/deepspeed_fb641535c2f944058d1eea2e0ff7c6f7 has version 0.5.9, which satisfies requirement deepspeed==0.5.9 from https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090
2022-01-04T23:23:40,853   Removed deepspeed==0.5.9 from https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090 from build tracker '/tmp/pip-req-tracker-iyy3o840'
2022-01-04T23:23:40,864 Created temporary directory: /tmp/pip-unpack-ewtkvkv1
2022-01-04T23:23:40,866 Building wheels for collected packages: deepspeed
2022-01-04T23:23:40,874   Created temporary directory: /tmp/pip-wheel-0a53nzg8
2022-01-04T23:23:40,875   Building wheel for deepspeed (setup.py): started
2022-01-04T23:23:40,875   Destination directory: /tmp/pip-wheel-0a53nzg8
2022-01-04T23:23:40,876   Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-633lk5sn/deepspeed_fb641535c2f944058d1eea2e0ff7c6f7/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-633lk5sn/deepspeed_fb641535c2f944058d1eea2e0ff7c6f7/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-0a53nzg8
2022-01-04T23:23:42,342   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2022-01-04T23:23:42,364   �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2022-01-04T23:23:42,388   DS_BUILD_OPS=0
2022-01-04T23:23:42,390   �[93m [WARNING] �[0m unable to import torch, please install it first
2022-01-04T23:23:42,689   �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2022-01-04T23:23:42,854   �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2022-01-04T23:23:42,855   �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2022-01-04T23:23:42,856   Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2022-01-04T23:23:42,895   fatal: not a git repository (or any of the parent directories): .git
2022-01-04T23:23:42,901   version=0.5.9, git_hash=unknown, git_branch=unknown
2022-01-04T23:23:42,902   install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'torch', 'tqdm']
2022-01-04T23:23:42,903   compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2022-01-04T23:23:42,903   ext_modules=[]
2022-01-04T23:23:43,578   running bdist_wheel
2022-01-04T23:23:43,587   running build
2022-01-04T23:23:43,587   running build_py
2022-01-04T23:23:43,597   creating build
2022-01-04T23:23:43,597   creating build/lib
2022-01-04T23:23:43,599   creating build/lib/op_builder
2022-01-04T23:23:43,601   copying op_builder/builder.py -> build/lib/op_builder
2022-01-04T23:23:43,605   copying op_builder/__init__.py -> build/lib/op_builder
2022-01-04T23:23:43,609   copying op_builder/transformer.py -> build/lib/op_builder
2022-01-04T23:23:43,611   copying op_builder/utils.py -> build/lib/op_builder
2022-01-04T23:23:43,614   copying op_builder/fused_adam.py -> build/lib/op_builder
2022-01-04T23:23:43,616   copying op_builder/stochastic_transformer.py -> build/lib/op_builder
2022-01-04T23:23:43,619   copying op_builder/async_io.py -> build/lib/op_builder
2022-01-04T23:23:43,622   copying op_builder/cpu_adam.py -> build/lib/op_builder
2022-01-04T23:23:43,624   copying op_builder/cpu_adagrad.py -> build/lib/op_builder
2022-01-04T23:23:43,627   copying op_builder/quantizer.py -> build/lib/op_builder
2022-01-04T23:23:43,629   copying op_builder/transformer_inference.py -> build/lib/op_builder
2022-01-04T23:23:43,632   copying op_builder/sparse_attn.py -> build/lib/op_builder
2022-01-04T23:23:43,635   copying op_builder/fused_lamb.py -> build/lib/op_builder
2022-01-04T23:23:43,639   creating build/lib/deepspeed
2022-01-04T23:23:43,640   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2022-01-04T23:23:43,643   copying deepspeed/__init__.py -> build/lib/deepspeed
2022-01-04T23:23:43,647   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2022-01-04T23:23:43,650   copying deepspeed/env_report.py -> build/lib/deepspeed
2022-01-04T23:23:43,653   copying deepspeed/constants.py -> build/lib/deepspeed
2022-01-04T23:23:43,657   creating build/lib/deepspeed/autotuning
2022-01-04T23:23:43,658   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,661   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,665   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,669   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,672   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,676   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2022-01-04T23:23:43,683   creating build/lib/deepspeed/ops
2022-01-04T23:23:43,685   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2022-01-04T23:23:43,689   creating build/lib/deepspeed/elasticity
2022-01-04T23:23:43,690   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2022-01-04T23:23:43,693   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2022-01-04T23:23:43,696   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2022-01-04T23:23:43,701   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2022-01-04T23:23:43,704   creating build/lib/deepspeed/inference
2022-01-04T23:23:43,706   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2022-01-04T23:23:43,709   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2022-01-04T23:23:43,714   creating build/lib/deepspeed/profiling
2022-01-04T23:23:43,715   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2022-01-04T23:23:43,718   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2022-01-04T23:23:43,721   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2022-01-04T23:23:43,725   creating build/lib/deepspeed/pipe
2022-01-04T23:23:43,727   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2022-01-04T23:23:43,731   creating build/lib/deepspeed/launcher
2022-01-04T23:23:43,733   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2022-01-04T23:23:43,737   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2022-01-04T23:23:43,739   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2022-01-04T23:23:43,743   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2022-01-04T23:23:43,746   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2022-01-04T23:23:43,751   creating build/lib/deepspeed/utils
2022-01-04T23:23:43,752   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,756   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,759   copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,763   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,766   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,770   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,774   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2022-01-04T23:23:43,782   creating build/lib/deepspeed/runtime
2022-01-04T23:23:43,783   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,786   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,791   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,797   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,802   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,806   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,810   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,814   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,825   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,829   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,834   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,837   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,843   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,847   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2022-01-04T23:23:43,852   creating build/lib/deepspeed/module_inject
2022-01-04T23:23:43,854   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2022-01-04T23:23:43,858   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2022-01-04T23:23:43,862   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2022-01-04T23:23:43,865   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2022-01-04T23:23:43,870   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2022-01-04T23:23:43,875   creating build/lib/deepspeed/moe
2022-01-04T23:23:43,876   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2022-01-04T23:23:43,879   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2022-01-04T23:23:43,882   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2022-01-04T23:23:43,885   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2022-01-04T23:23:43,888   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2022-01-04T23:23:43,893   creating build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,895   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,898   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,901   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,904   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,907   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,909   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2022-01-04T23:23:43,915   creating build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,917   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,922   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,925   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,928   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,931   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,934   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,937   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,940   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,943   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,946   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,949   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,953   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,956   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2022-01-04T23:23:43,961   creating build/lib/deepspeed/ops/transformer
2022-01-04T23:23:43,962   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2022-01-04T23:23:43,965   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2022-01-04T23:23:43,971   creating build/lib/deepspeed/ops/adam
2022-01-04T23:23:43,972   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2022-01-04T23:23:43,976   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2022-01-04T23:23:43,980   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2022-01-04T23:23:43,984   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2022-01-04T23:23:43,988   creating build/lib/deepspeed/ops/lamb
2022-01-04T23:23:43,989   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2022-01-04T23:23:43,993   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2022-01-04T23:23:43,998   creating build/lib/deepspeed/ops/adagrad
2022-01-04T23:23:43,999   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2022-01-04T23:23:44,002   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2022-01-04T23:23:44,008   creating build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,010   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,013   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,016   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,021   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,025   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,029   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,035   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2022-01-04T23:23:44,042   creating build/lib/deepspeed/ops/quantizer
2022-01-04T23:23:44,044   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2022-01-04T23:23:44,047   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2022-01-04T23:23:44,051   creating build/lib/deepspeed/ops/aio
2022-01-04T23:23:44,053   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2022-01-04T23:23:44,057   creating build/lib/deepspeed/ops/transformer/inference
2022-01-04T23:23:44,059   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2022-01-04T23:23:44,062   copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference
2022-01-04T23:23:44,069   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:44,070   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:44,075   creating build/lib/deepspeed/profiling/flops_profiler
2022-01-04T23:23:44,076   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2022-01-04T23:23:44,080   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2022-01-04T23:23:44,087   creating build/lib/deepspeed/runtime/data_pipeline
2022-01-04T23:23:44,088   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2022-01-04T23:23:44,091   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2022-01-04T23:23:44,096   creating build/lib/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:44,097   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:44,101   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:44,104   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:44,112   creating build/lib/deepspeed/runtime/comm
2022-01-04T23:23:44,113   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2022-01-04T23:23:44,116   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2022-01-04T23:23:44,120   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2022-01-04T23:23:44,126   creating build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,127   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,132   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,136   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,143   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,150   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,154   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2022-01-04T23:23:44,162   creating build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,164   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,168   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,173   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,178   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,182   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,187   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,192   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,197   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,202   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2022-01-04T23:23:44,209   creating build/lib/deepspeed/runtime/compression
2022-01-04T23:23:44,210   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2022-01-04T23:23:44,213   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2022-01-04T23:23:44,219   creating build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,220   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,223   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,227   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,236   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,240   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,244   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,250   copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,254   copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,258   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,270   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,274   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,278   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,282   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2022-01-04T23:23:44,288   creating build/lib/deepspeed/runtime/fp16
2022-01-04T23:23:44,289   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2022-01-04T23:23:44,293   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2022-01-04T23:23:44,298   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2022-01-04T23:23:44,303   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2022-01-04T23:23:44,309   creating build/lib/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:44,311   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:44,314   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:44,318   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:44,324   running egg_info
2022-01-04T23:23:44,351   writing deepspeed.egg-info/PKG-INFO
2022-01-04T23:23:44,356   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2022-01-04T23:23:44,360   writing entry points to deepspeed.egg-info/entry_points.txt
2022-01-04T23:23:44,363   writing requirements to deepspeed.egg-info/requires.txt
2022-01-04T23:23:44,366   writing top-level names to deepspeed.egg-info/top_level.txt
2022-01-04T23:23:44,423   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2022-01-04T23:23:44,444   reading manifest template 'MANIFEST.in'
2022-01-04T23:23:45,849   warning: no files found matching '*.cc' under directory 'deepspeed'
2022-01-04T23:23:46,273   warning: no files found matching '*.tr' under directory 'csrc'
2022-01-04T23:23:46,380   warning: no files found matching '*.cc' under directory 'csrc'
2022-01-04T23:23:46,381   adding license file 'LICENSE'
2022-01-04T23:23:46,428   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2022-01-04T23:23:46,465   creating build/lib/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,467   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,471   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,476   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,480   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,484   creating build/lib/deepspeed/ops/csrc
2022-01-04T23:23:46,485   creating build/lib/deepspeed/ops/csrc/adagrad
2022-01-04T23:23:46,488   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2022-01-04T23:23:46,493   creating build/lib/deepspeed/ops/csrc/adam
2022-01-04T23:23:46,495   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2022-01-04T23:23:46,500   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2022-01-04T23:23:46,504   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2022-01-04T23:23:46,508   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2022-01-04T23:23:46,513   creating build/lib/deepspeed/ops/csrc/aio
2022-01-04T23:23:46,513   creating build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,515   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,520   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,524   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,528   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,532   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,536   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:46,540   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,541   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,546   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,550   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,554   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,558   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,563   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,567   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,571   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,575   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:46,579   creating build/lib/deepspeed/ops/csrc/aio/py_test
2022-01-04T23:23:46,580   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2022-01-04T23:23:46,584   creating build/lib/deepspeed/ops/csrc/common
2022-01-04T23:23:46,585   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2022-01-04T23:23:46,589   creating build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,591   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,595   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,599   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,603   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,607   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,611   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,616   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,621   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,625   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,629   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,634   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,637   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,641   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,646   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,650   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,654   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,658   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,663   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,666   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,671   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2022-01-04T23:23:46,675   creating build/lib/deepspeed/ops/csrc/lamb
2022-01-04T23:23:46,677   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2022-01-04T23:23:46,681   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2022-01-04T23:23:46,686   creating build/lib/deepspeed/ops/csrc/quantization
2022-01-04T23:23:46,687   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2022-01-04T23:23:46,691   copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2022-01-04T23:23:46,697   creating build/lib/deepspeed/ops/csrc/sparse_attention
2022-01-04T23:23:46,698   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2022-01-04T23:23:46,703   creating build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,705   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,711   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,717   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,725   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,731   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,737   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,747   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,753   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2022-01-04T23:23:46,759   creating build/lib/deepspeed/ops/csrc/transformer/inference
2022-01-04T23:23:46,761   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,763   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,768   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,774   copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,779   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,785   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:46,791   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:46,792   copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:46,796   copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:46,801   copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:46,805   creating build/lib/deepspeed/ops/csrc/utils
2022-01-04T23:23:46,806   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2022-01-04T23:23:46,810   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:46,815   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:46,819   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:46,866   running build_scripts
2022-01-04T23:23:46,867   creating build/scripts-3.7
2022-01-04T23:23:46,869   copying and adjusting bin/deepspeed -> build/scripts-3.7
2022-01-04T23:23:46,872   copying and adjusting bin/deepspeed.pt -> build/scripts-3.7
2022-01-04T23:23:46,874   copying and adjusting bin/ds -> build/scripts-3.7
2022-01-04T23:23:46,877   copying bin/ds_ssh -> build/scripts-3.7
2022-01-04T23:23:46,880   copying and adjusting bin/ds_report -> build/scripts-3.7
2022-01-04T23:23:46,883   copying and adjusting bin/ds_elastic -> build/scripts-3.7
2022-01-04T23:23:46,884   changing mode of build/scripts-3.7/deepspeed from 644 to 755
2022-01-04T23:23:46,885   changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755
2022-01-04T23:23:46,885   changing mode of build/scripts-3.7/ds from 644 to 755
2022-01-04T23:23:46,886   changing mode of build/scripts-3.7/ds_report from 644 to 755
2022-01-04T23:23:46,886   changing mode of build/scripts-3.7/ds_elastic from 644 to 755
2022-01-04T23:23:46,893   /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
2022-01-04T23:23:46,893     setuptools.SetuptoolsDeprecationWarning,
2022-01-04T23:23:46,897   installing to build/bdist.linux-armv7l/wheel
2022-01-04T23:23:46,898   running install
2022-01-04T23:23:46,900   running install_lib
2022-01-04T23:23:46,906   creating build/bdist.linux-armv7l
2022-01-04T23:23:46,907   creating build/bdist.linux-armv7l/wheel
2022-01-04T23:23:46,910   creating build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,912   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,917   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,920   copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,923   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,926   copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,929   copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,932   copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,935   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,938   copying build/lib/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,941   copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,944   copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,947   copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,950   copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder
2022-01-04T23:23:46,955   creating build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:46,957   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:46,959   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:46,962   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:46,967   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:46,970   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:46,975   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,977   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,980   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,983   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,986   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2022-01-04T23:23:46,990   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:46,991   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:46,995   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:46,998   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:47,001   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:47,004   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:47,008   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2022-01-04T23:23:47,012   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:47,015   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2022-01-04T23:23:47,022   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:47,026   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2022-01-04T23:23:47,030   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,032   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,037   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,041   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,045   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,049   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,053   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,056   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,060   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,063   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,066   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,070   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,073   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,076   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2022-01-04T23:23:47,080   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2022-01-04T23:23:47,082   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2022-01-04T23:23:47,085   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2022-01-04T23:23:47,091   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2022-01-04T23:23:47,092   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2022-01-04T23:23:47,096   copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2022-01-04T23:23:47,101   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2022-01-04T23:23:47,105   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2022-01-04T23:23:47,107   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2022-01-04T23:23:47,110   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2022-01-04T23:23:47,114   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2022-01-04T23:23:47,118   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2022-01-04T23:23:47,122   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2022-01-04T23:23:47,125   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,126   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,131   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,135   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2022-01-04T23:23:47,138   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:47,140   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:47,144   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:47,147   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2022-01-04T23:23:47,153   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,154   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,158   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,163   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,168   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,172   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2022-01-04T23:23:47,177   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,183   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,187   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,196   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,203   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,208   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2022-01-04T23:23:47,214   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2022-01-04T23:23:47,216   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2022-01-04T23:23:47,220   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2022-01-04T23:23:47,224   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2022-01-04T23:23:47,228   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2022-01-04T23:23:47,234   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,235   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,239   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,243   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,246   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,250   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,254   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,257   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,261   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,265   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,269   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,272   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,276   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,279   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,283   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,287   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,290   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,294   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,298   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,302   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,305   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2022-01-04T23:23:47,310   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2022-01-04T23:23:47,312   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2022-01-04T23:23:47,316   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2022-01-04T23:23:47,318   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2022-01-04T23:23:47,323   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2022-01-04T23:23:47,324   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2022-01-04T23:23:47,329   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2022-01-04T23:23:47,333   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2022-01-04T23:23:47,335   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2022-01-04T23:23:47,340   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2022-01-04T23:23:47,342   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2022-01-04T23:23:47,347   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2022-01-04T23:23:47,348   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2022-01-04T23:23:47,352   copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2022-01-04T23:23:47,360   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2022-01-04T23:23:47,362   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2022-01-04T23:23:47,364   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2022-01-04T23:23:47,369   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,370   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,374   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,377   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,381   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,386   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,389   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2022-01-04T23:23:47,394   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,396   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,400   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,404   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,408   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,411   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,415   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,418   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,422   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,426   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2022-01-04T23:23:47,430   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2022-01-04T23:23:47,431   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2022-01-04T23:23:47,435   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2022-01-04T23:23:47,440   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2022-01-04T23:23:47,441   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2022-01-04T23:23:47,445   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2022-01-04T23:23:47,450   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,452   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,455   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,459   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,463   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,469   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:47,470   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:47,474   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:47,477   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:47,482   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2022-01-04T23:23:47,485   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,489   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,495   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2022-01-04T23:23:47,504   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2022-01-04T23:23:47,506   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2022-01-04T23:23:47,509   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2022-01-04T23:23:47,513   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2022-01-04T23:23:47,515   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2022-01-04T23:23:47,518   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:47,524   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2022-01-04T23:23:47,526   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2022-01-04T23:23:47,529   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2022-01-04T23:23:47,533   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2022-01-04T23:23:47,537   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2022-01-04T23:23:47,541   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2022-01-04T23:23:47,543   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2022-01-04T23:23:47,546   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2022-01-04T23:23:47,551   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2022-01-04T23:23:47,553   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2022-01-04T23:23:47,555   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2022-01-04T23:23:47,560   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2022-01-04T23:23:47,561   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2022-01-04T23:23:47,564   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2022-01-04T23:23:47,571   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2022-01-04T23:23:47,574   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:47,578   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2022-01-04T23:23:47,580   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2022-01-04T23:23:47,584   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,586   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,591   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,593   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,598   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,602   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2022-01-04T23:23:47,605   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:47,611   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,612   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,616   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,620   copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,624   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,627   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,631   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,635   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2022-01-04T23:23:47,640   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2022-01-04T23:23:47,645   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,647   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2022-01-04T23:23:47,649   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2022-01-04T23:23:47,652   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2022-01-04T23:23:47,656   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,658   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,665   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:47,666   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:47,669   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:47,673   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2022-01-04T23:23:47,678   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,685   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,692   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2022-01-04T23:23:47,693   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2022-01-04T23:23:47,696   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2022-01-04T23:23:47,701   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2022-01-04T23:23:47,705   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,709   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,714   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,718   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,730   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,735   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,736   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,741   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,744   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,751   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,756   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,760   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2022-01-04T23:23:47,765   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,771   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,772   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,776   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,780   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,784   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,788   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,792   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,795   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,800   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,804   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2022-01-04T23:23:47,808   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,813   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2022-01-04T23:23:47,814   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2022-01-04T23:23:47,817   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2022-01-04T23:23:47,821   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,825   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,830   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,831   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,834   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,837   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,848   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,852   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,855   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,863   copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,867   copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,870   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,884   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,888   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,891   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,896   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2022-01-04T23:23:47,901   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2022-01-04T23:23:47,902   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2022-01-04T23:23:47,905   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2022-01-04T23:23:47,911   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2022-01-04T23:23:47,915   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2022-01-04T23:23:47,921   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:47,922   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:47,925   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:47,930   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2022-01-04T23:23:47,935   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2022-01-04T23:23:47,940   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,941   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,946   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,949   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,953   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,958   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2022-01-04T23:23:47,963   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,964   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,967   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,970   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,974   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,977   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2022-01-04T23:23:47,982   running install_egg_info
2022-01-04T23:23:47,997   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.5.9-py3.7.egg-info
2022-01-04T23:23:48,022   running install_scripts
2022-01-04T23:23:48,139   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data
2022-01-04T23:23:48,139   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,141   copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,145   copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,148   copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,151   copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,154   copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,156   copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts
2022-01-04T23:23:48,159   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/ds_ssh to 755
2022-01-04T23:23:48,159   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/ds_elastic to 755
2022-01-04T23:23:48,160   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/ds to 755
2022-01-04T23:23:48,160   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/ds_report to 755
2022-01-04T23:23:48,161   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/deepspeed to 755
2022-01-04T23:23:48,161   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.data/scripts/deepspeed.pt to 755
2022-01-04T23:23:48,333   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2022-01-04T23:23:48,342   creating build/bdist.linux-armv7l/wheel/deepspeed-0.5.9.dist-info/WHEEL
2022-01-04T23:23:48,347   creating '/tmp/pip-wheel-0a53nzg8/deepspeed-0.5.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2022-01-04T23:23:48,353   adding 'deepspeed/__init__.py'
2022-01-04T23:23:48,356   adding 'deepspeed/constants.py'
2022-01-04T23:23:48,359   adding 'deepspeed/env_report.py'
2022-01-04T23:23:48,361   adding 'deepspeed/git_version_info.py'
2022-01-04T23:23:48,363   adding 'deepspeed/git_version_info_installed.py'
2022-01-04T23:23:48,366   adding 'deepspeed/autotuning/__init__.py'
2022-01-04T23:23:48,378   adding 'deepspeed/autotuning/autotuner.py'
2022-01-04T23:23:48,382   adding 'deepspeed/autotuning/config.py'
2022-01-04T23:23:48,385   adding 'deepspeed/autotuning/constants.py'
2022-01-04T23:23:48,390   adding 'deepspeed/autotuning/scheduler.py'
2022-01-04T23:23:48,395   adding 'deepspeed/autotuning/utils.py'
2022-01-04T23:23:48,398   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2022-01-04T23:23:48,400   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2022-01-04T23:23:48,402   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2022-01-04T23:23:48,404   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2022-01-04T23:23:48,408   adding 'deepspeed/autotuning/tuner/__init__.py'
2022-01-04T23:23:48,410   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2022-01-04T23:23:48,412   adding 'deepspeed/autotuning/tuner/cost_model.py'
2022-01-04T23:23:48,415   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2022-01-04T23:23:48,417   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2022-01-04T23:23:48,420   adding 'deepspeed/autotuning/tuner/utils.py'
2022-01-04T23:23:48,423   adding 'deepspeed/elasticity/__init__.py'
2022-01-04T23:23:48,426   adding 'deepspeed/elasticity/config.py'
2022-01-04T23:23:48,428   adding 'deepspeed/elasticity/constants.py'
2022-01-04T23:23:48,433   adding 'deepspeed/elasticity/elasticity.py'
2022-01-04T23:23:48,436   adding 'deepspeed/inference/__init__.py'
2022-01-04T23:23:48,439   adding 'deepspeed/inference/engine.py'
2022-01-04T23:23:48,443   adding 'deepspeed/launcher/__init__.py'
2022-01-04T23:23:48,445   adding 'deepspeed/launcher/constants.py'
2022-01-04T23:23:48,448   adding 'deepspeed/launcher/launch.py'
2022-01-04T23:23:48,451   adding 'deepspeed/launcher/multinode_runner.py'
2022-01-04T23:23:48,456   adding 'deepspeed/launcher/runner.py'
2022-01-04T23:23:48,460   adding 'deepspeed/module_inject/__init__.py'
2022-01-04T23:23:48,462   adding 'deepspeed/module_inject/inject.py'
2022-01-04T23:23:48,465   adding 'deepspeed/module_inject/module_quantize.py'
2022-01-04T23:23:48,471   adding 'deepspeed/module_inject/replace_module.py'
2022-01-04T23:23:48,474   adding 'deepspeed/module_inject/replace_policy.py'
2022-01-04T23:23:48,477   adding 'deepspeed/moe/__init__.py'
2022-01-04T23:23:48,479   adding 'deepspeed/moe/experts.py'
2022-01-04T23:23:48,482   adding 'deepspeed/moe/layer.py'
2022-01-04T23:23:48,487   adding 'deepspeed/moe/sharded_moe.py'
2022-01-04T23:23:48,490   adding 'deepspeed/moe/utils.py'
2022-01-04T23:23:48,493   adding 'deepspeed/ops/__init__.py'
2022-01-04T23:23:48,496   adding 'deepspeed/ops/adagrad/__init__.py'
2022-01-04T23:23:48,499   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2022-01-04T23:23:48,502   adding 'deepspeed/ops/adam/__init__.py'
2022-01-04T23:23:48,505   adding 'deepspeed/ops/adam/cpu_adam.py'
2022-01-04T23:23:48,508   adding 'deepspeed/ops/adam/fused_adam.py'
2022-01-04T23:23:48,511   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2022-01-04T23:23:48,514   adding 'deepspeed/ops/aio/__init__.py'
2022-01-04T23:23:48,519   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2022-01-04T23:23:48,523   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2022-01-04T23:23:48,525   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2022-01-04T23:23:48,528   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2022-01-04T23:23:48,531   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2022-01-04T23:23:48,537   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2022-01-04T23:23:48,540   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2022-01-04T23:23:48,542   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2022-01-04T23:23:48,545   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2022-01-04T23:23:48,547   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2022-01-04T23:23:48,550   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2022-01-04T23:23:48,553   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2022-01-04T23:23:48,556   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2022-01-04T23:23:48,558   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2022-01-04T23:23:48,560   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2022-01-04T23:23:48,563   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2022-01-04T23:23:48,566   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2022-01-04T23:23:48,568   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2022-01-04T23:23:48,571   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2022-01-04T23:23:48,573   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2022-01-04T23:23:48,576   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2022-01-04T23:23:48,579   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2022-01-04T23:23:48,583   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2022-01-04T23:23:48,585   adding 'deepspeed/ops/csrc/includes/Timer.h'
2022-01-04T23:23:48,587   adding 'deepspeed/ops/csrc/includes/compat.h'
2022-01-04T23:23:48,590   adding 'deepspeed/ops/csrc/includes/context.h'
2022-01-04T23:23:48,593   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2022-01-04T23:23:48,596   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2022-01-04T23:23:48,598   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2022-01-04T23:23:48,601   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2022-01-04T23:23:48,604   adding 'deepspeed/ops/csrc/includes/dropout.h'
2022-01-04T23:23:48,606   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2022-01-04T23:23:48,609   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2022-01-04T23:23:48,611   adding 'deepspeed/ops/csrc/includes/gelu.h'
2022-01-04T23:23:48,614   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2022-01-04T23:23:48,616   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2022-01-04T23:23:48,619   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2022-01-04T23:23:48,621   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2022-01-04T23:23:48,623   adding 'deepspeed/ops/csrc/includes/simd.h'
2022-01-04T23:23:48,626   adding 'deepspeed/ops/csrc/includes/softmax.h'
2022-01-04T23:23:48,628   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2022-01-04T23:23:48,631   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2022-01-04T23:23:48,635   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2022-01-04T23:23:48,639   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2022-01-04T23:23:48,642   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2022-01-04T23:23:48,648   adding 'deepspeed/ops/csrc/quantization/quantizer.cu'
2022-01-04T23:23:48,653   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2022-01-04T23:23:48,657   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2022-01-04T23:23:48,662   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2022-01-04T23:23:48,671   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2022-01-04T23:23:48,675   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2022-01-04T23:23:48,679   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2022-01-04T23:23:48,689   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2022-01-04T23:23:48,695   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2022-01-04T23:23:48,700   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2022-01-04T23:23:48,705   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2022-01-04T23:23:48,708   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2022-01-04T23:23:48,712   adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu'
2022-01-04T23:23:48,716   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2022-01-04T23:23:48,721   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2022-01-04T23:23:48,725   adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h'
2022-01-04T23:23:48,727   adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h'
2022-01-04T23:23:48,730   adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h'
2022-01-04T23:23:48,733   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2022-01-04T23:23:48,736   adding 'deepspeed/ops/lamb/__init__.py'
2022-01-04T23:23:48,739   adding 'deepspeed/ops/lamb/fused_lamb.py'
2022-01-04T23:23:48,743   adding 'deepspeed/ops/op_builder/__init__.py'
2022-01-04T23:23:48,746   adding 'deepspeed/ops/op_builder/async_io.py'
2022-01-04T23:23:48,751   adding 'deepspeed/ops/op_builder/builder.py'
2022-01-04T23:23:48,754   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2022-01-04T23:23:48,756   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2022-01-04T23:23:48,758   adding 'deepspeed/ops/op_builder/fused_adam.py'
2022-01-04T23:23:48,760   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2022-01-04T23:23:48,763   adding 'deepspeed/ops/op_builder/quantizer.py'
2022-01-04T23:23:48,765   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2022-01-04T23:23:48,767   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2022-01-04T23:23:48,769   adding 'deepspeed/ops/op_builder/transformer.py'
2022-01-04T23:23:48,771   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2022-01-04T23:23:48,773   adding 'deepspeed/ops/op_builder/utils.py'
2022-01-04T23:23:48,776   adding 'deepspeed/ops/quantizer/__init__.py'
2022-01-04T23:23:48,778   adding 'deepspeed/ops/quantizer/quantizer.py'
2022-01-04T23:23:48,781   adding 'deepspeed/ops/sparse_attention/__init__.py'
2022-01-04T23:23:48,784   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2022-01-04T23:23:48,793   adding 'deepspeed/ops/sparse_attention/matmul.py'
2022-01-04T23:23:48,797   adding 'deepspeed/ops/sparse_attention/softmax.py'
2022-01-04T23:23:48,801   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2022-01-04T23:23:48,805   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2022-01-04T23:23:48,811   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2022-01-04T23:23:48,815   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2022-01-04T23:23:48,818   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2022-01-04T23:23:48,821   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2022-01-04T23:23:48,823   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2022-01-04T23:23:48,826   adding 'deepspeed/ops/transformer/__init__.py'
2022-01-04T23:23:48,832   adding 'deepspeed/ops/transformer/transformer.py'
2022-01-04T23:23:48,835   adding 'deepspeed/ops/transformer/inference/__init__.py'
2022-01-04T23:23:48,841   adding 'deepspeed/ops/transformer/inference/transformer_inference.py'
2022-01-04T23:23:48,844   adding 'deepspeed/pipe/__init__.py'
2022-01-04T23:23:48,847   adding 'deepspeed/profiling/__init__.py'
2022-01-04T23:23:48,849   adding 'deepspeed/profiling/config.py'
2022-01-04T23:23:48,851   adding 'deepspeed/profiling/constants.py'
2022-01-04T23:23:48,854   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2022-01-04T23:23:48,865   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2022-01-04T23:23:48,870   adding 'deepspeed/runtime/__init__.py'
2022-01-04T23:23:48,879   adding 'deepspeed/runtime/config.py'
2022-01-04T23:23:48,882   adding 'deepspeed/runtime/config_utils.py'
2022-01-04T23:23:48,885   adding 'deepspeed/runtime/constants.py'
2022-01-04T23:23:48,888   adding 'deepspeed/runtime/dataloader.py'
2022-01-04T23:23:48,891   adding 'deepspeed/runtime/eigenvalue.py'
2022-01-04T23:23:48,923   adding 'deepspeed/runtime/engine.py'
2022-01-04T23:23:48,933   adding 'deepspeed/runtime/lr_schedules.py'
2022-01-04T23:23:48,936   adding 'deepspeed/runtime/progressive_layer_drop.py'
2022-01-04T23:23:48,939   adding 'deepspeed/runtime/quantize.py'
2022-01-04T23:23:48,941   adding 'deepspeed/runtime/sparse_tensor.py'
2022-01-04T23:23:48,946   adding 'deepspeed/runtime/state_dict_factory.py'
2022-01-04T23:23:48,954   adding 'deepspeed/runtime/utils.py'
2022-01-04T23:23:48,958   adding 'deepspeed/runtime/weight_quantizer.py'
2022-01-04T23:23:48,961   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2022-01-04T23:23:48,969   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2022-01-04T23:23:48,972   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2022-01-04T23:23:48,975   adding 'deepspeed/runtime/comm/__init__.py'
2022-01-04T23:23:48,978   adding 'deepspeed/runtime/comm/mpi.py'
2022-01-04T23:23:48,982   adding 'deepspeed/runtime/comm/nccl.py'
2022-01-04T23:23:48,985   adding 'deepspeed/runtime/compression/__init__.py'
2022-01-04T23:23:48,987   adding 'deepspeed/runtime/compression/cupy.py'
2022-01-04T23:23:48,989   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2022-01-04T23:23:48,992   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2022-01-04T23:23:48,995   adding 'deepspeed/runtime/fp16/__init__.py'
2022-01-04T23:23:49,000   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2022-01-04T23:23:49,004   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2022-01-04T23:23:49,009   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2022-01-04T23:23:49,012   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2022-01-04T23:23:49,017   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2022-01-04T23:23:49,023   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2022-01-04T23:23:49,026   adding 'deepspeed/runtime/pipe/__init__.py'
2022-01-04T23:23:49,040   adding 'deepspeed/runtime/pipe/engine.py'
2022-01-04T23:23:49,049   adding 'deepspeed/runtime/pipe/module.py'
2022-01-04T23:23:49,052   adding 'deepspeed/runtime/pipe/p2p.py'
2022-01-04T23:23:49,056   adding 'deepspeed/runtime/pipe/schedule.py'
2022-01-04T23:23:49,061   adding 'deepspeed/runtime/pipe/topology.py'
2022-01-04T23:23:49,065   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2022-01-04T23:23:49,067   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2022-01-04T23:23:49,070   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2022-01-04T23:23:49,072   adding 'deepspeed/runtime/swap_tensor/constants.py'
2022-01-04T23:23:49,077   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2022-01-04T23:23:49,081   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2022-01-04T23:23:49,086   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2022-01-04T23:23:49,090   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2022-01-04T23:23:49,094   adding 'deepspeed/runtime/swap_tensor/utils.py'
2022-01-04T23:23:49,097   adding 'deepspeed/runtime/zero/__init__.py'
2022-01-04T23:23:49,100   adding 'deepspeed/runtime/zero/config.py'
2022-01-04T23:23:49,103   adding 'deepspeed/runtime/zero/constants.py'
2022-01-04T23:23:49,107   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2022-01-04T23:23:49,110   adding 'deepspeed/runtime/zero/linear.py'
2022-01-04T23:23:49,113   adding 'deepspeed/runtime/zero/offload_config.py'
2022-01-04T23:23:49,115   adding 'deepspeed/runtime/zero/offload_constants.py'
2022-01-04T23:23:49,130   adding 'deepspeed/runtime/zero/partition_parameters.py'
2022-01-04T23:23:49,170   adding 'deepspeed/runtime/zero/stage3.py'
2022-01-04T23:23:49,199   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2022-01-04T23:23:49,203   adding 'deepspeed/runtime/zero/test.py'
2022-01-04T23:23:49,207   adding 'deepspeed/runtime/zero/tiling.py'
2022-01-04T23:23:49,210   adding 'deepspeed/runtime/zero/utils.py'
2022-01-04T23:23:49,213   adding 'deepspeed/utils/__init__.py'
2022-01-04T23:23:49,216   adding 'deepspeed/utils/debug.py'
2022-01-04T23:23:49,219   adding 'deepspeed/utils/distributed.py'
2022-01-04T23:23:49,223   adding 'deepspeed/utils/groups.py'
2022-01-04T23:23:49,226   adding 'deepspeed/utils/logging.py'
2022-01-04T23:23:49,229   adding 'deepspeed/utils/timer.py'
2022-01-04T23:23:49,234   adding 'deepspeed/utils/zero_to_fp32.py'
2022-01-04T23:23:49,239   adding 'deepspeed-0.5.9.data/scripts/deepspeed'
2022-01-04T23:23:49,241   adding 'deepspeed-0.5.9.data/scripts/deepspeed.pt'
2022-01-04T23:23:49,243   adding 'deepspeed-0.5.9.data/scripts/ds'
2022-01-04T23:23:49,245   adding 'deepspeed-0.5.9.data/scripts/ds_elastic'
2022-01-04T23:23:49,247   adding 'deepspeed-0.5.9.data/scripts/ds_report'
2022-01-04T23:23:49,249   adding 'deepspeed-0.5.9.data/scripts/ds_ssh'
2022-01-04T23:23:49,255   adding 'op_builder/__init__.py'
2022-01-04T23:23:49,257   adding 'op_builder/async_io.py'
2022-01-04T23:23:49,263   adding 'op_builder/builder.py'
2022-01-04T23:23:49,266   adding 'op_builder/cpu_adagrad.py'
2022-01-04T23:23:49,268   adding 'op_builder/cpu_adam.py'
2022-01-04T23:23:49,270   adding 'op_builder/fused_adam.py'
2022-01-04T23:23:49,272   adding 'op_builder/fused_lamb.py'
2022-01-04T23:23:49,274   adding 'op_builder/quantizer.py'
2022-01-04T23:23:49,277   adding 'op_builder/sparse_attn.py'
2022-01-04T23:23:49,279   adding 'op_builder/stochastic_transformer.py'
2022-01-04T23:23:49,281   adding 'op_builder/transformer.py'
2022-01-04T23:23:49,283   adding 'op_builder/transformer_inference.py'
2022-01-04T23:23:49,285   adding 'op_builder/utils.py'
2022-01-04T23:23:49,287   adding 'deepspeed-0.5.9.dist-info/LICENSE'
2022-01-04T23:23:49,292   adding 'deepspeed-0.5.9.dist-info/METADATA'
2022-01-04T23:23:49,294   adding 'deepspeed-0.5.9.dist-info/WHEEL'
2022-01-04T23:23:49,296   adding 'deepspeed-0.5.9.dist-info/entry_points.txt'
2022-01-04T23:23:49,298   adding 'deepspeed-0.5.9.dist-info/top_level.txt'
2022-01-04T23:23:49,303   adding 'deepspeed-0.5.9.dist-info/RECORD'
2022-01-04T23:23:49,335   removing build/bdist.linux-armv7l/wheel
2022-01-04T23:23:49,474   deepspeed build time = 6.570424795150757 secs
2022-01-04T23:23:49,601   Building wheel for deepspeed (setup.py): finished with status 'done'
2022-01-04T23:23:49,618   Created wheel for deepspeed: filename=deepspeed-0.5.9-py3-none-any.whl size=524292 sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e
2022-01-04T23:23:49,619   Stored in directory: /tmp/pip-ephem-wheel-cache-b5o55jy1/wheels/06/00/64/2aeb9e77c46196d95544ae3c384735c2a819c6f101992c76ab
2022-01-04T23:23:49,664 Successfully built deepspeed
2022-01-04T23:23:49,704 Removed build tracker: '/tmp/pip-req-tracker-iyy3o840'