2022-08-25T19:43:48,739 Created temporary directory: /tmp/pip-ephem-wheel-cache-bfyt7b8f 2022-08-25T19:43:48,745 Created temporary directory: /tmp/pip-build-tracker-x24n3plt 2022-08-25T19:43:48,746 Initialized build tracking at /tmp/pip-build-tracker-x24n3plt 2022-08-25T19:43:48,747 Created build tracker: /tmp/pip-build-tracker-x24n3plt 2022-08-25T19:43:48,747 Entered build tracker: /tmp/pip-build-tracker-x24n3plt 2022-08-25T19:43:48,748 Created temporary directory: /tmp/pip-wheel-z7s0pcxj 2022-08-25T19:43:48,815 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-08-25T19:43:48,822 2 location(s) to search for versions of deepspeed: 2022-08-25T19:43:48,822 * https://pypi.org/simple/deepspeed/ 2022-08-25T19:43:48,822 * https://www.piwheels.org/simple/deepspeed/ 2022-08-25T19:43:48,824 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2022-08-25T19:43:48,825 Getting page https://pypi.org/simple/deepspeed/ 2022-08-25T19:43:48,828 Found index url https://pypi.org/simple 2022-08-25T19:43:49,054 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/) 2022-08-25T19:43:49,054 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2022-08-25T19:43:49,055 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/) 2022-08-25T19:43:49,056 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2022-08-25T19:43:49,057 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/) 2022-08-25T19:43:49,057 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2022-08-25T19:43:49,058 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/) 2022-08-25T19:43:49,059 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2022-08-25T19:43:49,059 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/) 2022-08-25T19:43:49,060 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2022-08-25T19:43:49,061 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2022-08-25T19:43:49,061 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2022-08-25T19:43:49,062 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2022-08-25T19:43:49,063 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2022-08-25T19:43:49,064 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2022-08-25T19:43:49,064 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2022-08-25T19:43:49,065 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2022-08-25T19:43:49,066 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2022-08-25T19:43:49,066 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2022-08-25T19:43:49,067 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2022-08-25T19:43:49,068 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2022-08-25T19:43:49,069 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2022-08-25T19:43:49,069 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2022-08-25T19:43:49,070 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2022-08-25T19:43:49,071 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2022-08-25T19:43:49,071 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2022-08-25T19:43:49,072 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2022-08-25T19:43:49,073 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2022-08-25T19:43:49,074 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2022-08-25T19:43:49,074 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2022-08-25T19:43:49,075 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2022-08-25T19:43:49,076 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2022-08-25T19:43:49,076 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2022-08-25T19:43:49,077 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2022-08-25T19:43:49,078 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz#sha256=72862cb6c1e00f199155046915129d801143e8fecc48e98f301a5f5aa32633fb (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2022-08-25T19:43:49,079 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz#sha256=a0b9498da1e23aeefd4cfc74cdc8af3055df1ec3f65cffd226f1cf4b28b55aca (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2022-08-25T19:43:49,079 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz#sha256=067d95579eeb13a04a4cb49c83ae5c570dac5e37f5578fda656b177a06e720f9 (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2022-08-25T19:43:49,080 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz#sha256=dfa76539a56f36eeff6f3b1e5483f624f7ffc9551188660a65f370e375f7987d (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2022-08-25T19:43:49,081 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz#sha256=f8c083db2bd1594b928458ac4cef5e8f1599e7b764d475d61a3d5aa94563a287 (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2022-08-25T19:43:49,081 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz#sha256=2cdb8d9fe82bc3ff10d181b5d4419e857622c643cf9bfa05141ceb83d89cfcdb (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2022-08-25T19:43:49,082 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz#sha256=03fc7c89b00cfb8abad2af98c662f22032bb9550813908548dbd47499be75a06 (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2022-08-25T19:43:49,083 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz#sha256=5db284052e17f937500b1700ce93aec1bde4527ad2f9acb0b85e9db979e438c1 (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2022-08-25T19:43:49,083 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz#sha256=f078ddd22e14925e147509baae702727ea38c1c2e878c72583f0891c5abf956f (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2022-08-25T19:43:49,084 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz#sha256=10001b6c14398bacd5c9f39581e91d336e5d452133088e35c545af3ce40179d7 (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2022-08-25T19:43:49,085 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz#sha256=7c43d151b51d346a430034e77764097c4af7637217c08503291c48c37ae7d090 (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2022-08-25T19:43:49,086 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz#sha256=871623ee95b2655595195b99a59f1eb3cf2eeb395fb3418d824eb62a350f7b83 (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2022-08-25T19:43:49,087 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz#sha256=98502df63dc53332cde601d644b29f2cf0234ea9d4d21c65b0d1d6db892e5fe1 (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2022-08-25T19:43:49,087 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz#sha256=b3143b593f1b63c067aaaebd120e9d97915effbf4bf4f593840546cec2514ff1 (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2022-08-25T19:43:49,088 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz#sha256=eb5ed5a12ad8a1388ad15358204f05d833ade1e9af0530e6e6aa613bead67a49 (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2022-08-25T19:43:49,089 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz#sha256=ad2de46d6609798fa3525ef8eb0e1ddfb66e06983b0af967b462b1511f21cc9c (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2022-08-25T19:43:49,089 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz#sha256=97bf7b8966f264de38508057af28c768bccaba7aecd5778d5cf5f2bc97d36957 (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2022-08-25T19:43:49,090 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz#sha256=14ffd0c5a9d20d6535fe650c15e0bdd1265890df7ae6dbbd202311c9caa7a47c (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2022-08-25T19:43:49,091 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz#sha256=85824e1901b02bf0ebf5902c17e2dad2377f50904a4927f59308f73230c162f4 (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2022-08-25T19:43:49,092 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz#sha256=0ee39e1b01fe4ecbd89e7c4358db6327cee6fe52a201157999e1c995985453a4 (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2022-08-25T19:43:49,092 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz#sha256=630923825a38d10096e3eb53bafc62f7ec20b6b95e6dbdd4dc2eec26b1be42ae (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2022-08-25T19:43:49,093 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz#sha256=862b2e5261ecd38fc8a110fd26b76bb223470fabac6a682af73bb54b5624c231 (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2022-08-25T19:43:49,094 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2022-08-25T19:43:49,095 Getting page https://www.piwheels.org/simple/deepspeed/ 2022-08-25T19:43:49,097 Found index url https://www.piwheels.org/simple 2022-08-25T19:43:49,337 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,338 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,338 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,339 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,339 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,340 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,340 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,341 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,341 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,342 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,343 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,343 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,344 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,344 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,345 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,345 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,346 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,346 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,347 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,347 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,348 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,348 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,349 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,349 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,350 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,350 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2022-08-25T19:43:49,351 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2022-08-25T19:43:49,352 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2022-08-25T19:43:49,402 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2022-08-25T19:43:49,434 Collecting deepspeed==0.7.2 2022-08-25T19:43:49,439 Created temporary directory: /tmp/pip-unpack-myd3b1qr 2022-08-25T19:43:49,689 Downloading deepspeed-0.7.2.tar.gz (704 kB) 2022-08-25T19:43:52,067 Added deepspeed==0.7.2 from https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz#sha256=862b2e5261ecd38fc8a110fd26b76bb223470fabac6a682af73bb54b5624c231 to build tracker '/tmp/pip-build-tracker-x24n3plt' 2022-08-25T19:43:52,070 Running setup.py (path:/tmp/pip-wheel-z7s0pcxj/deepspeed_f6281c7f4bd24f98b5a5d5a709a758c7/setup.py) egg_info for package deepspeed 2022-08-25T19:43:52,071 Created temporary directory: /tmp/pip-pip-egg-info-trzeuejn 2022-08-25T19:43:52,072 Preparing metadata (setup.py): started 2022-08-25T19:43:52,074 Running command python setup.py egg_info 2022-08-25T19:43:55,227 fatal: not a git repository (or any of the parent directories): .git 2022-08-25T19:44:01,210 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-08-25T19:44:01,211  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-08-25T19:44:01,211 DS_BUILD_OPS=0 2022-08-25T19:44:01,211  [WARNING]  unable to import torch, please install it first 2022-08-25T19:44:01,212  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-08-25T19:44:01,212  [WARNING]  async_io: please install the libaio-dev package with apt 2022-08-25T19:44:01,212  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-08-25T19:44:01,213  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-08-25T19:44:01,213 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-08-25T19:44:01,214 version=0.7.2, git_hash=unknown, git_branch=unknown 2022-08-25T19:44:01,214 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-08-25T19:44:01,214 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-08-25T19:44:01,215 ext_modules=[] 2022-08-25T19:44:01,215 running egg_info 2022-08-25T19:44:01,215 creating /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info 2022-08-25T19:44:01,919 writing /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/PKG-INFO 2022-08-25T19:44:02,517 writing dependency_links to /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/dependency_links.txt 2022-08-25T19:44:04,298 writing entry points to /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/entry_points.txt 2022-08-25T19:44:05,488 writing requirements to /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/requires.txt 2022-08-25T19:44:06,083 writing top-level names to /tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/top_level.txt 2022-08-25T19:44:06,086 writing manifest file '/tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/SOURCES.txt' 2022-08-25T19:44:07,283 reading manifest file '/tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/SOURCES.txt' 2022-08-25T19:44:07,286 reading manifest template 'MANIFEST.in' 2022-08-25T19:44:08,317 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-08-25T19:44:09,070 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-08-25T19:44:09,570 warning: no files found matching '*.tr' under directory 'csrc' 2022-08-25T19:44:09,700 warning: no files found matching '*.cc' under directory 'csrc' 2022-08-25T19:44:09,734 adding license file 'LICENSE' 2022-08-25T19:44:09,771 writing manifest file '/tmp/pip-pip-egg-info-trzeuejn/deepspeed.egg-info/SOURCES.txt' 2022-08-25T19:44:09,774 deepspeed build time = 14.536267042160034 secs 2022-08-25T19:44:10,003 Preparing metadata (setup.py): finished with status 'done' 2022-08-25T19:44:10,018 Source in /tmp/pip-wheel-z7s0pcxj/deepspeed_f6281c7f4bd24f98b5a5d5a709a758c7 has version 0.7.2, which satisfies requirement deepspeed==0.7.2 from https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz#sha256=862b2e5261ecd38fc8a110fd26b76bb223470fabac6a682af73bb54b5624c231 2022-08-25T19:44:10,020 Removed deepspeed==0.7.2 from https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz#sha256=862b2e5261ecd38fc8a110fd26b76bb223470fabac6a682af73bb54b5624c231 from build tracker '/tmp/pip-build-tracker-x24n3plt' 2022-08-25T19:44:10,031 Created temporary directory: /tmp/pip-unpack-0icgd5hj 2022-08-25T19:44:10,033 Building wheels for collected packages: deepspeed 2022-08-25T19:44:10,043 Created temporary directory: /tmp/pip-wheel-j8qlmtc9 2022-08-25T19:44:10,044 Building wheel for deepspeed (setup.py): started 2022-08-25T19:44:10,046 Destination directory: /tmp/pip-wheel-j8qlmtc9 2022-08-25T19:44:10,046 Running command python setup.py bdist_wheel 2022-08-25T19:44:12,602 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-08-25T19:44:12,621  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-08-25T19:44:12,661 DS_BUILD_OPS=0 2022-08-25T19:44:12,664  [WARNING]  unable to import torch, please install it first 2022-08-25T19:44:12,967  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-08-25T19:44:13,137  [WARNING]  async_io: please install the libaio-dev package with apt 2022-08-25T19:44:13,139  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-08-25T19:44:13,143  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-08-25T19:44:13,144 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-08-25T19:44:13,189 fatal: not a git repository (or any of the parent directories): .git 2022-08-25T19:44:13,194 version=0.7.2, git_hash=unknown, git_branch=unknown 2022-08-25T19:44:13,197 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-08-25T19:44:13,198 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-08-25T19:44:13,199 ext_modules=[] 2022-08-25T19:44:18,665 running bdist_wheel 2022-08-25T19:44:19,004 running build 2022-08-25T19:44:19,004 running build_py 2022-08-25T19:44:19,716 creating build 2022-08-25T19:44:19,717 creating build/lib 2022-08-25T19:44:19,719 creating build/lib/benchmarks 2022-08-25T19:44:19,721 copying benchmarks/__init__.py -> build/lib/benchmarks 2022-08-25T19:44:19,727 creating build/lib/deepspeed 2022-08-25T19:44:19,729 copying deepspeed/__init__.py -> build/lib/deepspeed 2022-08-25T19:44:19,734 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2022-08-25T19:44:19,737 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2022-08-25T19:44:19,741 copying deepspeed/constants.py -> build/lib/deepspeed 2022-08-25T19:44:19,744 copying deepspeed/env_report.py -> build/lib/deepspeed 2022-08-25T19:44:19,754 creating build/lib/benchmarks/communication 2022-08-25T19:44:19,756 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,759 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,762 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,766 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,770 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,773 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,777 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,781 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,785 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2022-08-25T19:44:19,790 creating build/lib/deepspeed/runtime 2022-08-25T19:44:19,792 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,796 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,800 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,803 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,807 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,812 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,817 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,822 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,826 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,830 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,836 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,840 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,844 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,856 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,861 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2022-08-25T19:44:19,867 creating build/lib/deepspeed/compression 2022-08-25T19:44:19,868 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,872 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,876 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,880 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,884 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,888 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,894 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,898 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2022-08-25T19:44:19,904 creating build/lib/deepspeed/moe 2022-08-25T19:44:19,905 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,908 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,912 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,916 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,919 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,924 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2022-08-25T19:44:19,929 creating build/lib/deepspeed/elasticity 2022-08-25T19:44:19,931 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,934 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,939 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,943 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,946 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,950 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2022-08-25T19:44:19,955 creating build/lib/deepspeed/launcher 2022-08-25T19:44:19,957 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2022-08-25T19:44:19,960 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2022-08-25T19:44:19,965 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2022-08-25T19:44:19,968 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2022-08-25T19:44:19,972 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2022-08-25T19:44:19,978 creating build/lib/deepspeed/pipe 2022-08-25T19:44:19,979 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2022-08-25T19:44:19,984 creating build/lib/deepspeed/ops 2022-08-25T19:44:19,985 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2022-08-25T19:44:19,990 creating build/lib/deepspeed/profiling 2022-08-25T19:44:19,992 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2022-08-25T19:44:19,995 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2022-08-25T19:44:19,998 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2022-08-25T19:44:20,002 creating build/lib/deepspeed/inference 2022-08-25T19:44:20,004 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2022-08-25T19:44:20,008 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2022-08-25T19:44:20,014 creating build/lib/deepspeed/monitor 2022-08-25T19:44:20,016 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,020 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,024 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,028 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,032 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,036 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,040 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,044 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2022-08-25T19:44:20,050 creating build/lib/deepspeed/utils 2022-08-25T19:44:20,052 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,056 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,063 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,068 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,072 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,076 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,081 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,085 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,090 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,094 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,098 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2022-08-25T19:44:20,103 creating build/lib/deepspeed/module_inject 2022-08-25T19:44:20,105 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,110 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,114 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,118 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,124 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,128 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,136 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2022-08-25T19:44:20,141 creating build/lib/deepspeed/autotuning 2022-08-25T19:44:20,143 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,149 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,152 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,158 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,162 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,167 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2022-08-25T19:44:20,172 creating build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,174 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,177 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,181 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,185 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,188 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,191 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,195 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,198 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2022-08-25T19:44:20,203 creating build/lib/deepspeed/nebula 2022-08-25T19:44:20,205 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2022-08-25T19:44:20,207 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2022-08-25T19:44:20,211 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2022-08-25T19:44:20,216 creating build/lib/deepspeed/comm 2022-08-25T19:44:20,217 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,221 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,225 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,230 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,233 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,236 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,240 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2022-08-25T19:44:20,245 creating build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,247 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,250 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,255 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,259 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,262 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,266 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,270 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,273 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,277 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-08-25T19:44:20,283 creating build/lib/deepspeed/runtime/compression 2022-08-25T19:44:20,285 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2022-08-25T19:44:20,288 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2022-08-25T19:44:20,293 creating build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,294 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,298 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,301 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,306 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,311 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,315 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2022-08-25T19:44:20,323 creating build/lib/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:20,324 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:20,328 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:20,330 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:20,334 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:20,338 creating build/lib/deepspeed/runtime/fp16 2022-08-25T19:44:20,340 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2022-08-25T19:44:20,343 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-08-25T19:44:20,347 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-08-25T19:44:20,352 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2022-08-25T19:44:20,357 creating build/lib/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:20,359 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:20,362 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:20,367 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:20,371 creating build/lib/deepspeed/runtime/comm 2022-08-25T19:44:20,373 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2022-08-25T19:44:20,377 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2022-08-25T19:44:20,380 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2022-08-25T19:44:20,383 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2022-08-25T19:44:20,388 creating build/lib/deepspeed/runtime/data_pipeline 2022-08-25T19:44:20,390 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2022-08-25T19:44:20,393 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2022-08-25T19:44:20,399 creating build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,400 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,404 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,407 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,412 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,420 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,425 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,428 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,437 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,442 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,446 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,449 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,458 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,462 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2022-08-25T19:44:20,468 creating build/lib/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:20,470 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:20,473 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:20,479 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:20,485 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:20,490 creating build/lib/deepspeed/ops/lamb 2022-08-25T19:44:20,491 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2022-08-25T19:44:20,495 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2022-08-25T19:44:20,500 creating build/lib/deepspeed/ops/adam 2022-08-25T19:44:20,502 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2022-08-25T19:44:20,505 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2022-08-25T19:44:20,509 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2022-08-25T19:44:20,512 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2022-08-25T19:44:20,517 creating build/lib/deepspeed/ops/aio 2022-08-25T19:44:20,519 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2022-08-25T19:44:20,525 creating build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,527 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,530 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,534 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,537 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,540 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,543 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,547 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,550 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,553 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,559 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,562 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,565 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,568 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2022-08-25T19:44:20,573 creating build/lib/deepspeed/ops/quantizer 2022-08-25T19:44:20,574 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2022-08-25T19:44:20,578 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2022-08-25T19:44:20,582 creating build/lib/deepspeed/ops/adagrad 2022-08-25T19:44:20,583 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2022-08-25T19:44:20,587 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2022-08-25T19:44:20,593 creating build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,594 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,599 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,605 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,608 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,613 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,618 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,622 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-08-25T19:44:20,627 creating build/lib/deepspeed/ops/transformer 2022-08-25T19:44:20,628 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2022-08-25T19:44:20,631 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2022-08-25T19:44:20,637 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:20,639 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:20,644 creating build/lib/deepspeed/ops/transformer/inference 2022-08-25T19:44:20,646 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2022-08-25T19:44:20,649 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-08-25T19:44:20,655 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-08-25T19:44:20,661 creating build/lib/deepspeed/profiling/flops_profiler 2022-08-25T19:44:20,662 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2022-08-25T19:44:20,668 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2022-08-25T19:44:20,672 creating build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,674 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,678 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,681 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,685 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,688 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,692 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-08-25T19:44:20,696 running egg_info 2022-08-25T19:44:22,111 writing deepspeed.egg-info/PKG-INFO 2022-08-25T19:44:22,709 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2022-08-25T19:44:24,493 writing entry points to deepspeed.egg-info/entry_points.txt 2022-08-25T19:44:25,687 writing requirements to deepspeed.egg-info/requires.txt 2022-08-25T19:44:26,285 writing top-level names to deepspeed.egg-info/top_level.txt 2022-08-25T19:44:26,468 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-08-25T19:44:26,551 reading manifest template 'MANIFEST.in' 2022-08-25T19:44:27,536 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-08-25T19:44:28,251 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-08-25T19:44:28,738 warning: no files found matching '*.tr' under directory 'csrc' 2022-08-25T19:44:28,857 warning: no files found matching '*.cc' under directory 'csrc' 2022-08-25T19:44:28,888 adding license file 'LICENSE' 2022-08-25T19:44:28,944 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-08-25T19:44:28,956 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,957 ############################ 2022-08-25T19:44:28,957 # Package would be ignored # 2022-08-25T19:44:28,958 ############################ 2022-08-25T19:44:28,958 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, however it is 2022-08-25T19:44:28,958 included in the distribution as "data". 2022-08-25T19:44:28,959 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,959 therefore is considered deprecated). 2022-08-25T19:44:28,960 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2022-08-25T19:44:28,960 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,960 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,961 documentation page. 2022-08-25T19:44:28,962 !! 2022-08-25T19:44:28,962 check.warn(importable) 2022-08-25T19:44:28,963 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,964 ############################ 2022-08-25T19:44:28,964 # Package would be ignored # 2022-08-25T19:44:28,964 ############################ 2022-08-25T19:44:28,965 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, however it is 2022-08-25T19:44:28,965 included in the distribution as "data". 2022-08-25T19:44:28,965 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,966 therefore is considered deprecated). 2022-08-25T19:44:28,966 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2022-08-25T19:44:28,966 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,967 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,967 documentation page. 2022-08-25T19:44:28,968 !! 2022-08-25T19:44:28,969 check.warn(importable) 2022-08-25T19:44:28,969 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,970 ############################ 2022-08-25T19:44:28,970 # Package would be ignored # 2022-08-25T19:44:28,971 ############################ 2022-08-25T19:44:28,971 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, however it is 2022-08-25T19:44:28,971 included in the distribution as "data". 2022-08-25T19:44:28,971 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,972 therefore is considered deprecated). 2022-08-25T19:44:28,972 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2022-08-25T19:44:28,973 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,973 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,974 documentation page. 2022-08-25T19:44:28,975 !! 2022-08-25T19:44:28,975 check.warn(importable) 2022-08-25T19:44:28,975 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,976 ############################ 2022-08-25T19:44:28,977 # Package would be ignored # 2022-08-25T19:44:28,977 ############################ 2022-08-25T19:44:28,977 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, however it is 2022-08-25T19:44:28,977 included in the distribution as "data". 2022-08-25T19:44:28,978 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,978 therefore is considered deprecated). 2022-08-25T19:44:28,979 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2022-08-25T19:44:28,979 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,979 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,980 documentation page. 2022-08-25T19:44:28,980 !! 2022-08-25T19:44:28,981 check.warn(importable) 2022-08-25T19:44:28,981 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,982 ############################ 2022-08-25T19:44:28,982 # Package would be ignored # 2022-08-25T19:44:28,983 ############################ 2022-08-25T19:44:28,983 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, however it is 2022-08-25T19:44:28,983 included in the distribution as "data". 2022-08-25T19:44:28,984 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,984 therefore is considered deprecated). 2022-08-25T19:44:28,984 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2022-08-25T19:44:28,985 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,985 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,986 documentation page. 2022-08-25T19:44:28,986 !! 2022-08-25T19:44:28,987 check.warn(importable) 2022-08-25T19:44:28,987 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,988 ############################ 2022-08-25T19:44:28,989 # Package would be ignored # 2022-08-25T19:44:28,989 ############################ 2022-08-25T19:44:28,989 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, however it is 2022-08-25T19:44:28,990 included in the distribution as "data". 2022-08-25T19:44:28,990 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,990 therefore is considered deprecated). 2022-08-25T19:44:28,991 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2022-08-25T19:44:28,991 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,991 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,992 documentation page. 2022-08-25T19:44:28,993 !! 2022-08-25T19:44:28,993 check.warn(importable) 2022-08-25T19:44:28,994 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:28,994 ############################ 2022-08-25T19:44:28,995 # Package would be ignored # 2022-08-25T19:44:28,995 ############################ 2022-08-25T19:44:28,995 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, however it is 2022-08-25T19:44:28,995 included in the distribution as "data". 2022-08-25T19:44:28,996 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:28,996 therefore is considered deprecated). 2022-08-25T19:44:28,997 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2022-08-25T19:44:28,997 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:28,997 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:28,998 documentation page. 2022-08-25T19:44:28,999 !! 2022-08-25T19:44:28,999 check.warn(importable) 2022-08-25T19:44:28,999 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,000 ############################ 2022-08-25T19:44:29,001 # Package would be ignored # 2022-08-25T19:44:29,001 ############################ 2022-08-25T19:44:29,001 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, however it is 2022-08-25T19:44:29,001 included in the distribution as "data". 2022-08-25T19:44:29,002 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,002 therefore is considered deprecated). 2022-08-25T19:44:29,003 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2022-08-25T19:44:29,003 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,004 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,004 documentation page. 2022-08-25T19:44:29,006 !! 2022-08-25T19:44:29,006 check.warn(importable) 2022-08-25T19:44:29,007 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,009 ############################ 2022-08-25T19:44:29,010 # Package would be ignored # 2022-08-25T19:44:29,010 ############################ 2022-08-25T19:44:29,011 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, however it is 2022-08-25T19:44:29,011 included in the distribution as "data". 2022-08-25T19:44:29,011 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,012 therefore is considered deprecated). 2022-08-25T19:44:29,013 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2022-08-25T19:44:29,013 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,014 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,015 documentation page. 2022-08-25T19:44:29,016 !! 2022-08-25T19:44:29,018 check.warn(importable) 2022-08-25T19:44:29,018 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,020 ############################ 2022-08-25T19:44:29,020 # Package would be ignored # 2022-08-25T19:44:29,021 ############################ 2022-08-25T19:44:29,021 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, however it is 2022-08-25T19:44:29,022 included in the distribution as "data". 2022-08-25T19:44:29,022 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,023 therefore is considered deprecated). 2022-08-25T19:44:29,024 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2022-08-25T19:44:29,024 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,026 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,027 documentation page. 2022-08-25T19:44:29,028 !! 2022-08-25T19:44:29,029 check.warn(importable) 2022-08-25T19:44:29,030 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,032 ############################ 2022-08-25T19:44:29,032 # Package would be ignored # 2022-08-25T19:44:29,033 ############################ 2022-08-25T19:44:29,033 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, however it is 2022-08-25T19:44:29,034 included in the distribution as "data". 2022-08-25T19:44:29,034 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,034 therefore is considered deprecated). 2022-08-25T19:44:29,035 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2022-08-25T19:44:29,036 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,037 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,037 documentation page. 2022-08-25T19:44:29,039 !! 2022-08-25T19:44:29,040 check.warn(importable) 2022-08-25T19:44:29,040 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,042 ############################ 2022-08-25T19:44:29,042 # Package would be ignored # 2022-08-25T19:44:29,043 ############################ 2022-08-25T19:44:29,043 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, however it is 2022-08-25T19:44:29,044 included in the distribution as "data". 2022-08-25T19:44:29,044 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,045 therefore is considered deprecated). 2022-08-25T19:44:29,046 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2022-08-25T19:44:29,046 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,047 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,047 documentation page. 2022-08-25T19:44:29,049 !! 2022-08-25T19:44:29,050 check.warn(importable) 2022-08-25T19:44:29,050 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,051 ############################ 2022-08-25T19:44:29,052 # Package would be ignored # 2022-08-25T19:44:29,052 ############################ 2022-08-25T19:44:29,053 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, however it is 2022-08-25T19:44:29,053 included in the distribution as "data". 2022-08-25T19:44:29,054 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,054 therefore is considered deprecated). 2022-08-25T19:44:29,055 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2022-08-25T19:44:29,056 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,057 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,057 documentation page. 2022-08-25T19:44:29,059 !! 2022-08-25T19:44:29,060 check.warn(importable) 2022-08-25T19:44:29,060 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,062 ############################ 2022-08-25T19:44:29,062 # Package would be ignored # 2022-08-25T19:44:29,062 ############################ 2022-08-25T19:44:29,063 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, however it is 2022-08-25T19:44:29,063 included in the distribution as "data". 2022-08-25T19:44:29,064 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,064 therefore is considered deprecated). 2022-08-25T19:44:29,065 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2022-08-25T19:44:29,066 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,067 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,067 documentation page. 2022-08-25T19:44:29,069 !! 2022-08-25T19:44:29,070 check.warn(importable) 2022-08-25T19:44:29,070 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-08-25T19:44:29,071 ############################ 2022-08-25T19:44:29,072 # Package would be ignored # 2022-08-25T19:44:29,072 ############################ 2022-08-25T19:44:29,073 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, however it is 2022-08-25T19:44:29,073 included in the distribution as "data". 2022-08-25T19:44:29,074 This behavior is likely to change in future versions of setuptools (and 2022-08-25T19:44:29,074 therefore is considered deprecated). 2022-08-25T19:44:29,075 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2022-08-25T19:44:29,076 setuptools' `packages` configuration field or the proper discovery methods. 2022-08-25T19:44:29,077 You can read more about "package discovery" and "data files" on setuptools 2022-08-25T19:44:29,077 documentation page. 2022-08-25T19:44:29,079 !! 2022-08-25T19:44:29,079 check.warn(importable) 2022-08-25T19:44:29,080 creating build/lib/deepspeed/ops/csrc 2022-08-25T19:44:29,081 creating build/lib/deepspeed/ops/csrc/adagrad 2022-08-25T19:44:29,081 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2022-08-25T19:44:29,082 creating build/lib/deepspeed/ops/csrc/adam 2022-08-25T19:44:29,082 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-08-25T19:44:29,082 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-08-25T19:44:29,083 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2022-08-25T19:44:29,083 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2022-08-25T19:44:29,084 creating build/lib/deepspeed/ops/csrc/aio 2022-08-25T19:44:29,084 creating build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,085 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,085 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,086 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,086 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,087 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,088 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:29,088 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,089 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,089 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,090 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,090 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,091 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,091 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,095 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,099 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,103 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:29,107 creating build/lib/deepspeed/ops/csrc/aio/py_test 2022-08-25T19:44:29,109 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2022-08-25T19:44:29,113 creating build/lib/deepspeed/ops/csrc/common 2022-08-25T19:44:29,115 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2022-08-25T19:44:29,119 creating build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,120 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,125 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,129 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,133 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,138 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,142 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,147 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,151 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,156 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,160 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,165 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,169 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,173 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,178 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,182 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,187 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,191 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,196 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,200 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,205 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2022-08-25T19:44:29,209 creating build/lib/deepspeed/ops/csrc/lamb 2022-08-25T19:44:29,211 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2022-08-25T19:44:29,215 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2022-08-25T19:44:29,220 creating build/lib/deepspeed/ops/csrc/quantization 2022-08-25T19:44:29,221 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2022-08-25T19:44:29,226 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-08-25T19:44:29,233 creating build/lib/deepspeed/ops/csrc/sparse_attention 2022-08-25T19:44:29,235 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2022-08-25T19:44:29,240 creating build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,242 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,248 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,254 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,261 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,266 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,271 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,279 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,284 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-08-25T19:44:29,289 creating build/lib/deepspeed/ops/csrc/transformer/inference 2022-08-25T19:44:29,290 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,292 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,297 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,301 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,306 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,311 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,318 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,322 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,328 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:29,334 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:29,335 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:29,340 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:29,345 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:29,349 creating build/lib/deepspeed/ops/csrc/utils 2022-08-25T19:44:29,350 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2022-08-25T19:44:29,354 creating build/lib/deepspeed/autotuning/config_templates 2022-08-25T19:44:29,356 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2022-08-25T19:44:29,360 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2022-08-25T19:44:29,364 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2022-08-25T19:44:29,367 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2022-08-25T19:44:29,371 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:29,376 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:29,380 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:29,441 running build_scripts 2022-08-25T19:44:29,442 creating build/scripts-3.7 2022-08-25T19:44:29,445 copying and adjusting bin/deepspeed -> build/scripts-3.7 2022-08-25T19:44:29,448 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2022-08-25T19:44:29,450 copying and adjusting bin/ds -> build/scripts-3.7 2022-08-25T19:44:29,454 copying bin/ds_ssh -> build/scripts-3.7 2022-08-25T19:44:29,457 copying and adjusting bin/ds_report -> build/scripts-3.7 2022-08-25T19:44:29,460 copying and adjusting bin/ds_bench -> build/scripts-3.7 2022-08-25T19:44:29,463 copying and adjusting bin/dsr -> build/scripts-3.7 2022-08-25T19:44:29,466 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2022-08-25T19:44:29,467 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2022-08-25T19:44:29,468 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2022-08-25T19:44:29,468 changing mode of build/scripts-3.7/ds from 644 to 755 2022-08-25T19:44:29,469 changing mode of build/scripts-3.7/ds_report from 644 to 755 2022-08-25T19:44:29,469 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2022-08-25T19:44:29,470 changing mode of build/scripts-3.7/dsr from 644 to 755 2022-08-25T19:44:29,470 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2022-08-25T19:44:30,187 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2022-08-25T19:44:30,189 setuptools.SetuptoolsDeprecationWarning, 2022-08-25T19:44:30,901 installing to build/bdist.linux-armv7l/wheel 2022-08-25T19:44:30,901 running install 2022-08-25T19:44:30,963 running install_lib 2022-08-25T19:44:31,670 creating build/bdist.linux-armv7l 2022-08-25T19:44:31,671 creating build/bdist.linux-armv7l/wheel 2022-08-25T19:44:31,674 creating build/bdist.linux-armv7l/wheel/benchmarks 2022-08-25T19:44:31,676 copying build/lib/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks 2022-08-25T19:44:31,681 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,684 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,687 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,691 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,696 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,701 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,705 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,709 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,714 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,719 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-08-25T19:44:31,725 creating build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:31,729 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,733 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,735 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,739 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,745 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,750 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,755 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,758 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,763 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,767 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,772 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-08-25T19:44:31,784 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-08-25T19:44:31,786 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-08-25T19:44:31,789 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-08-25T19:44:31,794 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,796 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,800 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,805 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,810 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,815 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,820 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-08-25T19:44:31,827 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,831 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,835 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,840 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:31,842 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:31,846 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:31,849 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:31,853 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-08-25T19:44:31,857 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,861 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,867 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-08-25T19:44:31,869 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-08-25T19:44:31,873 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-08-25T19:44:31,879 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-08-25T19:44:31,886 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:31,888 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:31,891 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:31,896 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:31,901 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-08-25T19:44:31,906 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-08-25T19:44:31,911 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,917 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,923 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,928 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:31,930 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:31,934 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:31,940 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-08-25T19:44:31,943 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,948 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,954 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,959 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-08-25T19:44:31,961 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-08-25T19:44:31,967 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-08-25T19:44:31,970 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-08-25T19:44:31,974 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-08-25T19:44:31,979 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:31,983 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-08-25T19:44:31,985 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-08-25T19:44:31,989 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-08-25T19:44:31,993 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:32,005 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:32,012 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,013 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,017 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,020 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,025 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,032 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,037 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,041 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,050 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,054 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,059 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,062 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,072 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,077 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-08-25T19:44:32,080 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-08-25T19:44:32,085 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,086 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,090 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,094 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,098 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,102 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,106 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,111 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,115 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-08-25T19:44:32,121 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,123 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,126 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,130 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,133 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,136 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,141 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-08-25T19:44:32,146 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,147 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,150 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,155 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,159 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,162 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,165 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-08-25T19:44:32,170 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,171 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,174 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,179 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,182 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,187 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-08-25T19:44:32,192 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-08-25T19:44:32,193 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-08-25T19:44:32,197 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:32,202 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-08-25T19:44:32,205 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-08-25T19:44:32,207 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-08-25T19:44:32,210 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-08-25T19:44:32,214 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-08-25T19:44:32,219 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-08-25T19:44:32,220 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-08-25T19:44:32,224 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-08-25T19:44:32,228 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-08-25T19:44:32,232 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-08-25T19:44:32,237 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-08-25T19:44:32,239 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-08-25T19:44:32,244 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,245 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,249 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,253 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,257 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,260 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,264 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,267 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,270 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,274 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,279 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,283 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,287 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,290 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-08-25T19:44:32,294 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-08-25T19:44:32,296 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-08-25T19:44:32,300 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-08-25T19:44:32,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-08-25T19:44:32,306 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-08-25T19:44:32,310 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-08-25T19:44:32,315 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,316 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,321 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,327 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,330 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,336 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:32,337 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:32,340 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:32,344 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:32,348 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-08-25T19:44:32,351 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,357 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,360 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-08-25T19:44:32,365 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2022-08-25T19:44:32,367 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-08-25T19:44:32,369 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-08-25T19:44:32,374 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-08-25T19:44:32,378 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-08-25T19:44:32,379 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-08-25T19:44:32,384 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-08-25T19:44:32,387 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-08-25T19:44:32,391 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-08-25T19:44:32,396 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2022-08-25T19:44:32,398 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-08-25T19:44:32,400 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-08-25T19:44:32,405 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,406 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,410 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,414 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,417 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,420 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,424 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-08-25T19:44:32,428 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,430 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,433 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,437 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,441 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,444 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,448 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,451 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,454 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,458 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-08-25T19:44:32,462 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-08-25T19:44:32,463 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-08-25T19:44:32,467 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-08-25T19:44:32,469 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-08-25T19:44:32,472 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-08-25T19:44:32,479 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-08-25T19:44:32,480 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-08-25T19:44:32,485 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-08-25T19:44:32,486 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-08-25T19:44:32,491 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-08-25T19:44:32,493 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-08-25T19:44:32,498 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,499 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,503 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,506 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,509 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,513 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,518 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,521 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,525 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,528 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,532 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,536 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,539 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,543 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,547 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,550 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,554 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,557 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,560 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,563 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,568 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-08-25T19:44:32,572 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,574 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,580 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,584 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,591 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,597 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2022-08-25T19:44:32,599 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:32,601 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:32,605 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:32,609 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-08-25T19:44:32,615 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,616 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,620 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,629 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,633 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,639 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,643 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,648 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,652 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-08-25T19:44:32,657 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,661 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,669 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,674 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-08-25T19:44:32,680 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-08-25T19:44:32,682 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-08-25T19:44:32,686 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-08-25T19:44:32,693 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-08-25T19:44:32,695 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-08-25T19:44:32,700 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-08-25T19:44:32,706 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-08-25T19:44:32,712 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-08-25T19:44:32,714 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-08-25T19:44:32,719 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-08-25T19:44:32,721 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-08-25T19:44:32,728 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-08-25T19:44:32,732 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-08-25T19:44:32,736 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-08-25T19:44:32,742 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-08-25T19:44:32,744 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-08-25T19:44:32,748 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-08-25T19:44:32,755 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,757 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,762 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,765 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,769 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,774 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,778 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,782 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,786 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-08-25T19:44:32,792 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,794 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,798 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,804 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,808 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,813 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,817 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,822 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,826 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,831 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,836 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,840 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-08-25T19:44:32,844 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:32,850 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,852 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,857 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,861 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,864 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,870 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,875 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,881 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-08-25T19:44:32,887 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,889 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,894 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,898 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,906 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-08-25T19:44:32,908 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-08-25T19:44:32,913 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-08-25T19:44:32,917 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-08-25T19:44:32,921 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-08-25T19:44:32,926 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,928 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,933 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,937 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,941 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,945 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,949 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-08-25T19:44:32,953 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,958 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,963 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-08-25T19:44:32,969 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,971 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,975 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,980 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,984 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,988 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,991 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,994 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:32,998 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-08-25T19:44:33,001 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:33,004 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:33,008 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-08-25T19:44:33,012 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-08-25T19:44:33,013 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-08-25T19:44:33,016 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-08-25T19:44:33,020 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-08-25T19:44:33,024 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,025 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,029 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,032 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,037 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,040 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,044 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,047 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-08-25T19:44:33,050 running install_egg_info 2022-08-25T19:44:33,817 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.7.2-py3.7.egg-info 2022-08-25T19:44:33,845 running install_scripts 2022-08-25T19:44:33,951 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data 2022-08-25T19:44:33,952 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,954 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,958 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,961 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,965 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,968 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,972 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,975 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,979 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts 2022-08-25T19:44:33,982 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/ds_report to 755 2022-08-25T19:44:33,982 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/ds to 755 2022-08-25T19:44:33,983 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/ds_elastic to 755 2022-08-25T19:44:33,983 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/ds_bench to 755 2022-08-25T19:44:33,984 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/dsr to 755 2022-08-25T19:44:33,984 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/deepspeed to 755 2022-08-25T19:44:33,985 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/ds_ssh to 755 2022-08-25T19:44:33,985 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.data/scripts/deepspeed.pt to 755 2022-08-25T19:44:34,231 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2022-08-25T19:44:34,240 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.2.dist-info/WHEEL 2022-08-25T19:44:34,245 creating '/tmp/pip-wheel-j8qlmtc9/deepspeed-0.7.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-08-25T19:44:34,250 adding 'benchmarks/__init__.py' 2022-08-25T19:44:34,254 adding 'benchmarks/communication/__init__.py' 2022-08-25T19:44:34,258 adding 'benchmarks/communication/all_gather.py' 2022-08-25T19:44:34,261 adding 'benchmarks/communication/all_reduce.py' 2022-08-25T19:44:34,265 adding 'benchmarks/communication/all_to_all.py' 2022-08-25T19:44:34,268 adding 'benchmarks/communication/broadcast.py' 2022-08-25T19:44:34,271 adding 'benchmarks/communication/constants.py' 2022-08-25T19:44:34,274 adding 'benchmarks/communication/pt2pt.py' 2022-08-25T19:44:34,277 adding 'benchmarks/communication/run_all.py' 2022-08-25T19:44:34,281 adding 'benchmarks/communication/utils.py' 2022-08-25T19:44:34,288 adding 'deepspeed/__init__.py' 2022-08-25T19:44:34,291 adding 'deepspeed/constants.py' 2022-08-25T19:44:34,295 adding 'deepspeed/env_report.py' 2022-08-25T19:44:34,298 adding 'deepspeed/git_version_info.py' 2022-08-25T19:44:34,301 adding 'deepspeed/git_version_info_installed.py' 2022-08-25T19:44:34,305 adding 'deepspeed/autotuning/__init__.py' 2022-08-25T19:44:34,318 adding 'deepspeed/autotuning/autotuner.py' 2022-08-25T19:44:34,323 adding 'deepspeed/autotuning/config.py' 2022-08-25T19:44:34,326 adding 'deepspeed/autotuning/constants.py' 2022-08-25T19:44:34,332 adding 'deepspeed/autotuning/scheduler.py' 2022-08-25T19:44:34,339 adding 'deepspeed/autotuning/utils.py' 2022-08-25T19:44:34,344 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2022-08-25T19:44:34,346 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2022-08-25T19:44:34,348 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2022-08-25T19:44:34,350 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2022-08-25T19:44:34,353 adding 'deepspeed/autotuning/tuner/__init__.py' 2022-08-25T19:44:34,356 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2022-08-25T19:44:34,358 adding 'deepspeed/autotuning/tuner/cost_model.py' 2022-08-25T19:44:34,360 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2022-08-25T19:44:34,364 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2022-08-25T19:44:34,366 adding 'deepspeed/autotuning/tuner/utils.py' 2022-08-25T19:44:34,370 adding 'deepspeed/checkpoint/__init__.py' 2022-08-25T19:44:34,372 adding 'deepspeed/checkpoint/constants.py' 2022-08-25T19:44:34,377 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2022-08-25T19:44:34,380 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2022-08-25T19:44:34,385 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2022-08-25T19:44:34,389 adding 'deepspeed/checkpoint/reshape_utils.py' 2022-08-25T19:44:34,391 adding 'deepspeed/checkpoint/utils.py' 2022-08-25T19:44:34,394 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2022-08-25T19:44:34,398 adding 'deepspeed/comm/__init__.py' 2022-08-25T19:44:34,401 adding 'deepspeed/comm/backend.py' 2022-08-25T19:44:34,407 adding 'deepspeed/comm/comm.py' 2022-08-25T19:44:34,410 adding 'deepspeed/comm/config.py' 2022-08-25T19:44:34,412 adding 'deepspeed/comm/constants.py' 2022-08-25T19:44:34,416 adding 'deepspeed/comm/torch.py' 2022-08-25T19:44:34,419 adding 'deepspeed/comm/utils.py' 2022-08-25T19:44:34,422 adding 'deepspeed/compression/__init__.py' 2022-08-25T19:44:34,429 adding 'deepspeed/compression/basic_layer.py' 2022-08-25T19:44:34,434 adding 'deepspeed/compression/compress.py' 2022-08-25T19:44:34,438 adding 'deepspeed/compression/config.py' 2022-08-25T19:44:34,442 adding 'deepspeed/compression/constants.py' 2022-08-25T19:44:34,445 adding 'deepspeed/compression/helper.py' 2022-08-25T19:44:34,448 adding 'deepspeed/compression/scheduler.py' 2022-08-25T19:44:34,452 adding 'deepspeed/compression/utils.py' 2022-08-25T19:44:34,455 adding 'deepspeed/elasticity/__init__.py' 2022-08-25T19:44:34,458 adding 'deepspeed/elasticity/config.py' 2022-08-25T19:44:34,461 adding 'deepspeed/elasticity/constants.py' 2022-08-25T19:44:34,464 adding 'deepspeed/elasticity/elastic_agent.py' 2022-08-25T19:44:34,469 adding 'deepspeed/elasticity/elasticity.py' 2022-08-25T19:44:34,472 adding 'deepspeed/elasticity/utils.py' 2022-08-25T19:44:34,475 adding 'deepspeed/inference/__init__.py' 2022-08-25T19:44:34,481 adding 'deepspeed/inference/engine.py' 2022-08-25T19:44:34,485 adding 'deepspeed/launcher/__init__.py' 2022-08-25T19:44:34,487 adding 'deepspeed/launcher/constants.py' 2022-08-25T19:44:34,491 adding 'deepspeed/launcher/launch.py' 2022-08-25T19:44:34,495 adding 'deepspeed/launcher/multinode_runner.py' 2022-08-25T19:44:34,501 adding 'deepspeed/launcher/runner.py' 2022-08-25T19:44:34,504 adding 'deepspeed/module_inject/__init__.py' 2022-08-25T19:44:34,507 adding 'deepspeed/module_inject/inject.py' 2022-08-25T19:44:34,509 adding 'deepspeed/module_inject/layers.py' 2022-08-25T19:44:34,513 adding 'deepspeed/module_inject/load_checkpoint.py' 2022-08-25T19:44:34,515 adding 'deepspeed/module_inject/module_quantize.py' 2022-08-25T19:44:34,526 adding 'deepspeed/module_inject/replace_module.py' 2022-08-25T19:44:34,531 adding 'deepspeed/module_inject/replace_policy.py' 2022-08-25T19:44:34,535 adding 'deepspeed/moe/__init__.py' 2022-08-25T19:44:34,537 adding 'deepspeed/moe/experts.py' 2022-08-25T19:44:34,540 adding 'deepspeed/moe/layer.py' 2022-08-25T19:44:34,543 adding 'deepspeed/moe/mappings.py' 2022-08-25T19:44:34,549 adding 'deepspeed/moe/sharded_moe.py' 2022-08-25T19:44:34,553 adding 'deepspeed/moe/utils.py' 2022-08-25T19:44:34,556 adding 'deepspeed/monitor/__init__.py' 2022-08-25T19:44:34,558 adding 'deepspeed/monitor/config.py' 2022-08-25T19:44:34,561 adding 'deepspeed/monitor/constants.py' 2022-08-25T19:44:34,563 adding 'deepspeed/monitor/csv_monitor.py' 2022-08-25T19:44:34,566 adding 'deepspeed/monitor/monitor.py' 2022-08-25T19:44:34,568 adding 'deepspeed/monitor/tensorboard.py' 2022-08-25T19:44:34,570 adding 'deepspeed/monitor/utils.py' 2022-08-25T19:44:34,573 adding 'deepspeed/monitor/wandb.py' 2022-08-25T19:44:34,576 adding 'deepspeed/nebula/__init__.py' 2022-08-25T19:44:34,578 adding 'deepspeed/nebula/config.py' 2022-08-25T19:44:34,581 adding 'deepspeed/nebula/constants.py' 2022-08-25T19:44:34,584 adding 'deepspeed/ops/__init__.py' 2022-08-25T19:44:34,587 adding 'deepspeed/ops/adagrad/__init__.py' 2022-08-25T19:44:34,590 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2022-08-25T19:44:34,594 adding 'deepspeed/ops/adam/__init__.py' 2022-08-25T19:44:34,597 adding 'deepspeed/ops/adam/cpu_adam.py' 2022-08-25T19:44:34,601 adding 'deepspeed/ops/adam/fused_adam.py' 2022-08-25T19:44:34,603 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2022-08-25T19:44:34,606 adding 'deepspeed/ops/aio/__init__.py' 2022-08-25T19:44:34,611 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2022-08-25T19:44:34,616 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2022-08-25T19:44:34,618 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2022-08-25T19:44:34,621 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2022-08-25T19:44:34,624 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2022-08-25T19:44:34,631 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2022-08-25T19:44:34,633 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2022-08-25T19:44:34,636 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2022-08-25T19:44:34,638 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2022-08-25T19:44:34,641 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2022-08-25T19:44:34,644 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2022-08-25T19:44:34,648 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2022-08-25T19:44:34,650 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2022-08-25T19:44:34,652 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2022-08-25T19:44:34,655 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2022-08-25T19:44:34,658 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2022-08-25T19:44:34,661 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2022-08-25T19:44:34,663 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2022-08-25T19:44:34,666 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2022-08-25T19:44:34,668 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2022-08-25T19:44:34,671 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2022-08-25T19:44:34,675 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2022-08-25T19:44:34,679 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2022-08-25T19:44:34,681 adding 'deepspeed/ops/csrc/includes/Timer.h' 2022-08-25T19:44:34,683 adding 'deepspeed/ops/csrc/includes/compat.h' 2022-08-25T19:44:34,686 adding 'deepspeed/ops/csrc/includes/context.h' 2022-08-25T19:44:34,689 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2022-08-25T19:44:34,692 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2022-08-25T19:44:34,695 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2022-08-25T19:44:34,698 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2022-08-25T19:44:34,701 adding 'deepspeed/ops/csrc/includes/dropout.h' 2022-08-25T19:44:34,704 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2022-08-25T19:44:34,706 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2022-08-25T19:44:34,709 adding 'deepspeed/ops/csrc/includes/gelu.h' 2022-08-25T19:44:34,712 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2022-08-25T19:44:34,715 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2022-08-25T19:44:34,717 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2022-08-25T19:44:34,720 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2022-08-25T19:44:34,722 adding 'deepspeed/ops/csrc/includes/simd.h' 2022-08-25T19:44:34,725 adding 'deepspeed/ops/csrc/includes/softmax.h' 2022-08-25T19:44:34,727 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2022-08-25T19:44:34,730 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2022-08-25T19:44:34,734 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2022-08-25T19:44:34,738 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2022-08-25T19:44:34,742 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2022-08-25T19:44:34,748 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2022-08-25T19:44:34,753 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2022-08-25T19:44:34,758 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2022-08-25T19:44:34,764 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2022-08-25T19:44:34,773 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2022-08-25T19:44:34,777 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2022-08-25T19:44:34,781 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2022-08-25T19:44:34,791 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2022-08-25T19:44:34,798 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2022-08-25T19:44:34,803 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2022-08-25T19:44:34,809 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2022-08-25T19:44:34,812 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2022-08-25T19:44:34,817 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2022-08-25T19:44:34,821 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2022-08-25T19:44:34,831 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2022-08-25T19:44:34,835 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2022-08-25T19:44:34,839 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2022-08-25T19:44:34,845 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2022-08-25T19:44:34,850 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2022-08-25T19:44:34,855 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2022-08-25T19:44:34,858 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2022-08-25T19:44:34,862 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2022-08-25T19:44:34,866 adding 'deepspeed/ops/lamb/__init__.py' 2022-08-25T19:44:34,870 adding 'deepspeed/ops/lamb/fused_lamb.py' 2022-08-25T19:44:34,874 adding 'deepspeed/ops/op_builder/__init__.py' 2022-08-25T19:44:34,878 adding 'deepspeed/ops/op_builder/async_io.py' 2022-08-25T19:44:34,885 adding 'deepspeed/ops/op_builder/builder.py' 2022-08-25T19:44:34,889 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2022-08-25T19:44:34,892 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2022-08-25T19:44:34,895 adding 'deepspeed/ops/op_builder/fused_adam.py' 2022-08-25T19:44:34,898 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2022-08-25T19:44:34,900 adding 'deepspeed/ops/op_builder/quantizer.py' 2022-08-25T19:44:34,904 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2022-08-25T19:44:34,906 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2022-08-25T19:44:34,909 adding 'deepspeed/ops/op_builder/transformer.py' 2022-08-25T19:44:34,912 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2022-08-25T19:44:34,915 adding 'deepspeed/ops/op_builder/utils.py' 2022-08-25T19:44:34,919 adding 'deepspeed/ops/quantizer/__init__.py' 2022-08-25T19:44:34,922 adding 'deepspeed/ops/quantizer/quantizer.py' 2022-08-25T19:44:34,926 adding 'deepspeed/ops/sparse_attention/__init__.py' 2022-08-25T19:44:34,929 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2022-08-25T19:44:34,939 adding 'deepspeed/ops/sparse_attention/matmul.py' 2022-08-25T19:44:34,944 adding 'deepspeed/ops/sparse_attention/softmax.py' 2022-08-25T19:44:34,949 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2022-08-25T19:44:34,953 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2022-08-25T19:44:34,961 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2022-08-25T19:44:34,966 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2022-08-25T19:44:34,970 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2022-08-25T19:44:34,973 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2022-08-25T19:44:34,976 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2022-08-25T19:44:34,980 adding 'deepspeed/ops/transformer/__init__.py' 2022-08-25T19:44:34,986 adding 'deepspeed/ops/transformer/transformer.py' 2022-08-25T19:44:34,991 adding 'deepspeed/ops/transformer/inference/__init__.py' 2022-08-25T19:44:34,997 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2022-08-25T19:44:35,006 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2022-08-25T19:44:35,010 adding 'deepspeed/pipe/__init__.py' 2022-08-25T19:44:35,014 adding 'deepspeed/profiling/__init__.py' 2022-08-25T19:44:35,017 adding 'deepspeed/profiling/config.py' 2022-08-25T19:44:35,020 adding 'deepspeed/profiling/constants.py' 2022-08-25T19:44:35,024 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2022-08-25T19:44:35,037 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2022-08-25T19:44:35,043 adding 'deepspeed/runtime/__init__.py' 2022-08-25T19:44:35,052 adding 'deepspeed/runtime/bf16_optimizer.py' 2022-08-25T19:44:35,061 adding 'deepspeed/runtime/config.py' 2022-08-25T19:44:35,064 adding 'deepspeed/runtime/config_utils.py' 2022-08-25T19:44:35,068 adding 'deepspeed/runtime/constants.py' 2022-08-25T19:44:35,071 adding 'deepspeed/runtime/dataloader.py' 2022-08-25T19:44:35,074 adding 'deepspeed/runtime/eigenvalue.py' 2022-08-25T19:44:35,111 adding 'deepspeed/runtime/engine.py' 2022-08-25T19:44:35,122 adding 'deepspeed/runtime/lr_schedules.py' 2022-08-25T19:44:35,126 adding 'deepspeed/runtime/progressive_layer_drop.py' 2022-08-25T19:44:35,129 adding 'deepspeed/runtime/quantize.py' 2022-08-25T19:44:35,131 adding 'deepspeed/runtime/sparse_tensor.py' 2022-08-25T19:44:35,136 adding 'deepspeed/runtime/state_dict_factory.py' 2022-08-25T19:44:35,146 adding 'deepspeed/runtime/utils.py' 2022-08-25T19:44:35,150 adding 'deepspeed/runtime/weight_quantizer.py' 2022-08-25T19:44:35,153 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2022-08-25T19:44:35,162 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2022-08-25T19:44:35,165 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2022-08-25T19:44:35,168 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2022-08-25T19:44:35,171 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2022-08-25T19:44:35,173 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2022-08-25T19:44:35,176 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2022-08-25T19:44:35,179 adding 'deepspeed/runtime/comm/__init__.py' 2022-08-25T19:44:35,182 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2022-08-25T19:44:35,185 adding 'deepspeed/runtime/comm/mpi.py' 2022-08-25T19:44:35,189 adding 'deepspeed/runtime/comm/nccl.py' 2022-08-25T19:44:35,192 adding 'deepspeed/runtime/compression/__init__.py' 2022-08-25T19:44:35,194 adding 'deepspeed/runtime/compression/cupy.py' 2022-08-25T19:44:35,197 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2022-08-25T19:44:35,200 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2022-08-25T19:44:35,203 adding 'deepspeed/runtime/fp16/__init__.py' 2022-08-25T19:44:35,209 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2022-08-25T19:44:35,213 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2022-08-25T19:44:35,219 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2022-08-25T19:44:35,222 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2022-08-25T19:44:35,227 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2022-08-25T19:44:35,233 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2022-08-25T19:44:35,240 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2022-08-25T19:44:35,244 adding 'deepspeed/runtime/pipe/__init__.py' 2022-08-25T19:44:35,258 adding 'deepspeed/runtime/pipe/engine.py' 2022-08-25T19:44:35,267 adding 'deepspeed/runtime/pipe/module.py' 2022-08-25T19:44:35,270 adding 'deepspeed/runtime/pipe/p2p.py' 2022-08-25T19:44:35,275 adding 'deepspeed/runtime/pipe/schedule.py' 2022-08-25T19:44:35,280 adding 'deepspeed/runtime/pipe/topology.py' 2022-08-25T19:44:35,284 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2022-08-25T19:44:35,286 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2022-08-25T19:44:35,289 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2022-08-25T19:44:35,292 adding 'deepspeed/runtime/swap_tensor/constants.py' 2022-08-25T19:44:35,297 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2022-08-25T19:44:35,301 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2022-08-25T19:44:35,306 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2022-08-25T19:44:35,310 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2022-08-25T19:44:35,314 adding 'deepspeed/runtime/swap_tensor/utils.py' 2022-08-25T19:44:35,317 adding 'deepspeed/runtime/zero/__init__.py' 2022-08-25T19:44:35,320 adding 'deepspeed/runtime/zero/config.py' 2022-08-25T19:44:35,324 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2022-08-25T19:44:35,328 adding 'deepspeed/runtime/zero/linear.py' 2022-08-25T19:44:35,331 adding 'deepspeed/runtime/zero/offload_config.py' 2022-08-25T19:44:35,336 adding 'deepspeed/runtime/zero/parameter_offload.py' 2022-08-25T19:44:35,355 adding 'deepspeed/runtime/zero/partition_parameters.py' 2022-08-25T19:44:35,363 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2022-08-25T19:44:35,394 adding 'deepspeed/runtime/zero/stage3.py' 2022-08-25T19:44:35,425 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2022-08-25T19:44:35,429 adding 'deepspeed/runtime/zero/test.py' 2022-08-25T19:44:35,433 adding 'deepspeed/runtime/zero/tiling.py' 2022-08-25T19:44:35,436 adding 'deepspeed/runtime/zero/utils.py' 2022-08-25T19:44:35,440 adding 'deepspeed/utils/__init__.py' 2022-08-25T19:44:35,443 adding 'deepspeed/utils/comms_logging.py' 2022-08-25T19:44:35,446 adding 'deepspeed/utils/debug.py' 2022-08-25T19:44:35,448 adding 'deepspeed/utils/exceptions.py' 2022-08-25T19:44:35,453 adding 'deepspeed/utils/groups.py' 2022-08-25T19:44:35,456 adding 'deepspeed/utils/init_on_device.py' 2022-08-25T19:44:35,458 adding 'deepspeed/utils/logging.py' 2022-08-25T19:44:35,460 adding 'deepspeed/utils/nvtx.py' 2022-08-25T19:44:35,464 adding 'deepspeed/utils/timer.py' 2022-08-25T19:44:35,466 adding 'deepspeed/utils/types.py' 2022-08-25T19:44:35,471 adding 'deepspeed/utils/zero_to_fp32.py' 2022-08-25T19:44:35,476 adding 'deepspeed-0.7.2.data/scripts/deepspeed' 2022-08-25T19:44:35,478 adding 'deepspeed-0.7.2.data/scripts/deepspeed.pt' 2022-08-25T19:44:35,480 adding 'deepspeed-0.7.2.data/scripts/ds' 2022-08-25T19:44:35,482 adding 'deepspeed-0.7.2.data/scripts/ds_bench' 2022-08-25T19:44:35,485 adding 'deepspeed-0.7.2.data/scripts/ds_elastic' 2022-08-25T19:44:35,487 adding 'deepspeed-0.7.2.data/scripts/ds_report' 2022-08-25T19:44:35,489 adding 'deepspeed-0.7.2.data/scripts/ds_ssh' 2022-08-25T19:44:35,491 adding 'deepspeed-0.7.2.data/scripts/dsr' 2022-08-25T19:44:35,496 adding 'deepspeed-0.7.2.dist-info/LICENSE' 2022-08-25T19:44:35,502 adding 'deepspeed-0.7.2.dist-info/METADATA' 2022-08-25T19:44:35,504 adding 'deepspeed-0.7.2.dist-info/WHEEL' 2022-08-25T19:44:35,506 adding 'deepspeed-0.7.2.dist-info/entry_points.txt' 2022-08-25T19:44:35,508 adding 'deepspeed-0.7.2.dist-info/top_level.txt' 2022-08-25T19:44:35,515 adding 'deepspeed-0.7.2.dist-info/RECORD' 2022-08-25T19:44:35,549 removing build/bdist.linux-armv7l/wheel 2022-08-25T19:44:35,723 deepspeed build time = 22.5220205783844 secs 2022-08-25T19:44:35,969 Building wheel for deepspeed (setup.py): finished with status 'done' 2022-08-25T19:44:35,996 Created wheel for deepspeed: filename=deepspeed-0.7.2-py3-none-any.whl size=646894 sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb 2022-08-25T19:44:35,998 Stored in directory: /tmp/pip-ephem-wheel-cache-bfyt7b8f/wheels/9c/38/79/97bf055491f727e3bfaf0fe7926196515a7066167f26cb3adf 2022-08-25T19:44:36,051 Successfully built deepspeed 2022-08-25T19:44:36,105 Removed build tracker: '/tmp/pip-build-tracker-x24n3plt'