2023-03-20T18:24:16,770 Created temporary directory: /tmp/pip-ephem-wheel-cache-fe58_koq 2023-03-20T18:24:16,777 Created temporary directory: /tmp/pip-build-tracker-ja1r_nz1 2023-03-20T18:24:16,777 Initialized build tracking at /tmp/pip-build-tracker-ja1r_nz1 2023-03-20T18:24:16,778 Created build tracker: /tmp/pip-build-tracker-ja1r_nz1 2023-03-20T18:24:16,778 Entered build tracker: /tmp/pip-build-tracker-ja1r_nz1 2023-03-20T18:24:16,779 Created temporary directory: /tmp/pip-wheel-xrgzsaff 2023-03-20T18:24:16,790 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-03-20T18:24:16,796 Created temporary directory: /tmp/pip-ephem-wheel-cache-ktw8dybf 2023-03-20T18:24:16,848 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-03-20T18:24:16,855 2 location(s) to search for versions of deepspeed: 2023-03-20T18:24:16,855 * https://pypi.org/simple/deepspeed/ 2023-03-20T18:24:16,855 * https://www.piwheels.org/simple/deepspeed/ 2023-03-20T18:24:16,856 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-03-20T18:24:16,857 Getting page https://pypi.org/simple/deepspeed/ 2023-03-20T18:24:16,861 Found index url https://pypi.org/simple 2023-03-20T18:24:17,049 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-03-20T18:24:17,085 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-20T18:24:17,086 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-03-20T18:24:17,087 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-20T18:24:17,088 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-03-20T18:24:17,088 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-20T18:24:17,089 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-03-20T18:24:17,090 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-20T18:24:17,090 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-03-20T18:24:17,091 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-03-20T18:24:17,091 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-03-20T18:24:17,092 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-03-20T18:24:17,093 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-03-20T18:24:17,094 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-03-20T18:24:17,094 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-03-20T18:24:17,095 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-03-20T18:24:17,096 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-03-20T18:24:17,096 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-03-20T18:24:17,097 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-03-20T18:24:17,098 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-03-20T18:24:17,098 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-03-20T18:24:17,099 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-03-20T18:24:17,100 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-03-20T18:24:17,101 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-03-20T18:24:17,101 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-03-20T18:24:17,102 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-03-20T18:24:17,103 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-03-20T18:24:17,103 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-03-20T18:24:17,104 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-03-20T18:24:17,105 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-03-20T18:24:17,105 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-03-20T18:24:17,106 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-03-20T18:24:17,107 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-03-20T18:24:17,107 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-03-20T18:24:17,108 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-03-20T18:24:17,109 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-03-20T18:24:17,109 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-03-20T18:24:17,110 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-03-20T18:24:17,111 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-03-20T18:24:17,112 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-03-20T18:24:17,112 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-03-20T18:24:17,113 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-03-20T18:24:17,114 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-03-20T18:24:17,114 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-03-20T18:24:17,115 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-03-20T18:24:17,116 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-03-20T18:24:17,116 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-03-20T18:24:17,117 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-03-20T18:24:17,118 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-03-20T18:24:17,118 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-03-20T18:24:17,119 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-03-20T18:24:17,120 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-03-20T18:24:17,120 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-03-20T18:24:17,121 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-03-20T18:24:17,122 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-03-20T18:24:17,122 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-03-20T18:24:17,123 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-03-20T18:24:17,124 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-03-20T18:24:17,124 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-03-20T18:24:17,125 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-03-20T18:24:17,126 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-03-20T18:24:17,126 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-03-20T18:24:17,127 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-03-20T18:24:17,128 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-03-20T18:24:17,128 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-03-20T18:24:17,129 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-03-20T18:24:17,130 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-03-20T18:24:17,131 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-03-20T18:24:17,133 Found index url https://www.piwheels.org/simple 2023-03-20T18:24:17,355 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-03-20T18:24:17,381 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,382 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,383 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,383 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,384 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,384 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,385 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,385 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,386 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,386 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,387 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,387 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,388 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,388 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,389 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,389 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,390 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,391 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,391 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,392 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,392 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,393 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,393 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,394 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,394 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,395 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,395 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,396 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,396 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,397 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,397 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,398 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,398 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,399 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,399 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-03-20T18:24:17,400 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-03-20T18:24:17,400 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-03-20T18:24:17,453 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-03-20T18:24:17,484 Collecting deepspeed==0.8.3 2023-03-20T18:24:17,488 Created temporary directory: /tmp/pip-unpack-vsj0uowd 2023-03-20T18:24:18,149 Downloading deepspeed-0.8.3.tar.gz (765 kB) 2023-03-20T18:24:20,913 Added deepspeed==0.8.3 from https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz to build tracker '/tmp/pip-build-tracker-ja1r_nz1' 2023-03-20T18:24:20,917 Running setup.py (path:/tmp/pip-wheel-xrgzsaff/deepspeed_061a5293b5dd4c339f62ee2577dee6f3/setup.py) egg_info for package deepspeed 2023-03-20T18:24:20,918 Created temporary directory: /tmp/pip-pip-egg-info-tle5ylop 2023-03-20T18:24:20,919 Preparing metadata (setup.py): started 2023-03-20T18:24:20,922 Running command python setup.py egg_info 2023-03-20T18:24:22,925 fatal: not a git repository (or any of the parent directories): .git 2023-03-20T18:24:23,512 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-03-20T18:24:23,512  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-03-20T18:24:23,513 DS_BUILD_OPS=0 2023-03-20T18:24:23,513  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-03-20T18:24:23,513  [WARNING]  async_io: please install the libaio-dev package with apt 2023-03-20T18:24:23,514  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-03-20T18:24:23,514  [WARNING]  unable to import torch, please install it first 2023-03-20T18:24:23,514  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-20T18:24:23,515  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-20T18:24:23,515 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-03-20T18:24:23,515 version=0.8.3, git_hash=unknown, git_branch=unknown 2023-03-20T18:24:23,516 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-03-20T18:24:23,516 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-03-20T18:24:23,517 ext_modules=[] 2023-03-20T18:24:23,517 running egg_info 2023-03-20T18:24:23,517 creating /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info 2023-03-20T18:24:23,567 writing /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/PKG-INFO 2023-03-20T18:24:23,574 writing dependency_links to /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/dependency_links.txt 2023-03-20T18:24:23,579 writing entry points to /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/entry_points.txt 2023-03-20T18:24:23,584 writing requirements to /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/requires.txt 2023-03-20T18:24:23,587 writing top-level names to /tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/top_level.txt 2023-03-20T18:24:23,591 writing manifest file '/tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/SOURCES.txt' 2023-03-20T18:24:23,902 reading manifest file '/tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/SOURCES.txt' 2023-03-20T18:24:23,906 reading manifest template 'MANIFEST.in' 2023-03-20T18:24:25,193 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-03-20T18:24:26,160 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-03-20T18:24:26,815 warning: no files found matching '*.tr' under directory 'csrc' 2023-03-20T18:24:26,970 warning: no files found matching '*.cc' under directory 'csrc' 2023-03-20T18:24:27,018 adding license file 'LICENSE' 2023-03-20T18:24:27,076 writing manifest file '/tmp/pip-pip-egg-info-tle5ylop/deepspeed.egg-info/SOURCES.txt' 2023-03-20T18:24:27,080 deepspeed build time = 4.144354581832886 secs 2023-03-20T18:24:27,207 Preparing metadata (setup.py): finished with status 'done' 2023-03-20T18:24:27,227 Source in /tmp/pip-wheel-xrgzsaff/deepspeed_061a5293b5dd4c339f62ee2577dee6f3 has version 0.8.3, which satisfies requirement deepspeed==0.8.3 from https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz 2023-03-20T18:24:27,229 Removed deepspeed==0.8.3 from https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz from build tracker '/tmp/pip-build-tracker-ja1r_nz1' 2023-03-20T18:24:27,245 Created temporary directory: /tmp/pip-unpack-x3et40py 2023-03-20T18:24:27,246 Building wheels for collected packages: deepspeed 2023-03-20T18:24:27,255 Created temporary directory: /tmp/pip-wheel-1c1t244p 2023-03-20T18:24:27,256 Building wheel for deepspeed (setup.py): started 2023-03-20T18:24:27,258 Destination directory: /tmp/pip-wheel-1c1t244p 2023-03-20T18:24:27,258 Running command python setup.py bdist_wheel 2023-03-20T18:24:28,396 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-03-20T18:24:28,420  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-03-20T18:24:28,501 DS_BUILD_OPS=0 2023-03-20T18:24:28,796  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-03-20T18:24:28,962  [WARNING]  async_io: please install the libaio-dev package with apt 2023-03-20T18:24:28,963  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-03-20T18:24:28,966  [WARNING]  unable to import torch, please install it first 2023-03-20T18:24:28,967  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-20T18:24:28,968  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-03-20T18:24:28,968 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-03-20T18:24:29,008 fatal: not a git repository (or any of the parent directories): .git 2023-03-20T18:24:29,014 version=0.8.3, git_hash=unknown, git_branch=unknown 2023-03-20T18:24:29,016 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-03-20T18:24:29,017 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-03-20T18:24:29,017 ext_modules=[] 2023-03-20T18:24:30,061 running bdist_wheel 2023-03-20T18:24:30,757 running build 2023-03-20T18:24:30,758 running build_py 2023-03-20T18:24:30,820 creating build 2023-03-20T18:24:30,821 creating build/lib 2023-03-20T18:24:30,823 creating build/lib/deepspeed 2023-03-20T18:24:30,825 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-03-20T18:24:30,829 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-03-20T18:24:30,834 copying deepspeed/constants.py -> build/lib/deepspeed 2023-03-20T18:24:30,838 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-03-20T18:24:30,842 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-03-20T18:24:30,848 creating build/lib/deepspeed/comm 2023-03-20T18:24:30,850 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,855 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,860 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,864 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,869 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,875 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,879 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-03-20T18:24:30,885 creating build/lib/deepspeed/elasticity 2023-03-20T18:24:30,886 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,892 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,896 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,901 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,906 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,912 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-03-20T18:24:30,918 creating build/lib/deepspeed/profiling 2023-03-20T18:24:30,921 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-03-20T18:24:30,926 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-03-20T18:24:30,930 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-03-20T18:24:30,936 creating build/lib/deepspeed/autotuning 2023-03-20T18:24:30,938 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,943 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,950 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,955 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,960 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,965 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-03-20T18:24:30,970 creating build/lib/deepspeed/inference 2023-03-20T18:24:30,972 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-03-20T18:24:30,977 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-03-20T18:24:30,982 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-03-20T18:24:30,988 creating build/lib/deepspeed/compression 2023-03-20T18:24:30,990 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-03-20T18:24:30,995 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,002 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,008 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,012 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,017 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,022 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,026 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-03-20T18:24:31,031 creating build/lib/deepspeed/monitor 2023-03-20T18:24:31,033 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,037 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,041 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,044 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,048 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,052 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,055 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-03-20T18:24:31,060 creating build/lib/deepspeed/accelerator 2023-03-20T18:24:31,062 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-20T18:24:31,066 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-20T18:24:31,070 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-03-20T18:24:31,074 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-03-20T18:24:31,079 creating build/lib/deepspeed/moe 2023-03-20T18:24:31,081 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,085 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,090 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,094 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,098 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,102 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-03-20T18:24:31,107 creating build/lib/deepspeed/pipe 2023-03-20T18:24:31,109 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-03-20T18:24:31,116 creating build/lib/deepspeed/runtime 2023-03-20T18:24:31,118 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,124 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,130 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,134 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,139 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,145 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,149 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,154 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,160 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,164 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,167 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,179 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,186 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,190 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,195 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-03-20T18:24:31,200 creating build/lib/deepspeed/ops 2023-03-20T18:24:31,201 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-03-20T18:24:31,208 creating build/lib/deepspeed/utils 2023-03-20T18:24:31,210 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,214 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,218 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,223 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,227 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,231 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,236 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,240 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,244 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,249 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,255 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,259 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,264 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-03-20T18:24:31,269 creating build/lib/deepspeed/nebula 2023-03-20T18:24:31,271 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-03-20T18:24:31,275 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-03-20T18:24:31,278 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-03-20T18:24:31,283 creating build/lib/deepspeed/model_implementations 2023-03-20T18:24:31,285 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-03-20T18:24:31,291 creating build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,292 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,297 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,301 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,304 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,307 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,312 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,315 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,319 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,324 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-03-20T18:24:31,329 creating build/lib/deepspeed/module_inject 2023-03-20T18:24:31,331 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,335 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,340 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,346 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,349 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,353 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,357 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,360 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,364 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,368 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-03-20T18:24:31,373 creating build/lib/deepspeed/launcher 2023-03-20T18:24:31,375 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-03-20T18:24:31,381 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-03-20T18:24:31,386 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-03-20T18:24:31,389 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-03-20T18:24:31,394 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-03-20T18:24:31,398 creating build/lib/deepspeed/profiling/flops_profiler 2023-03-20T18:24:31,401 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-03-20T18:24:31,407 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-03-20T18:24:31,413 creating build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,414 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,418 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,423 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,427 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,431 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,434 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-03-20T18:24:31,439 creating build/lib/deepspeed/runtime/comm 2023-03-20T18:24:31,441 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-03-20T18:24:31,447 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-03-20T18:24:31,452 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-03-20T18:24:31,456 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-03-20T18:24:31,462 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:31,464 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:31,468 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:31,473 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:31,476 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:31,481 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:31,483 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:31,487 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:31,493 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:31,497 creating build/lib/deepspeed/runtime/compression 2023-03-20T18:24:31,499 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-03-20T18:24:31,502 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-03-20T18:24:31,508 creating build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,510 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,515 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,520 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,524 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,528 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,531 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,541 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,546 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,556 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,560 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,569 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,573 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,577 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-03-20T18:24:31,584 creating build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,586 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,591 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,597 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,601 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,607 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,611 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,614 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,619 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,623 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-03-20T18:24:31,629 creating build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,631 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,637 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,641 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,646 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,653 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,657 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-03-20T18:24:31,663 creating build/lib/deepspeed/runtime/data_pipeline 2023-03-20T18:24:31,665 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-20T18:24:31,670 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-20T18:24:31,674 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-20T18:24:31,679 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-03-20T18:24:31,685 creating build/lib/deepspeed/runtime/fp16 2023-03-20T18:24:31,687 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-03-20T18:24:31,693 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-03-20T18:24:31,698 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-03-20T18:24:31,704 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-03-20T18:24:31,710 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,713 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,719 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,723 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,729 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,734 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:31,739 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,741 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,746 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,750 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,754 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,757 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:31,762 creating build/lib/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:31,764 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:31,770 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:31,776 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:31,781 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:31,787 creating build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,789 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,793 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,797 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,801 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,805 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,808 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,812 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,816 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,820 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,824 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,827 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,831 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,835 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,839 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,842 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,846 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-03-20T18:24:31,852 creating build/lib/deepspeed/ops/adagrad 2023-03-20T18:24:31,854 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-03-20T18:24:31,859 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-03-20T18:24:31,863 creating build/lib/deepspeed/ops/aio 2023-03-20T18:24:31,865 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-03-20T18:24:31,871 creating build/lib/deepspeed/ops/lamb 2023-03-20T18:24:31,873 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-03-20T18:24:31,889 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-03-20T18:24:31,894 creating build/lib/deepspeed/ops/transformer 2023-03-20T18:24:31,896 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-03-20T18:24:31,902 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-03-20T18:24:31,907 creating build/lib/deepspeed/ops/adam 2023-03-20T18:24:31,908 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-03-20T18:24:31,913 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-03-20T18:24:31,917 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-03-20T18:24:31,921 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-03-20T18:24:31,926 creating build/lib/deepspeed/ops/quantizer 2023-03-20T18:24:31,928 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-03-20T18:24:31,932 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-03-20T18:24:31,936 creating build/lib/deepspeed/ops/random_ltd 2023-03-20T18:24:31,938 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-03-20T18:24:31,943 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-03-20T18:24:31,948 creating build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,950 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,956 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,962 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,967 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,972 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,978 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,982 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-03-20T18:24:31,990 creating build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:31,992 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:31,996 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,001 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,006 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,009 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,014 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,019 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,023 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,027 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,031 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-03-20T18:24:32,037 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,039 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,043 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,047 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,051 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,055 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,059 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,063 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,068 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,072 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,077 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:32,082 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:32,085 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:32,091 creating build/lib/deepspeed/model_implementations/diffusers 2023-03-20T18:24:32,093 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-20T18:24:32,098 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-20T18:24:32,102 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-03-20T18:24:32,108 creating build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,111 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,115 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,120 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,124 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,128 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,133 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,137 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,141 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,146 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-03-20T18:24:32,152 creating build/lib/deepspeed/model_implementations/features 2023-03-20T18:24:32,154 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-03-20T18:24:32,158 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-03-20T18:24:32,165 creating build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,167 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,172 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,177 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,181 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,185 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,190 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,195 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,200 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,204 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,208 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,213 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,216 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,220 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,225 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,228 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,232 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-03-20T18:24:32,238 creating build/lib/deepspeed/module_inject/containers/features 2023-03-20T18:24:32,240 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-20T18:24:32,243 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-20T18:24:32,247 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-03-20T18:24:32,252 running egg_info 2023-03-20T18:24:32,371 writing deepspeed.egg-info/PKG-INFO 2023-03-20T18:24:32,377 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-03-20T18:24:32,381 writing entry points to deepspeed.egg-info/entry_points.txt 2023-03-20T18:24:32,386 writing requirements to deepspeed.egg-info/requires.txt 2023-03-20T18:24:32,388 writing top-level names to deepspeed.egg-info/top_level.txt 2023-03-20T18:24:32,533 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-03-20T18:24:32,594 reading manifest template 'MANIFEST.in' 2023-03-20T18:24:33,887 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-03-20T18:24:34,848 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-03-20T18:24:35,489 warning: no files found matching '*.tr' under directory 'csrc' 2023-03-20T18:24:35,641 warning: no files found matching '*.cc' under directory 'csrc' 2023-03-20T18:24:35,689 adding license file 'LICENSE' 2023-03-20T18:24:35,760 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-03-20T18:24:35,777 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,778 !! 2023-03-20T18:24:35,779 ############################ 2023-03-20T18:24:35,779 # Package would be ignored # 2023-03-20T18:24:35,779 ############################ 2023-03-20T18:24:35,780 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-03-20T18:24:35,780 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,780 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-03-20T18:24:35,781 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,781 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,782 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-03-20T18:24:35,782 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,782 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,783 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,783 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,783 documentation page. 2023-03-20T18:24:35,784 !! 2023-03-20T18:24:35,785 check.warn(importable) 2023-03-20T18:24:35,786 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,787 !! 2023-03-20T18:24:35,788 ############################ 2023-03-20T18:24:35,788 # Package would be ignored # 2023-03-20T18:24:35,788 ############################ 2023-03-20T18:24:35,789 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-03-20T18:24:35,789 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,790 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-03-20T18:24:35,790 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,790 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,791 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-03-20T18:24:35,791 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,791 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,792 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,792 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,793 documentation page. 2023-03-20T18:24:35,793 !! 2023-03-20T18:24:35,794 check.warn(importable) 2023-03-20T18:24:35,794 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,795 !! 2023-03-20T18:24:35,796 ############################ 2023-03-20T18:24:35,796 # Package would be ignored # 2023-03-20T18:24:35,796 ############################ 2023-03-20T18:24:35,797 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-03-20T18:24:35,797 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,797 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-03-20T18:24:35,798 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,798 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,799 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-03-20T18:24:35,799 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,799 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,800 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,800 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,800 documentation page. 2023-03-20T18:24:35,801 !! 2023-03-20T18:24:35,802 check.warn(importable) 2023-03-20T18:24:35,802 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,802 !! 2023-03-20T18:24:35,803 ############################ 2023-03-20T18:24:35,804 # Package would be ignored # 2023-03-20T18:24:35,804 ############################ 2023-03-20T18:24:35,804 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-03-20T18:24:35,804 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,805 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-03-20T18:24:35,805 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,806 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,806 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-03-20T18:24:35,807 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,807 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,807 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,808 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,808 documentation page. 2023-03-20T18:24:35,809 !! 2023-03-20T18:24:35,809 check.warn(importable) 2023-03-20T18:24:35,810 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,810 !! 2023-03-20T18:24:35,811 ############################ 2023-03-20T18:24:35,811 # Package would be ignored # 2023-03-20T18:24:35,812 ############################ 2023-03-20T18:24:35,812 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-03-20T18:24:35,812 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,813 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-03-20T18:24:35,813 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,813 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,814 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-03-20T18:24:35,814 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,814 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,815 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,815 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,816 documentation page. 2023-03-20T18:24:35,816 !! 2023-03-20T18:24:35,817 check.warn(importable) 2023-03-20T18:24:35,817 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,818 !! 2023-03-20T18:24:35,818 ############################ 2023-03-20T18:24:35,819 # Package would be ignored # 2023-03-20T18:24:35,819 ############################ 2023-03-20T18:24:35,819 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-03-20T18:24:35,820 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,820 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-03-20T18:24:35,820 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,821 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,821 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-03-20T18:24:35,822 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,822 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,822 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,823 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,823 documentation page. 2023-03-20T18:24:35,824 !! 2023-03-20T18:24:35,825 check.warn(importable) 2023-03-20T18:24:35,825 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,825 !! 2023-03-20T18:24:35,826 ############################ 2023-03-20T18:24:35,826 # Package would be ignored # 2023-03-20T18:24:35,827 ############################ 2023-03-20T18:24:35,827 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-03-20T18:24:35,827 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,828 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-03-20T18:24:35,828 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,828 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,829 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-03-20T18:24:35,829 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,829 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,830 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,830 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,831 documentation page. 2023-03-20T18:24:35,831 !! 2023-03-20T18:24:35,832 check.warn(importable) 2023-03-20T18:24:35,833 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,833 !! 2023-03-20T18:24:35,834 ############################ 2023-03-20T18:24:35,834 # Package would be ignored # 2023-03-20T18:24:35,834 ############################ 2023-03-20T18:24:35,835 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-03-20T18:24:35,835 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,835 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-03-20T18:24:35,836 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,836 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,837 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-03-20T18:24:35,837 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,837 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,837 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,838 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,838 documentation page. 2023-03-20T18:24:35,839 !! 2023-03-20T18:24:35,840 check.warn(importable) 2023-03-20T18:24:35,840 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,840 !! 2023-03-20T18:24:35,841 ############################ 2023-03-20T18:24:35,842 # Package would be ignored # 2023-03-20T18:24:35,842 ############################ 2023-03-20T18:24:35,842 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-03-20T18:24:35,842 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,843 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-03-20T18:24:35,843 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,844 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,844 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-03-20T18:24:35,844 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,845 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,845 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,846 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,846 documentation page. 2023-03-20T18:24:35,847 !! 2023-03-20T18:24:35,847 check.warn(importable) 2023-03-20T18:24:35,848 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,848 !! 2023-03-20T18:24:35,849 ############################ 2023-03-20T18:24:35,849 # Package would be ignored # 2023-03-20T18:24:35,850 ############################ 2023-03-20T18:24:35,850 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-03-20T18:24:35,850 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,851 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-03-20T18:24:35,851 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,852 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,852 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-03-20T18:24:35,853 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,853 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,853 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,854 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,854 documentation page. 2023-03-20T18:24:35,855 !! 2023-03-20T18:24:35,856 check.warn(importable) 2023-03-20T18:24:35,856 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,857 !! 2023-03-20T18:24:35,857 ############################ 2023-03-20T18:24:35,858 # Package would be ignored # 2023-03-20T18:24:35,858 ############################ 2023-03-20T18:24:35,858 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-03-20T18:24:35,859 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,859 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-03-20T18:24:35,860 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,860 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,861 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-03-20T18:24:35,861 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,861 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,862 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,862 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,863 documentation page. 2023-03-20T18:24:35,864 !! 2023-03-20T18:24:35,864 check.warn(importable) 2023-03-20T18:24:35,864 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,865 !! 2023-03-20T18:24:35,866 ############################ 2023-03-20T18:24:35,866 # Package would be ignored # 2023-03-20T18:24:35,866 ############################ 2023-03-20T18:24:35,867 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-03-20T18:24:35,867 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,868 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-03-20T18:24:35,868 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,868 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,869 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-03-20T18:24:35,869 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,870 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,870 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,871 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,871 documentation page. 2023-03-20T18:24:35,872 !! 2023-03-20T18:24:35,873 check.warn(importable) 2023-03-20T18:24:35,873 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,873 !! 2023-03-20T18:24:35,874 ############################ 2023-03-20T18:24:35,875 # Package would be ignored # 2023-03-20T18:24:35,875 ############################ 2023-03-20T18:24:35,875 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-03-20T18:24:35,876 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,876 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-03-20T18:24:35,876 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,877 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,877 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-03-20T18:24:35,878 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,878 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,878 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,879 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,879 documentation page. 2023-03-20T18:24:35,880 !! 2023-03-20T18:24:35,881 check.warn(importable) 2023-03-20T18:24:35,881 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,882 !! 2023-03-20T18:24:35,883 ############################ 2023-03-20T18:24:35,883 # Package would be ignored # 2023-03-20T18:24:35,883 ############################ 2023-03-20T18:24:35,884 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-03-20T18:24:35,884 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,884 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-03-20T18:24:35,885 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,885 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,886 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-03-20T18:24:35,886 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,886 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,887 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,887 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,888 documentation page. 2023-03-20T18:24:35,889 !! 2023-03-20T18:24:35,889 check.warn(importable) 2023-03-20T18:24:35,890 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,890 !! 2023-03-20T18:24:35,891 ############################ 2023-03-20T18:24:35,891 # Package would be ignored # 2023-03-20T18:24:35,892 ############################ 2023-03-20T18:24:35,892 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-03-20T18:24:35,892 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,893 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-03-20T18:24:35,893 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,894 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,894 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-03-20T18:24:35,895 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,895 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,895 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,896 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,896 documentation page. 2023-03-20T18:24:35,897 !! 2023-03-20T18:24:35,898 check.warn(importable) 2023-03-20T18:24:35,898 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,898 !! 2023-03-20T18:24:35,900 ############################ 2023-03-20T18:24:35,900 # Package would be ignored # 2023-03-20T18:24:35,900 ############################ 2023-03-20T18:24:35,900 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-03-20T18:24:35,901 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,901 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-03-20T18:24:35,902 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,902 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,903 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-03-20T18:24:35,903 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,903 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,904 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,904 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,905 documentation page. 2023-03-20T18:24:35,906 !! 2023-03-20T18:24:35,906 check.warn(importable) 2023-03-20T18:24:35,907 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,907 !! 2023-03-20T18:24:35,908 ############################ 2023-03-20T18:24:35,908 # Package would be ignored # 2023-03-20T18:24:35,908 ############################ 2023-03-20T18:24:35,909 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-03-20T18:24:35,909 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,910 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-03-20T18:24:35,910 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,910 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,911 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-03-20T18:24:35,911 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,912 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,912 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,913 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,913 documentation page. 2023-03-20T18:24:35,914 !! 2023-03-20T18:24:35,915 check.warn(importable) 2023-03-20T18:24:35,915 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-03-20T18:24:35,915 !! 2023-03-20T18:24:35,916 ############################ 2023-03-20T18:24:35,917 # Package would be ignored # 2023-03-20T18:24:35,917 ############################ 2023-03-20T18:24:35,917 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-03-20T18:24:35,918 but it is not listed in the `packages` configuration of setuptools. 2023-03-20T18:24:35,918 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-03-20T18:24:35,918 because it may contain data files, but this behavior is likely to change 2023-03-20T18:24:35,919 in future versions of setuptools (and therefore is considered deprecated). 2023-03-20T18:24:35,919 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-03-20T18:24:35,920 the `packages` configuration field or the proper discovery methods 2023-03-20T18:24:35,920 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-03-20T18:24:35,920 instead of `find_packages(...)`/`find:`). 2023-03-20T18:24:35,921 You can read more about "package discovery" and "data files" on setuptools 2023-03-20T18:24:35,921 documentation page. 2023-03-20T18:24:35,922 !! 2023-03-20T18:24:35,923 check.warn(importable) 2023-03-20T18:24:35,923 creating build/lib/deepspeed/autotuning/config_templates 2023-03-20T18:24:35,924 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-20T18:24:35,924 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-20T18:24:35,924 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-20T18:24:35,925 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-03-20T18:24:35,925 creating build/lib/deepspeed/ops/csrc 2023-03-20T18:24:35,925 creating build/lib/deepspeed/ops/csrc/adagrad 2023-03-20T18:24:35,926 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-03-20T18:24:35,926 creating build/lib/deepspeed/ops/csrc/adam 2023-03-20T18:24:35,926 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-03-20T18:24:35,927 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-03-20T18:24:35,927 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-03-20T18:24:35,927 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-03-20T18:24:35,928 creating build/lib/deepspeed/ops/csrc/aio 2023-03-20T18:24:35,928 creating build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,928 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,929 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,929 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,929 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,930 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,932 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:35,936 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,938 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,943 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,947 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,952 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,957 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,962 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,966 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,971 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,975 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,980 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,984 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:35,988 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-03-20T18:24:35,990 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-03-20T18:24:35,995 creating build/lib/deepspeed/ops/csrc/common 2023-03-20T18:24:35,996 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-03-20T18:24:36,001 creating build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,003 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,007 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,012 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,015 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,020 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,026 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,031 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,036 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,040 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,046 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,051 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,055 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,059 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,064 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,068 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,072 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,077 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,081 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,088 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,093 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,097 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,102 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,106 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,112 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,117 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,121 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,126 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-03-20T18:24:36,131 creating build/lib/deepspeed/ops/csrc/lamb 2023-03-20T18:24:36,133 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-03-20T18:24:36,137 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-03-20T18:24:36,143 creating build/lib/deepspeed/ops/csrc/quantization 2023-03-20T18:24:36,145 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-20T18:24:36,150 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-20T18:24:36,157 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-03-20T18:24:36,162 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-03-20T18:24:36,168 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:36,170 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:36,176 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:36,182 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:36,187 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:36,193 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-03-20T18:24:36,195 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-03-20T18:24:36,201 creating build/lib/deepspeed/ops/csrc/spatial 2023-03-20T18:24:36,203 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:36,205 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:36,211 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:36,216 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-03-20T18:24:36,219 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-03-20T18:24:36,224 creating build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,227 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,233 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,240 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,247 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,253 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,259 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,269 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,275 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-03-20T18:24:36,282 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-03-20T18:24:36,283 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,285 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,290 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,295 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,302 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,308 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,318 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,322 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,328 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:36,335 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:36,337 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:36,342 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:36,348 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:36,353 creating build/lib/deepspeed/ops/csrc/utils 2023-03-20T18:24:36,355 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-03-20T18:24:36,359 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:36,364 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:36,369 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:36,447 running build_scripts 2023-03-20T18:24:36,449 creating build/scripts-3.7 2023-03-20T18:24:36,451 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-03-20T18:24:36,454 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-03-20T18:24:36,457 copying and adjusting bin/ds -> build/scripts-3.7 2023-03-20T18:24:36,460 copying bin/ds_ssh -> build/scripts-3.7 2023-03-20T18:24:36,464 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-03-20T18:24:36,467 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-03-20T18:24:36,470 copying and adjusting bin/dsr -> build/scripts-3.7 2023-03-20T18:24:36,473 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-03-20T18:24:36,475 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-03-20T18:24:36,476 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-03-20T18:24:36,477 changing mode of build/scripts-3.7/ds from 644 to 755 2023-03-20T18:24:36,478 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-03-20T18:24:36,478 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-03-20T18:24:36,479 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-03-20T18:24:36,480 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-03-20T18:24:36,542 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-03-20T18:24:36,543 setuptools.SetuptoolsDeprecationWarning, 2023-03-20T18:24:36,598 installing to build/bdist.linux-armv7l/wheel 2023-03-20T18:24:36,598 running install 2023-03-20T18:24:36,659 running install_lib 2023-03-20T18:24:36,718 creating build/bdist.linux-armv7l 2023-03-20T18:24:36,719 creating build/bdist.linux-armv7l/wheel 2023-03-20T18:24:36,723 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:36,726 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,728 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,732 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,737 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,740 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,745 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,751 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,755 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-03-20T18:24:36,760 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,761 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,765 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,769 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,773 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,777 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,782 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-03-20T18:24:36,787 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-20T18:24:36,788 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-20T18:24:36,793 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-20T18:24:36,795 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-20T18:24:36,803 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-03-20T18:24:36,807 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-20T18:24:36,810 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-03-20T18:24:36,815 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,817 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-20T18:24:36,819 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-20T18:24:36,823 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-20T18:24:36,827 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-20T18:24:36,830 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-03-20T18:24:36,834 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,839 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,848 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,853 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,857 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,862 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,864 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,867 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,871 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,875 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,878 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,882 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-03-20T18:24:36,885 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-03-20T18:24:36,889 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-20T18:24:36,891 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-20T18:24:36,895 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-20T18:24:36,901 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-03-20T18:24:36,904 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:36,908 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:36,912 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:36,916 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,918 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,922 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,940 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,945 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,949 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,953 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,958 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,962 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-03-20T18:24:36,967 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,969 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,972 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,976 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,979 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,983 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,986 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,990 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-03-20T18:24:36,994 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-20T18:24:36,996 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-20T18:24:37,000 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-20T18:24:37,004 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-20T18:24:37,008 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-03-20T18:24:37,012 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,014 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,018 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,023 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,027 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,031 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,035 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-03-20T18:24:37,038 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:37,043 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-03-20T18:24:37,045 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-03-20T18:24:37,050 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,053 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-20T18:24:37,055 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-20T18:24:37,060 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-20T18:24:37,065 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-20T18:24:37,069 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-03-20T18:24:37,074 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:37,075 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:37,080 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:37,083 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:37,087 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-03-20T18:24:37,090 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,095 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,101 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,105 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,110 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:37,112 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:37,116 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:37,122 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-03-20T18:24:37,125 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,132 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,136 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,142 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-20T18:24:37,143 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-20T18:24:37,147 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-03-20T18:24:37,151 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,156 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,161 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,163 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,169 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,174 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,177 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,182 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,186 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,195 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,201 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,216 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,220 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,229 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,234 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,237 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-03-20T18:24:37,243 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,245 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,250 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,255 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,259 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,264 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,268 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,271 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,276 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,280 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-03-20T18:24:37,284 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,289 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,290 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,296 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,302 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,306 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,314 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,318 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-03-20T18:24:37,323 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-20T18:24:37,325 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,327 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,333 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,336 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,342 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,347 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-03-20T18:24:37,351 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-20T18:24:37,355 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-20T18:24:37,360 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,362 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,366 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,370 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,374 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,378 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-03-20T18:24:37,382 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-20T18:24:37,386 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-03-20T18:24:37,390 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,402 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,408 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,413 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,419 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-20T18:24:37,422 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-20T18:24:37,430 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:37,432 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:37,437 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:37,442 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:37,448 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-03-20T18:24:37,452 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-20T18:24:37,457 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-20T18:24:37,464 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-03-20T18:24:37,467 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-03-20T18:24:37,472 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-03-20T18:24:37,475 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-03-20T18:24:37,479 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,482 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,486 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,491 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,496 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,501 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,505 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,510 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,514 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,518 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,521 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,526 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,529 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,533 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,537 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,541 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,547 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,552 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,555 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,561 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,564 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,568 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,572 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,577 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,581 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,585 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,590 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,594 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-03-20T18:24:37,599 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-03-20T18:24:37,601 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-03-20T18:24:37,607 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-03-20T18:24:37,610 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,612 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,617 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,622 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,625 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,629 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,633 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-03-20T18:24:37,638 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-03-20T18:24:37,641 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-03-20T18:24:37,647 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,649 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,653 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,657 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,661 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,665 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,669 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,673 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,677 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,681 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,686 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,690 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-03-20T18:24:37,695 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-20T18:24:37,696 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-20T18:24:37,701 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-03-20T18:24:37,706 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-03-20T18:24:37,708 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-03-20T18:24:37,713 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,715 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,721 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-03-20T18:24:37,724 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,726 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,737 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,741 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,745 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,750 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,757 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,763 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,768 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-03-20T18:24:37,775 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:37,776 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:37,781 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:37,786 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-03-20T18:24:37,791 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,797 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,803 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,809 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,814 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,819 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,827 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-03-20T18:24:37,833 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-03-20T18:24:37,836 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:37,838 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:37,842 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-03-20T18:24:37,848 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-03-20T18:24:37,850 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-03-20T18:24:37,855 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-20T18:24:37,857 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-20T18:24:37,861 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-20T18:24:37,865 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-20T18:24:37,870 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-03-20T18:24:37,877 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-20T18:24:37,879 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-20T18:24:37,884 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-20T18:24:37,887 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-20T18:24:37,892 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-03-20T18:24:37,897 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:37,899 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:37,904 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:37,908 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:37,912 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-03-20T18:24:37,917 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-03-20T18:24:37,919 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-03-20T18:24:37,924 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-03-20T18:24:37,926 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-03-20T18:24:37,931 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,933 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,937 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,941 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,944 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,948 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,951 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,955 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,958 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,962 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,966 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,969 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,973 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,976 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,980 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,984 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,987 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-03-20T18:24:37,994 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-20T18:24:37,996 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-20T18:24:38,000 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-03-20T18:24:38,005 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-03-20T18:24:38,006 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-03-20T18:24:38,011 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-20T18:24:38,013 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-20T18:24:38,018 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-03-20T18:24:38,022 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-20T18:24:38,025 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,027 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,031 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,037 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,041 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,045 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,049 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,054 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,058 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,062 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,066 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,068 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,072 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,075 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,079 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,082 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,086 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,089 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,093 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,096 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,100 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-03-20T18:24:38,103 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-03-20T18:24:38,106 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-20T18:24:38,112 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-03-20T18:24:38,116 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-20T18:24:38,118 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-20T18:24:38,122 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-20T18:24:38,126 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-20T18:24:38,130 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-03-20T18:24:38,134 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-20T18:24:38,136 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-20T18:24:38,139 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-03-20T18:24:38,144 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-20T18:24:38,145 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-20T18:24:38,150 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-03-20T18:24:38,154 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,156 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,161 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,167 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,172 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:38,173 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:38,177 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:38,181 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:38,185 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-03-20T18:24:38,189 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,192 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,199 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,202 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-03-20T18:24:38,207 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-03-20T18:24:38,212 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,214 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,217 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,221 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,225 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,229 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,233 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,237 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,241 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,245 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,249 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,254 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,257 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,263 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-03-20T18:24:38,267 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-20T18:24:38,268 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-20T18:24:38,272 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-20T18:24:38,276 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-03-20T18:24:38,280 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-03-20T18:24:38,283 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-20T18:24:38,285 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-20T18:24:38,289 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-20T18:24:38,293 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-03-20T18:24:38,298 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,299 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,303 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,308 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,311 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,315 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,318 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,322 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,326 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,329 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-03-20T18:24:38,334 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-20T18:24:38,336 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-20T18:24:38,339 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-03-20T18:24:38,343 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-03-20T18:24:38,346 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-03-20T18:24:38,352 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,354 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,358 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,363 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,366 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,370 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,375 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,378 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,382 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,386 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-03-20T18:24:38,391 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,392 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,397 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,401 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,407 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,411 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,415 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,420 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,422 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,425 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,429 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,433 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,436 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,440 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,445 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,449 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,452 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,456 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,459 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,462 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,467 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-20T18:24:38,469 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-20T18:24:38,473 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-20T18:24:38,476 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-03-20T18:24:38,479 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,483 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,487 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,490 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-03-20T18:24:38,494 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,498 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,501 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,505 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-03-20T18:24:38,509 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,511 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,517 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,521 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,525 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,529 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-03-20T18:24:38,532 running install_egg_info 2023-03-20T18:24:38,601 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.8.3-py3.7.egg-info 2023-03-20T18:24:38,631 running install_scripts 2023-03-20T18:24:38,634 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data 2023-03-20T18:24:38,635 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,637 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,640 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,644 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,647 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,650 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,654 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,657 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,661 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts 2023-03-20T18:24:38,665 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/ds_report to 755 2023-03-20T18:24:38,665 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/deepspeed to 755 2023-03-20T18:24:38,666 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/ds_ssh to 755 2023-03-20T18:24:38,667 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/dsr to 755 2023-03-20T18:24:38,668 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/ds_elastic to 755 2023-03-20T18:24:38,669 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/ds to 755 2023-03-20T18:24:38,670 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/ds_bench to 755 2023-03-20T18:24:38,670 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.data/scripts/deepspeed.pt to 755 2023-03-20T18:24:38,794 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.3.dist-info/WHEEL 2023-03-20T18:24:38,799 creating '/tmp/pip-wheel-1c1t244p/deepspeed-0.8.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-03-20T18:24:38,807 adding 'deepspeed/__init__.py' 2023-03-20T18:24:38,810 adding 'deepspeed/constants.py' 2023-03-20T18:24:38,813 adding 'deepspeed/env_report.py' 2023-03-20T18:24:38,816 adding 'deepspeed/git_version_info.py' 2023-03-20T18:24:38,818 adding 'deepspeed/git_version_info_installed.py' 2023-03-20T18:24:38,822 adding 'deepspeed/accelerator/__init__.py' 2023-03-20T18:24:38,825 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-03-20T18:24:38,828 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-03-20T18:24:38,832 adding 'deepspeed/accelerator/real_accelerator.py' 2023-03-20T18:24:38,835 adding 'deepspeed/autotuning/__init__.py' 2023-03-20T18:24:38,849 adding 'deepspeed/autotuning/autotuner.py' 2023-03-20T18:24:38,853 adding 'deepspeed/autotuning/config.py' 2023-03-20T18:24:38,856 adding 'deepspeed/autotuning/constants.py' 2023-03-20T18:24:38,862 adding 'deepspeed/autotuning/scheduler.py' 2023-03-20T18:24:38,867 adding 'deepspeed/autotuning/utils.py' 2023-03-20T18:24:38,871 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-03-20T18:24:38,874 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-03-20T18:24:38,876 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-03-20T18:24:38,878 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-03-20T18:24:38,882 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-03-20T18:24:38,885 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-03-20T18:24:38,888 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-03-20T18:24:38,891 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-03-20T18:24:38,894 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-03-20T18:24:38,897 adding 'deepspeed/autotuning/tuner/utils.py' 2023-03-20T18:24:38,901 adding 'deepspeed/checkpoint/__init__.py' 2023-03-20T18:24:38,903 adding 'deepspeed/checkpoint/constants.py' 2023-03-20T18:24:38,908 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-03-20T18:24:38,911 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-03-20T18:24:38,915 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-03-20T18:24:38,918 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-03-20T18:24:38,921 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-03-20T18:24:38,924 adding 'deepspeed/checkpoint/utils.py' 2023-03-20T18:24:38,927 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-03-20T18:24:38,931 adding 'deepspeed/comm/__init__.py' 2023-03-20T18:24:38,934 adding 'deepspeed/comm/backend.py' 2023-03-20T18:24:38,941 adding 'deepspeed/comm/comm.py' 2023-03-20T18:24:38,945 adding 'deepspeed/comm/config.py' 2023-03-20T18:24:38,947 adding 'deepspeed/comm/constants.py' 2023-03-20T18:24:38,951 adding 'deepspeed/comm/torch.py' 2023-03-20T18:24:38,954 adding 'deepspeed/comm/utils.py' 2023-03-20T18:24:38,958 adding 'deepspeed/compression/__init__.py' 2023-03-20T18:24:38,966 adding 'deepspeed/compression/basic_layer.py' 2023-03-20T18:24:38,971 adding 'deepspeed/compression/compress.py' 2023-03-20T18:24:38,976 adding 'deepspeed/compression/config.py' 2023-03-20T18:24:38,980 adding 'deepspeed/compression/constants.py' 2023-03-20T18:24:38,984 adding 'deepspeed/compression/helper.py' 2023-03-20T18:24:38,987 adding 'deepspeed/compression/scheduler.py' 2023-03-20T18:24:38,991 adding 'deepspeed/compression/utils.py' 2023-03-20T18:24:38,995 adding 'deepspeed/elasticity/__init__.py' 2023-03-20T18:24:38,998 adding 'deepspeed/elasticity/config.py' 2023-03-20T18:24:39,001 adding 'deepspeed/elasticity/constants.py' 2023-03-20T18:24:39,005 adding 'deepspeed/elasticity/elastic_agent.py' 2023-03-20T18:24:39,010 adding 'deepspeed/elasticity/elasticity.py' 2023-03-20T18:24:39,013 adding 'deepspeed/elasticity/utils.py' 2023-03-20T18:24:39,017 adding 'deepspeed/inference/__init__.py' 2023-03-20T18:24:39,021 adding 'deepspeed/inference/config.py' 2023-03-20T18:24:39,029 adding 'deepspeed/inference/engine.py' 2023-03-20T18:24:39,033 adding 'deepspeed/launcher/__init__.py' 2023-03-20T18:24:39,035 adding 'deepspeed/launcher/constants.py' 2023-03-20T18:24:39,040 adding 'deepspeed/launcher/launch.py' 2023-03-20T18:24:39,044 adding 'deepspeed/launcher/multinode_runner.py' 2023-03-20T18:24:39,051 adding 'deepspeed/launcher/runner.py' 2023-03-20T18:24:39,055 adding 'deepspeed/model_implementations/__init__.py' 2023-03-20T18:24:39,059 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-03-20T18:24:39,061 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-03-20T18:24:39,064 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-03-20T18:24:39,068 adding 'deepspeed/model_implementations/features/__init__.py' 2023-03-20T18:24:39,070 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-03-20T18:24:39,074 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-03-20T18:24:39,076 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-03-20T18:24:39,079 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-03-20T18:24:39,081 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-03-20T18:24:39,084 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-03-20T18:24:39,086 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-03-20T18:24:39,089 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-03-20T18:24:39,091 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-03-20T18:24:39,095 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-03-20T18:24:39,098 adding 'deepspeed/module_inject/__init__.py' 2023-03-20T18:24:39,101 adding 'deepspeed/module_inject/auto_tp.py' 2023-03-20T18:24:39,105 adding 'deepspeed/module_inject/inject.py' 2023-03-20T18:24:39,107 adding 'deepspeed/module_inject/layers.py' 2023-03-20T18:24:39,112 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-03-20T18:24:39,115 adding 'deepspeed/module_inject/module_quantize.py' 2023-03-20T18:24:39,118 adding 'deepspeed/module_inject/policy.py' 2023-03-20T18:24:39,128 adding 'deepspeed/module_inject/replace_module.py' 2023-03-20T18:24:39,131 adding 'deepspeed/module_inject/replace_policy.py' 2023-03-20T18:24:39,133 adding 'deepspeed/module_inject/utils.py' 2023-03-20T18:24:39,137 adding 'deepspeed/module_inject/containers/__init__.py' 2023-03-20T18:24:39,141 adding 'deepspeed/module_inject/containers/base.py' 2023-03-20T18:24:39,145 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-03-20T18:24:39,148 adding 'deepspeed/module_inject/containers/bert.py' 2023-03-20T18:24:39,151 adding 'deepspeed/module_inject/containers/bloom.py' 2023-03-20T18:24:39,153 adding 'deepspeed/module_inject/containers/clip.py' 2023-03-20T18:24:39,156 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-03-20T18:24:39,159 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-03-20T18:24:39,162 adding 'deepspeed/module_inject/containers/gptj.py' 2023-03-20T18:24:39,164 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-03-20T18:24:39,167 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-03-20T18:24:39,171 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-03-20T18:24:39,173 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-03-20T18:24:39,176 adding 'deepspeed/module_inject/containers/opt.py' 2023-03-20T18:24:39,179 adding 'deepspeed/module_inject/containers/unet.py' 2023-03-20T18:24:39,182 adding 'deepspeed/module_inject/containers/vae.py' 2023-03-20T18:24:39,185 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-03-20T18:24:39,188 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-03-20T18:24:39,191 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-03-20T18:24:39,194 adding 'deepspeed/moe/__init__.py' 2023-03-20T18:24:39,196 adding 'deepspeed/moe/experts.py' 2023-03-20T18:24:39,200 adding 'deepspeed/moe/layer.py' 2023-03-20T18:24:39,203 adding 'deepspeed/moe/mappings.py' 2023-03-20T18:24:39,209 adding 'deepspeed/moe/sharded_moe.py' 2023-03-20T18:24:39,213 adding 'deepspeed/moe/utils.py' 2023-03-20T18:24:39,216 adding 'deepspeed/monitor/__init__.py' 2023-03-20T18:24:39,219 adding 'deepspeed/monitor/config.py' 2023-03-20T18:24:39,222 adding 'deepspeed/monitor/csv_monitor.py' 2023-03-20T18:24:39,224 adding 'deepspeed/monitor/monitor.py' 2023-03-20T18:24:39,227 adding 'deepspeed/monitor/tensorboard.py' 2023-03-20T18:24:39,230 adding 'deepspeed/monitor/utils.py' 2023-03-20T18:24:39,232 adding 'deepspeed/monitor/wandb.py' 2023-03-20T18:24:39,236 adding 'deepspeed/nebula/__init__.py' 2023-03-20T18:24:39,238 adding 'deepspeed/nebula/config.py' 2023-03-20T18:24:39,241 adding 'deepspeed/nebula/constants.py' 2023-03-20T18:24:39,245 adding 'deepspeed/ops/__init__.py' 2023-03-20T18:24:39,248 adding 'deepspeed/ops/adagrad/__init__.py' 2023-03-20T18:24:39,251 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-03-20T18:24:39,255 adding 'deepspeed/ops/adam/__init__.py' 2023-03-20T18:24:39,259 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-03-20T18:24:39,262 adding 'deepspeed/ops/adam/fused_adam.py' 2023-03-20T18:24:39,265 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-03-20T18:24:39,268 adding 'deepspeed/ops/aio/__init__.py' 2023-03-20T18:24:39,274 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-03-20T18:24:39,279 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-03-20T18:24:39,281 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-03-20T18:24:39,284 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-03-20T18:24:39,288 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-03-20T18:24:39,294 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-03-20T18:24:39,297 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-03-20T18:24:39,300 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-03-20T18:24:39,302 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-03-20T18:24:39,305 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-03-20T18:24:39,308 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-03-20T18:24:39,312 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-03-20T18:24:39,315 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-03-20T18:24:39,317 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-03-20T18:24:39,320 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-03-20T18:24:39,323 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-03-20T18:24:39,325 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-03-20T18:24:39,329 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-03-20T18:24:39,332 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-03-20T18:24:39,335 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-03-20T18:24:39,337 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-03-20T18:24:39,340 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-03-20T18:24:39,343 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-03-20T18:24:39,347 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-03-20T18:24:39,351 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-03-20T18:24:39,354 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-03-20T18:24:39,356 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-03-20T18:24:39,360 adding 'deepspeed/ops/csrc/includes/context.h' 2023-03-20T18:24:39,364 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-03-20T18:24:39,367 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-03-20T18:24:39,371 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-03-20T18:24:39,373 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-03-20T18:24:39,377 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-03-20T18:24:39,381 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-03-20T18:24:39,384 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-03-20T18:24:39,387 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-03-20T18:24:39,390 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-03-20T18:24:39,393 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-03-20T18:24:39,395 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-03-20T18:24:39,399 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-03-20T18:24:39,402 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-03-20T18:24:39,407 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-03-20T18:24:39,411 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-03-20T18:24:39,414 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-03-20T18:24:39,418 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-03-20T18:24:39,421 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-03-20T18:24:39,426 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-03-20T18:24:39,430 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-03-20T18:24:39,432 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-03-20T18:24:39,436 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-03-20T18:24:39,439 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-03-20T18:24:39,443 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-03-20T18:24:39,447 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-03-20T18:24:39,452 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-03-20T18:24:39,458 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-03-20T18:24:39,462 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-03-20T18:24:39,465 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-03-20T18:24:39,470 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-03-20T18:24:39,473 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-03-20T18:24:39,476 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-03-20T18:24:39,480 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-03-20T18:24:39,484 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-03-20T18:24:39,489 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-03-20T18:24:39,492 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-03-20T18:24:39,496 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-03-20T18:24:39,501 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-03-20T18:24:39,507 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-03-20T18:24:39,517 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-03-20T18:24:39,522 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-03-20T18:24:39,526 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-03-20T18:24:39,536 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-03-20T18:24:39,544 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-03-20T18:24:39,550 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-03-20T18:24:39,557 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-03-20T18:24:39,561 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-03-20T18:24:39,568 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-03-20T18:24:39,573 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-03-20T18:24:39,587 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-03-20T18:24:39,591 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-03-20T18:24:39,597 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-03-20T18:24:39,604 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-03-20T18:24:39,609 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-03-20T18:24:39,614 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-03-20T18:24:39,617 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-03-20T18:24:39,621 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-03-20T18:24:39,624 adding 'deepspeed/ops/lamb/__init__.py' 2023-03-20T18:24:39,628 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-03-20T18:24:39,633 adding 'deepspeed/ops/op_builder/__init__.py' 2023-03-20T18:24:39,635 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-03-20T18:24:39,638 adding 'deepspeed/ops/op_builder/async_io.py' 2023-03-20T18:24:39,646 adding 'deepspeed/ops/op_builder/builder.py' 2023-03-20T18:24:39,649 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-03-20T18:24:39,652 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-03-20T18:24:39,655 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-03-20T18:24:39,657 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-03-20T18:24:39,660 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-03-20T18:24:39,662 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-03-20T18:24:39,665 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-03-20T18:24:39,668 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-03-20T18:24:39,670 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-03-20T18:24:39,673 adding 'deepspeed/ops/op_builder/transformer.py' 2023-03-20T18:24:39,676 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-03-20T18:24:39,678 adding 'deepspeed/ops/op_builder/utils.py' 2023-03-20T18:24:39,682 adding 'deepspeed/ops/quantizer/__init__.py' 2023-03-20T18:24:39,684 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-03-20T18:24:39,688 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-03-20T18:24:39,691 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-03-20T18:24:39,695 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-03-20T18:24:39,697 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-03-20T18:24:39,707 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-03-20T18:24:39,712 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-03-20T18:24:39,717 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-03-20T18:24:39,721 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-03-20T18:24:39,728 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-03-20T18:24:39,733 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-03-20T18:24:39,737 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-03-20T18:24:39,739 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-03-20T18:24:39,743 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-03-20T18:24:39,746 adding 'deepspeed/ops/transformer/__init__.py' 2023-03-20T18:24:39,753 adding 'deepspeed/ops/transformer/transformer.py' 2023-03-20T18:24:39,757 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-03-20T18:24:39,760 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-03-20T18:24:39,763 adding 'deepspeed/ops/transformer/inference/config.py' 2023-03-20T18:24:39,765 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-03-20T18:24:39,769 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-03-20T18:24:39,773 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-03-20T18:24:39,780 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-03-20T18:24:39,783 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-03-20T18:24:39,789 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-03-20T18:24:39,793 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-03-20T18:24:39,797 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-03-20T18:24:39,799 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-03-20T18:24:39,802 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-03-20T18:24:39,805 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-03-20T18:24:39,807 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-03-20T18:24:39,810 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-03-20T18:24:39,813 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-03-20T18:24:39,817 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-03-20T18:24:39,820 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-03-20T18:24:39,824 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-03-20T18:24:39,828 adding 'deepspeed/pipe/__init__.py' 2023-03-20T18:24:39,832 adding 'deepspeed/profiling/__init__.py' 2023-03-20T18:24:39,834 adding 'deepspeed/profiling/config.py' 2023-03-20T18:24:39,837 adding 'deepspeed/profiling/constants.py' 2023-03-20T18:24:39,840 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-03-20T18:24:39,853 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-03-20T18:24:39,859 adding 'deepspeed/runtime/__init__.py' 2023-03-20T18:24:39,866 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-03-20T18:24:39,877 adding 'deepspeed/runtime/config.py' 2023-03-20T18:24:39,881 adding 'deepspeed/runtime/config_utils.py' 2023-03-20T18:24:39,886 adding 'deepspeed/runtime/constants.py' 2023-03-20T18:24:39,889 adding 'deepspeed/runtime/dataloader.py' 2023-03-20T18:24:39,893 adding 'deepspeed/runtime/eigenvalue.py' 2023-03-20T18:24:39,934 adding 'deepspeed/runtime/engine.py' 2023-03-20T18:24:39,945 adding 'deepspeed/runtime/lr_schedules.py' 2023-03-20T18:24:39,949 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-03-20T18:24:39,952 adding 'deepspeed/runtime/quantize.py' 2023-03-20T18:24:39,956 adding 'deepspeed/runtime/sparse_tensor.py' 2023-03-20T18:24:39,961 adding 'deepspeed/runtime/state_dict_factory.py' 2023-03-20T18:24:39,971 adding 'deepspeed/runtime/utils.py' 2023-03-20T18:24:39,976 adding 'deepspeed/runtime/weight_quantizer.py' 2023-03-20T18:24:39,979 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-03-20T18:24:39,988 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-03-20T18:24:39,992 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-03-20T18:24:39,995 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-03-20T18:24:39,998 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-03-20T18:24:40,001 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-03-20T18:24:40,004 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-03-20T18:24:40,007 adding 'deepspeed/runtime/comm/__init__.py' 2023-03-20T18:24:40,010 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-03-20T18:24:40,014 adding 'deepspeed/runtime/comm/mpi.py' 2023-03-20T18:24:40,018 adding 'deepspeed/runtime/comm/nccl.py' 2023-03-20T18:24:40,022 adding 'deepspeed/runtime/compression/__init__.py' 2023-03-20T18:24:40,024 adding 'deepspeed/runtime/compression/cupy.py' 2023-03-20T18:24:40,027 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-03-20T18:24:40,030 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-03-20T18:24:40,033 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-03-20T18:24:40,037 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-03-20T18:24:40,041 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-03-20T18:24:40,044 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-03-20T18:24:40,046 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-03-20T18:24:40,049 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-03-20T18:24:40,052 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-03-20T18:24:40,056 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-03-20T18:24:40,062 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-03-20T18:24:40,068 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-03-20T18:24:40,075 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-03-20T18:24:40,078 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-03-20T18:24:40,081 adding 'deepspeed/runtime/fp16/__init__.py' 2023-03-20T18:24:40,087 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-03-20T18:24:40,092 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-03-20T18:24:40,098 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-03-20T18:24:40,102 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-03-20T18:24:40,107 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-03-20T18:24:40,113 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-03-20T18:24:40,119 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-03-20T18:24:40,123 adding 'deepspeed/runtime/pipe/__init__.py' 2023-03-20T18:24:40,138 adding 'deepspeed/runtime/pipe/engine.py' 2023-03-20T18:24:40,148 adding 'deepspeed/runtime/pipe/module.py' 2023-03-20T18:24:40,151 adding 'deepspeed/runtime/pipe/p2p.py' 2023-03-20T18:24:40,156 adding 'deepspeed/runtime/pipe/schedule.py' 2023-03-20T18:24:40,162 adding 'deepspeed/runtime/pipe/topology.py' 2023-03-20T18:24:40,166 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-03-20T18:24:40,169 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-03-20T18:24:40,172 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-03-20T18:24:40,175 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-03-20T18:24:40,181 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-03-20T18:24:40,185 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-03-20T18:24:40,191 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-03-20T18:24:40,195 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-03-20T18:24:40,199 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-03-20T18:24:40,203 adding 'deepspeed/runtime/zero/__init__.py' 2023-03-20T18:24:40,207 adding 'deepspeed/runtime/zero/config.py' 2023-03-20T18:24:40,211 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-03-20T18:24:40,215 adding 'deepspeed/runtime/zero/linear.py' 2023-03-20T18:24:40,218 adding 'deepspeed/runtime/zero/offload_config.py' 2023-03-20T18:24:40,224 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-03-20T18:24:40,244 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-03-20T18:24:40,252 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-03-20T18:24:40,284 adding 'deepspeed/runtime/zero/stage3.py' 2023-03-20T18:24:40,317 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-03-20T18:24:40,322 adding 'deepspeed/runtime/zero/test.py' 2023-03-20T18:24:40,326 adding 'deepspeed/runtime/zero/tiling.py' 2023-03-20T18:24:40,330 adding 'deepspeed/runtime/zero/utils.py' 2023-03-20T18:24:40,333 adding 'deepspeed/utils/__init__.py' 2023-03-20T18:24:40,337 adding 'deepspeed/utils/comms_logging.py' 2023-03-20T18:24:40,340 adding 'deepspeed/utils/debug.py' 2023-03-20T18:24:40,343 adding 'deepspeed/utils/exceptions.py' 2023-03-20T18:24:40,347 adding 'deepspeed/utils/groups.py' 2023-03-20T18:24:40,351 adding 'deepspeed/utils/init_on_device.py' 2023-03-20T18:24:40,354 adding 'deepspeed/utils/logging.py' 2023-03-20T18:24:40,356 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-03-20T18:24:40,359 adding 'deepspeed/utils/nvtx.py' 2023-03-20T18:24:40,363 adding 'deepspeed/utils/tensor_fragment.py' 2023-03-20T18:24:40,367 adding 'deepspeed/utils/timer.py' 2023-03-20T18:24:40,369 adding 'deepspeed/utils/types.py' 2023-03-20T18:24:40,375 adding 'deepspeed/utils/zero_to_fp32.py' 2023-03-20T18:24:40,380 adding 'deepspeed-0.8.3.data/scripts/deepspeed' 2023-03-20T18:24:40,382 adding 'deepspeed-0.8.3.data/scripts/deepspeed.pt' 2023-03-20T18:24:40,385 adding 'deepspeed-0.8.3.data/scripts/ds' 2023-03-20T18:24:40,387 adding 'deepspeed-0.8.3.data/scripts/ds_bench' 2023-03-20T18:24:40,390 adding 'deepspeed-0.8.3.data/scripts/ds_elastic' 2023-03-20T18:24:40,392 adding 'deepspeed-0.8.3.data/scripts/ds_report' 2023-03-20T18:24:40,395 adding 'deepspeed-0.8.3.data/scripts/ds_ssh' 2023-03-20T18:24:40,397 adding 'deepspeed-0.8.3.data/scripts/dsr' 2023-03-20T18:24:40,402 adding 'deepspeed-0.8.3.dist-info/LICENSE' 2023-03-20T18:24:40,410 adding 'deepspeed-0.8.3.dist-info/METADATA' 2023-03-20T18:24:40,413 adding 'deepspeed-0.8.3.dist-info/WHEEL' 2023-03-20T18:24:40,414 adding 'deepspeed-0.8.3.dist-info/entry_points.txt' 2023-03-20T18:24:40,416 adding 'deepspeed-0.8.3.dist-info/top_level.txt' 2023-03-20T18:24:40,432 adding 'deepspeed-0.8.3.dist-info/RECORD' 2023-03-20T18:24:40,475 removing build/bdist.linux-armv7l/wheel 2023-03-20T18:24:40,702 deepspeed build time = 11.682222843170166 secs 2023-03-20T18:24:40,881 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-03-20T18:24:40,910 Created wheel for deepspeed: filename=deepspeed-0.8.3-py3-none-any.whl size=776366 sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 2023-03-20T18:24:40,912 Stored in directory: /tmp/pip-ephem-wheel-cache-ktw8dybf/wheels/65/b4/e2/ce72a2f401f90f278ab3ba42057b0b119861b3c6704640699d 2023-03-20T18:24:40,978 Successfully built deepspeed 2023-03-20T18:24:41,046 Removed build tracker: '/tmp/pip-build-tracker-ja1r_nz1'