2023-08-31T18:11:46,780 Created temporary directory: /tmp/pip-build-tracker-i3mcxbka 2023-08-31T18:11:46,783 Initialized build tracking at /tmp/pip-build-tracker-i3mcxbka 2023-08-31T18:11:46,784 Created build tracker: /tmp/pip-build-tracker-i3mcxbka 2023-08-31T18:11:46,784 Entered build tracker: /tmp/pip-build-tracker-i3mcxbka 2023-08-31T18:11:46,785 Created temporary directory: /tmp/pip-wheel-8bkr6pzh 2023-08-31T18:11:46,794 Created temporary directory: /tmp/pip-ephem-wheel-cache-o29k8lbk 2023-08-31T18:11:46,856 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-08-31T18:11:46,864 2 location(s) to search for versions of deepspeed: 2023-08-31T18:11:46,864 * https://pypi.org/simple/deepspeed/ 2023-08-31T18:11:46,864 * https://www.piwheels.org/simple/deepspeed/ 2023-08-31T18:11:46,865 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-08-31T18:11:46,867 Getting page https://pypi.org/simple/deepspeed/ 2023-08-31T18:11:46,871 Found index url https://pypi.org/simple/ 2023-08-31T18:11:47,062 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-08-31T18:11:47,099 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-08-31T18:11:47,099 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-08-31T18:11:47,100 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-08-31T18:11:47,101 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-08-31T18:11:47,102 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-08-31T18:11:47,102 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-08-31T18:11:47,103 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-08-31T18:11:47,104 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-08-31T18:11:47,104 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-08-31T18:11:47,105 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-08-31T18:11:47,106 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-08-31T18:11:47,106 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-08-31T18:11:47,107 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-08-31T18:11:47,108 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-08-31T18:11:47,108 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-08-31T18:11:47,109 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-08-31T18:11:47,110 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-08-31T18:11:47,111 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-08-31T18:11:47,111 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-08-31T18:11:47,112 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-08-31T18:11:47,113 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-08-31T18:11:47,113 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-08-31T18:11:47,114 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-08-31T18:11:47,115 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-08-31T18:11:47,115 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-08-31T18:11:47,116 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-08-31T18:11:47,117 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-08-31T18:11:47,118 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-08-31T18:11:47,118 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-08-31T18:11:47,119 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-08-31T18:11:47,120 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-08-31T18:11:47,120 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-08-31T18:11:47,121 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-08-31T18:11:47,122 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-08-31T18:11:47,122 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-08-31T18:11:47,123 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-08-31T18:11:47,124 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-08-31T18:11:47,125 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-08-31T18:11:47,125 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-08-31T18:11:47,126 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-08-31T18:11:47,127 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-08-31T18:11:47,127 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-08-31T18:11:47,128 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-08-31T18:11:47,129 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-08-31T18:11:47,129 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-08-31T18:11:47,130 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-08-31T18:11:47,131 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-08-31T18:11:47,131 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-08-31T18:11:47,132 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-08-31T18:11:47,133 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-08-31T18:11:47,133 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-08-31T18:11:47,134 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-08-31T18:11:47,135 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-08-31T18:11:47,136 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-08-31T18:11:47,136 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-08-31T18:11:47,137 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-08-31T18:11:47,138 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-08-31T18:11:47,138 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-08-31T18:11:47,139 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-08-31T18:11:47,140 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-08-31T18:11:47,140 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-08-31T18:11:47,141 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-08-31T18:11:47,142 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-08-31T18:11:47,142 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-08-31T18:11:47,143 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-08-31T18:11:47,144 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-08-31T18:11:47,145 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-08-31T18:11:47,145 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-08-31T18:11:47,146 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-08-31T18:11:47,147 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-08-31T18:11:47,147 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-08-31T18:11:47,148 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-08-31T18:11:47,149 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-08-31T18:11:47,149 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-08-31T18:11:47,150 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-08-31T18:11:47,151 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-08-31T18:11:47,154 Found index url https://www.piwheels.org/simple/ 2023-08-31T18:11:47,392 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-08-31T18:11:47,424 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,425 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,426 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,426 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,427 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,427 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,428 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,428 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,429 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,430 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,430 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,431 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,431 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,432 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,432 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,433 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,433 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,434 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,434 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,435 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,435 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,436 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,436 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,437 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,438 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,438 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,439 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,439 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,440 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,440 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,441 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,441 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,442 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,442 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,443 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,443 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,444 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,444 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,445 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,445 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,446 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,446 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,447 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,448 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-08-31T18:11:47,448 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-08-31T18:11:47,449 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-08-31T18:11:47,505 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-08-31T18:11:47,537 Collecting deepspeed==0.10.2 2023-08-31T18:11:47,541 Created temporary directory: /tmp/pip-unpack-emm9_6v1 2023-08-31T18:11:47,725 Downloading deepspeed-0.10.2.tar.gz (858 kB) 2023-08-31T18:11:50,802 Added deepspeed==0.10.2 from https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz to build tracker '/tmp/pip-build-tracker-i3mcxbka' 2023-08-31T18:11:50,807 Running setup.py (path:/tmp/pip-wheel-8bkr6pzh/deepspeed_625338b8a80a4c82af651826d8a7f1b4/setup.py) egg_info for package deepspeed 2023-08-31T18:11:50,808 Created temporary directory: /tmp/pip-pip-egg-info-8f3ix4pk 2023-08-31T18:11:50,809 Preparing metadata (setup.py): started 2023-08-31T18:11:50,811 Running command python setup.py egg_info 2023-08-31T18:11:52,874 fatal: not a git repository (or any of the parent directories): .git 2023-08-31T18:11:53,795 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-08-31T18:11:53,796  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-08-31T18:11:53,796 DS_BUILD_OPS=0 2023-08-31T18:11:53,797  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-08-31T18:11:53,797  [WARNING]  async_io: please install the libaio-dev package with apt 2023-08-31T18:11:53,797  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-08-31T18:11:53,798  [WARNING]  unable to import torch, please install it first 2023-08-31T18:11:53,798  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-08-31T18:11:53,799  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-08-31T18:11:53,799 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-08-31T18:11:53,800 version=0.10.2, git_hash=unknown, git_branch=unknown 2023-08-31T18:11:53,800 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-08-31T18:11:53,801 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-08-31T18:11:53,801 ext_modules=[] 2023-08-31T18:11:53,802 running egg_info 2023-08-31T18:11:53,802 creating /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info 2023-08-31T18:11:53,910 writing /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/PKG-INFO 2023-08-31T18:11:53,917 writing dependency_links to /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/dependency_links.txt 2023-08-31T18:11:53,921 writing entry points to /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/entry_points.txt 2023-08-31T18:11:53,926 writing requirements to /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/requires.txt 2023-08-31T18:11:53,929 writing top-level names to /tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/top_level.txt 2023-08-31T18:11:53,932 writing manifest file '/tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/SOURCES.txt' 2023-08-31T18:11:54,487 reading manifest file '/tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/SOURCES.txt' 2023-08-31T18:11:54,491 reading manifest template 'MANIFEST.in' 2023-08-31T18:11:55,997 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-08-31T18:11:57,052 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-08-31T18:11:57,792 warning: no files found matching '*.tr' under directory 'csrc' 2023-08-31T18:11:57,964 warning: no files found matching '*.cc' under directory 'csrc' 2023-08-31T18:11:58,005 warning: no files found matching '*.py' under directory 'benchmarks' 2023-08-31T18:11:58,016 adding license file 'LICENSE' 2023-08-31T18:11:58,077 writing manifest file '/tmp/pip-pip-egg-info-8f3ix4pk/deepspeed.egg-info/SOURCES.txt' 2023-08-31T18:11:58,081 deepspeed build time = 5.196596384048462 secs 2023-08-31T18:11:58,217 Preparing metadata (setup.py): finished with status 'done' 2023-08-31T18:11:58,238 Source in /tmp/pip-wheel-8bkr6pzh/deepspeed_625338b8a80a4c82af651826d8a7f1b4 has version 0.10.2, which satisfies requirement deepspeed==0.10.2 from https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz 2023-08-31T18:11:58,240 Removed deepspeed==0.10.2 from https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz from build tracker '/tmp/pip-build-tracker-i3mcxbka' 2023-08-31T18:11:58,258 Created temporary directory: /tmp/pip-unpack-j6be2m0h 2023-08-31T18:11:58,260 Building wheels for collected packages: deepspeed 2023-08-31T18:11:58,268 Created temporary directory: /tmp/pip-wheel-ojlyxsi5 2023-08-31T18:11:58,269 Building wheel for deepspeed (setup.py): started 2023-08-31T18:11:58,271 Destination directory: /tmp/pip-wheel-ojlyxsi5 2023-08-31T18:11:58,272 Running command python setup.py bdist_wheel 2023-08-31T18:11:59,380 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-08-31T18:11:59,404  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-08-31T18:11:59,516 DS_BUILD_OPS=0 2023-08-31T18:11:59,811  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-08-31T18:11:59,975  [WARNING]  async_io: please install the libaio-dev package with apt 2023-08-31T18:11:59,976  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-08-31T18:11:59,979  [WARNING]  unable to import torch, please install it first 2023-08-31T18:11:59,980  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-08-31T18:11:59,982  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-08-31T18:11:59,982 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-08-31T18:12:00,021 fatal: not a git repository (or any of the parent directories): .git 2023-08-31T18:12:00,026 version=0.10.2, git_hash=unknown, git_branch=unknown 2023-08-31T18:12:00,028 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-08-31T18:12:00,029 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-08-31T18:12:00,029 ext_modules=[] 2023-08-31T18:12:00,995 running bdist_wheel 2023-08-31T18:12:01,912 running build 2023-08-31T18:12:01,913 running build_py 2023-08-31T18:12:02,031 creating build 2023-08-31T18:12:02,032 creating build/lib 2023-08-31T18:12:02,034 creating build/lib/deepspeed 2023-08-31T18:12:02,036 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-08-31T18:12:02,039 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-08-31T18:12:02,043 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-08-31T18:12:02,048 copying deepspeed/constants.py -> build/lib/deepspeed 2023-08-31T18:12:02,051 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-08-31T18:12:02,056 creating build/lib/deepspeed/profiling 2023-08-31T18:12:02,058 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-08-31T18:12:02,062 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-08-31T18:12:02,065 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-08-31T18:12:02,070 creating build/lib/deepspeed/elasticity 2023-08-31T18:12:02,071 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,075 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,079 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,082 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,086 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,091 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-08-31T18:12:02,097 creating build/lib/deepspeed/module_inject 2023-08-31T18:12:02,099 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,102 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,106 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,110 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,113 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,117 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,120 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,124 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,128 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,132 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,138 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,142 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-08-31T18:12:02,149 creating build/lib/deepspeed/compression 2023-08-31T18:12:02,150 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,154 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,158 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,163 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,167 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,171 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,177 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,183 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-08-31T18:12:02,188 creating build/lib/deepspeed/inference 2023-08-31T18:12:02,190 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-08-31T18:12:02,193 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-08-31T18:12:02,197 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-08-31T18:12:02,204 creating build/lib/deepspeed/pipe 2023-08-31T18:12:02,206 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-08-31T18:12:02,211 creating build/lib/deepspeed/sequence 2023-08-31T18:12:02,213 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-08-31T18:12:02,216 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-08-31T18:12:02,222 creating build/lib/deepspeed/comm 2023-08-31T18:12:02,223 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,227 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,233 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,236 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,239 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,243 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,246 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,250 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,253 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-08-31T18:12:02,260 creating build/lib/deepspeed/utils 2023-08-31T18:12:02,262 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,267 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,270 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,275 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,278 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,283 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,288 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,292 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,297 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,301 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,305 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,309 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,313 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,317 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-08-31T18:12:02,322 creating build/lib/deepspeed/accelerator 2023-08-31T18:12:02,323 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,327 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,330 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,334 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,338 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,342 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,346 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-08-31T18:12:02,351 creating build/lib/deepspeed/moe 2023-08-31T18:12:02,353 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,356 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,360 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,363 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,367 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,371 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-08-31T18:12:02,379 creating build/lib/deepspeed/runtime 2023-08-31T18:12:02,380 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,385 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,388 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,392 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,397 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,402 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,406 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,410 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,414 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,419 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,424 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,429 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,433 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,439 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,444 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,456 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-08-31T18:12:02,461 creating build/lib/deepspeed/ops 2023-08-31T18:12:02,463 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-08-31T18:12:02,468 creating build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,469 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,473 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,476 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,480 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,483 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,487 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,491 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,495 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,499 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-08-31T18:12:02,504 creating build/lib/deepspeed/autotuning 2023-08-31T18:12:02,506 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,512 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,516 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,520 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,524 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,528 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-08-31T18:12:02,533 creating build/lib/deepspeed/model_implementations 2023-08-31T18:12:02,535 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-08-31T18:12:02,540 creating build/lib/deepspeed/launcher 2023-08-31T18:12:02,541 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-08-31T18:12:02,545 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-08-31T18:12:02,548 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-08-31T18:12:02,553 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-08-31T18:12:02,558 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-08-31T18:12:02,564 creating build/lib/deepspeed/nebula 2023-08-31T18:12:02,565 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-08-31T18:12:02,569 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-08-31T18:12:02,572 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-08-31T18:12:02,577 creating build/lib/deepspeed/monitor 2023-08-31T18:12:02,579 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,582 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,586 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,589 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,592 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,595 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,598 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-08-31T18:12:02,603 creating build/lib/deepspeed/profiling/flops_profiler 2023-08-31T18:12:02,605 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-08-31T18:12:02,609 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-08-31T18:12:02,618 creating build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,619 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,623 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,627 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,630 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,633 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,637 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,640 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,644 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,648 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,652 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,655 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,659 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,662 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,666 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,670 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,674 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,677 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-08-31T18:12:02,683 creating build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,685 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,689 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,692 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,696 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,699 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,703 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,707 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-08-31T18:12:02,712 creating build/lib/deepspeed/runtime/compression 2023-08-31T18:12:02,714 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-08-31T18:12:02,718 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-08-31T18:12:02,723 creating build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,725 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,729 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,733 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,738 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,743 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,749 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-08-31T18:12:02,757 creating build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,758 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,764 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,768 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,772 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,776 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,780 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,784 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,789 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,794 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-08-31T18:12:02,798 creating build/lib/deepspeed/runtime/comm 2023-08-31T18:12:02,800 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-08-31T18:12:02,806 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-08-31T18:12:02,810 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-08-31T18:12:02,813 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-08-31T18:12:02,819 creating build/lib/deepspeed/runtime/fp16 2023-08-31T18:12:02,820 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-08-31T18:12:02,824 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-08-31T18:12:02,829 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-08-31T18:12:02,834 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-08-31T18:12:02,841 creating build/lib/deepspeed/runtime/data_pipeline 2023-08-31T18:12:02,842 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-08-31T18:12:02,846 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-08-31T18:12:02,850 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-08-31T18:12:02,855 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-08-31T18:12:02,861 creating build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,863 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,869 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,875 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,880 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,883 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,888 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,891 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,895 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,902 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,906 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,910 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,914 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,923 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,933 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,937 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,943 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-08-31T18:12:02,955 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:02,957 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:02,964 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:02,968 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:02,973 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:02,975 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:02,979 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:02,983 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:02,987 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:02,992 creating build/lib/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:02,994 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:03,000 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:03,005 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:03,008 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:03,015 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,016 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,021 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,025 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,028 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,034 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:03,041 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,043 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,048 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,052 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,056 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,062 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:03,068 creating build/lib/deepspeed/ops/adagrad 2023-08-31T18:12:03,070 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-08-31T18:12:03,074 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-08-31T18:12:03,080 creating build/lib/deepspeed/ops/lamb 2023-08-31T18:12:03,082 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-08-31T18:12:03,086 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-08-31T18:12:03,092 creating build/lib/deepspeed/ops/aio 2023-08-31T18:12:03,093 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-08-31T18:12:03,098 creating build/lib/deepspeed/ops/transformer 2023-08-31T18:12:03,100 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-08-31T18:12:03,106 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-08-31T18:12:03,112 creating build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,114 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,118 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,121 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,125 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,129 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,135 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,139 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,143 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,147 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,150 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,154 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,158 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,161 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,164 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,168 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-08-31T18:12:03,173 creating build/lib/deepspeed/ops/adam 2023-08-31T18:12:03,175 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-08-31T18:12:03,178 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-08-31T18:12:03,183 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-08-31T18:12:03,187 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-08-31T18:12:03,192 creating build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,194 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,199 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,203 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,210 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,215 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,222 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,227 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-08-31T18:12:03,233 creating build/lib/deepspeed/ops/random_ltd 2023-08-31T18:12:03,235 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-08-31T18:12:03,240 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-08-31T18:12:03,246 creating build/lib/deepspeed/ops/quantizer 2023-08-31T18:12:03,248 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-08-31T18:12:03,253 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-08-31T18:12:03,259 creating build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,262 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,267 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,272 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,277 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,282 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,287 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,292 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,298 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,302 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,308 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-08-31T18:12:03,315 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,317 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,323 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,327 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,333 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,338 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,343 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,348 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,352 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,357 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,363 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:03,369 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,372 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,377 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,382 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,386 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,391 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,395 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,399 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,404 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,409 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,413 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:03,419 creating build/lib/deepspeed/ops/op_builder/npu 2023-08-31T18:12:03,421 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-08-31T18:12:03,426 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-08-31T18:12:03,430 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-08-31T18:12:03,436 creating build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,439 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,443 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,447 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,452 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,456 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,460 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:03,466 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:03,468 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:03,474 creating build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,476 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,481 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,484 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,488 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,491 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,495 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-08-31T18:12:03,500 creating build/lib/deepspeed/model_implementations/diffusers 2023-08-31T18:12:03,502 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-08-31T18:12:03,506 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-08-31T18:12:03,510 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-08-31T18:12:03,516 creating build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,517 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,522 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,526 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,529 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,533 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,536 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,540 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,543 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,547 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-08-31T18:12:03,552 creating build/lib/deepspeed/model_implementations/features 2023-08-31T18:12:03,553 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-08-31T18:12:03,557 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-08-31T18:12:03,562 running egg_info 2023-08-31T18:12:03,782 writing deepspeed.egg-info/PKG-INFO 2023-08-31T18:12:03,788 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-08-31T18:12:03,793 writing entry points to deepspeed.egg-info/entry_points.txt 2023-08-31T18:12:03,798 writing requirements to deepspeed.egg-info/requires.txt 2023-08-31T18:12:03,800 writing top-level names to deepspeed.egg-info/top_level.txt 2023-08-31T18:12:04,012 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-08-31T18:12:04,115 reading manifest template 'MANIFEST.in' 2023-08-31T18:12:05,571 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-08-31T18:12:06,645 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-08-31T18:12:07,341 warning: no files found matching '*.tr' under directory 'csrc' 2023-08-31T18:12:07,508 warning: no files found matching '*.cc' under directory 'csrc' 2023-08-31T18:12:07,551 warning: no files found matching '*.py' under directory 'benchmarks' 2023-08-31T18:12:07,562 adding license file 'LICENSE' 2023-08-31T18:12:07,640 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-08-31T18:12:07,659 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-08-31T18:12:07,659 !! 2023-08-31T18:12:07,660 ******************************************************************************** 2023-08-31T18:12:07,660 ############################ 2023-08-31T18:12:07,661 # Package would be ignored # 2023-08-31T18:12:07,661 ############################ 2023-08-31T18:12:07,661 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-08-31T18:12:07,662 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,662 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,663 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-08-31T18:12:07,663 to the `packages` configuration field. 2023-08-31T18:12:07,663 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,664 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,664 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,665 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,665 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,666 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-08-31T18:12:07,666 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-08-31T18:12:07,666 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,667 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,667 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,668 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,668 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,669 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,670 even if it does not contain any `.py` files. 2023-08-31T18:12:07,670 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,670 directory, all directories are treated like packages. 2023-08-31T18:12:07,671 ******************************************************************************** 2023-08-31T18:12:07,671 !! 2023-08-31T18:12:07,671 check.warn(importable) 2023-08-31T18:12:07,672 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-08-31T18:12:07,672 !! 2023-08-31T18:12:07,673 ******************************************************************************** 2023-08-31T18:12:07,673 ############################ 2023-08-31T18:12:07,674 # Package would be ignored # 2023-08-31T18:12:07,674 ############################ 2023-08-31T18:12:07,674 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-08-31T18:12:07,674 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,675 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,675 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-08-31T18:12:07,676 to the `packages` configuration field. 2023-08-31T18:12:07,676 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,677 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,677 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,677 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,678 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,679 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-08-31T18:12:07,679 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-08-31T18:12:07,679 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,680 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,680 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,681 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,681 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,682 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,682 even if it does not contain any `.py` files. 2023-08-31T18:12:07,683 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,683 directory, all directories are treated like packages. 2023-08-31T18:12:07,683 ******************************************************************************** 2023-08-31T18:12:07,684 !! 2023-08-31T18:12:07,684 check.warn(importable) 2023-08-31T18:12:07,684 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-08-31T18:12:07,685 !! 2023-08-31T18:12:07,685 ******************************************************************************** 2023-08-31T18:12:07,686 ############################ 2023-08-31T18:12:07,686 # Package would be ignored # 2023-08-31T18:12:07,686 ############################ 2023-08-31T18:12:07,687 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-08-31T18:12:07,687 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,687 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,688 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-08-31T18:12:07,688 to the `packages` configuration field. 2023-08-31T18:12:07,689 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,689 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,689 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,690 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,691 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,691 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-08-31T18:12:07,691 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-08-31T18:12:07,692 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,692 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,692 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,693 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,694 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,695 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,695 even if it does not contain any `.py` files. 2023-08-31T18:12:07,695 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,695 directory, all directories are treated like packages. 2023-08-31T18:12:07,696 ******************************************************************************** 2023-08-31T18:12:07,696 !! 2023-08-31T18:12:07,697 check.warn(importable) 2023-08-31T18:12:07,697 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-08-31T18:12:07,697 !! 2023-08-31T18:12:07,698 ******************************************************************************** 2023-08-31T18:12:07,698 ############################ 2023-08-31T18:12:07,698 # Package would be ignored # 2023-08-31T18:12:07,699 ############################ 2023-08-31T18:12:07,699 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-08-31T18:12:07,699 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,700 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,700 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-08-31T18:12:07,701 to the `packages` configuration field. 2023-08-31T18:12:07,701 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,701 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,702 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,702 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,703 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,704 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-08-31T18:12:07,704 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-08-31T18:12:07,704 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,704 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,705 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,705 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,706 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,707 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,707 even if it does not contain any `.py` files. 2023-08-31T18:12:07,707 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,708 directory, all directories are treated like packages. 2023-08-31T18:12:07,708 ******************************************************************************** 2023-08-31T18:12:07,708 !! 2023-08-31T18:12:07,709 check.warn(importable) 2023-08-31T18:12:07,709 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-08-31T18:12:07,709 !! 2023-08-31T18:12:07,710 ******************************************************************************** 2023-08-31T18:12:07,710 ############################ 2023-08-31T18:12:07,710 # Package would be ignored # 2023-08-31T18:12:07,711 ############################ 2023-08-31T18:12:07,711 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-08-31T18:12:07,711 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,712 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,712 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-08-31T18:12:07,713 to the `packages` configuration field. 2023-08-31T18:12:07,713 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,713 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,714 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,714 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,715 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,715 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-08-31T18:12:07,716 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-08-31T18:12:07,716 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,716 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,717 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,717 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,718 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,719 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,719 even if it does not contain any `.py` files. 2023-08-31T18:12:07,719 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,720 directory, all directories are treated like packages. 2023-08-31T18:12:07,720 ******************************************************************************** 2023-08-31T18:12:07,721 !! 2023-08-31T18:12:07,721 check.warn(importable) 2023-08-31T18:12:07,721 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-08-31T18:12:07,722 !! 2023-08-31T18:12:07,722 ******************************************************************************** 2023-08-31T18:12:07,722 ############################ 2023-08-31T18:12:07,723 # Package would be ignored # 2023-08-31T18:12:07,723 ############################ 2023-08-31T18:12:07,723 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-08-31T18:12:07,724 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,724 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,725 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-08-31T18:12:07,725 to the `packages` configuration field. 2023-08-31T18:12:07,725 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,726 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,726 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,727 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,727 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,728 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-08-31T18:12:07,728 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-08-31T18:12:07,728 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,729 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,729 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,729 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,730 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,731 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,731 even if it does not contain any `.py` files. 2023-08-31T18:12:07,732 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,732 directory, all directories are treated like packages. 2023-08-31T18:12:07,732 ******************************************************************************** 2023-08-31T18:12:07,733 !! 2023-08-31T18:12:07,733 check.warn(importable) 2023-08-31T18:12:07,733 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-08-31T18:12:07,734 !! 2023-08-31T18:12:07,734 ******************************************************************************** 2023-08-31T18:12:07,734 ############################ 2023-08-31T18:12:07,735 # Package would be ignored # 2023-08-31T18:12:07,735 ############################ 2023-08-31T18:12:07,735 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-08-31T18:12:07,736 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,736 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,737 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-08-31T18:12:07,737 to the `packages` configuration field. 2023-08-31T18:12:07,738 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,738 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,738 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,739 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,739 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,740 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-08-31T18:12:07,741 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-08-31T18:12:07,741 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,741 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,742 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,742 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,743 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,744 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,744 even if it does not contain any `.py` files. 2023-08-31T18:12:07,745 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,745 directory, all directories are treated like packages. 2023-08-31T18:12:07,745 ******************************************************************************** 2023-08-31T18:12:07,746 !! 2023-08-31T18:12:07,746 check.warn(importable) 2023-08-31T18:12:07,747 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-08-31T18:12:07,747 !! 2023-08-31T18:12:07,748 ******************************************************************************** 2023-08-31T18:12:07,748 ############################ 2023-08-31T18:12:07,748 # Package would be ignored # 2023-08-31T18:12:07,749 ############################ 2023-08-31T18:12:07,749 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-08-31T18:12:07,749 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,750 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,751 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-08-31T18:12:07,751 to the `packages` configuration field. 2023-08-31T18:12:07,752 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,752 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,752 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,753 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,754 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,754 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-08-31T18:12:07,755 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-08-31T18:12:07,755 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,755 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,756 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,756 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,757 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,758 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,758 even if it does not contain any `.py` files. 2023-08-31T18:12:07,759 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,759 directory, all directories are treated like packages. 2023-08-31T18:12:07,759 ******************************************************************************** 2023-08-31T18:12:07,760 !! 2023-08-31T18:12:07,760 check.warn(importable) 2023-08-31T18:12:07,761 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-08-31T18:12:07,761 !! 2023-08-31T18:12:07,762 ******************************************************************************** 2023-08-31T18:12:07,762 ############################ 2023-08-31T18:12:07,762 # Package would be ignored # 2023-08-31T18:12:07,763 ############################ 2023-08-31T18:12:07,763 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-08-31T18:12:07,763 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,764 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,764 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-08-31T18:12:07,765 to the `packages` configuration field. 2023-08-31T18:12:07,765 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,766 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,766 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,767 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,768 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,768 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-08-31T18:12:07,769 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-08-31T18:12:07,769 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,769 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,770 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,770 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,771 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,773 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,773 even if it does not contain any `.py` files. 2023-08-31T18:12:07,773 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,774 directory, all directories are treated like packages. 2023-08-31T18:12:07,774 ******************************************************************************** 2023-08-31T18:12:07,775 !! 2023-08-31T18:12:07,775 check.warn(importable) 2023-08-31T18:12:07,775 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-08-31T18:12:07,776 !! 2023-08-31T18:12:07,776 ******************************************************************************** 2023-08-31T18:12:07,777 ############################ 2023-08-31T18:12:07,777 # Package would be ignored # 2023-08-31T18:12:07,777 ############################ 2023-08-31T18:12:07,778 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-08-31T18:12:07,778 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,779 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,779 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-08-31T18:12:07,779 to the `packages` configuration field. 2023-08-31T18:12:07,780 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,780 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,781 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,781 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,782 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,783 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-08-31T18:12:07,783 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-08-31T18:12:07,783 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,784 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,784 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,785 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,785 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,786 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,787 even if it does not contain any `.py` files. 2023-08-31T18:12:07,787 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,787 directory, all directories are treated like packages. 2023-08-31T18:12:07,788 ******************************************************************************** 2023-08-31T18:12:07,788 !! 2023-08-31T18:12:07,789 check.warn(importable) 2023-08-31T18:12:07,789 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-08-31T18:12:07,789 !! 2023-08-31T18:12:07,790 ******************************************************************************** 2023-08-31T18:12:07,790 ############################ 2023-08-31T18:12:07,791 # Package would be ignored # 2023-08-31T18:12:07,791 ############################ 2023-08-31T18:12:07,791 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-08-31T18:12:07,792 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,792 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,793 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-08-31T18:12:07,793 to the `packages` configuration field. 2023-08-31T18:12:07,794 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,794 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,794 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,795 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,796 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,796 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-08-31T18:12:07,797 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-08-31T18:12:07,797 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,797 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,798 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,798 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,799 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,800 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,800 even if it does not contain any `.py` files. 2023-08-31T18:12:07,801 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,801 directory, all directories are treated like packages. 2023-08-31T18:12:07,801 ******************************************************************************** 2023-08-31T18:12:07,802 !! 2023-08-31T18:12:07,802 check.warn(importable) 2023-08-31T18:12:07,803 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-08-31T18:12:07,803 !! 2023-08-31T18:12:07,804 ******************************************************************************** 2023-08-31T18:12:07,804 ############################ 2023-08-31T18:12:07,804 # Package would be ignored # 2023-08-31T18:12:07,805 ############################ 2023-08-31T18:12:07,805 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-08-31T18:12:07,805 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,806 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,806 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-08-31T18:12:07,807 to the `packages` configuration field. 2023-08-31T18:12:07,807 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,808 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,808 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,809 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,809 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,810 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-08-31T18:12:07,810 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-08-31T18:12:07,811 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,811 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,811 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,812 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,813 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,814 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,814 even if it does not contain any `.py` files. 2023-08-31T18:12:07,814 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,815 directory, all directories are treated like packages. 2023-08-31T18:12:07,815 ******************************************************************************** 2023-08-31T18:12:07,816 !! 2023-08-31T18:12:07,816 check.warn(importable) 2023-08-31T18:12:07,816 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-08-31T18:12:07,817 !! 2023-08-31T18:12:07,817 ******************************************************************************** 2023-08-31T18:12:07,818 ############################ 2023-08-31T18:12:07,818 # Package would be ignored # 2023-08-31T18:12:07,818 ############################ 2023-08-31T18:12:07,819 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-08-31T18:12:07,819 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,820 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,820 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-08-31T18:12:07,820 to the `packages` configuration field. 2023-08-31T18:12:07,821 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,821 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,822 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,822 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,823 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,824 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-08-31T18:12:07,824 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-08-31T18:12:07,824 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,825 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,825 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,826 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,827 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,828 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,828 even if it does not contain any `.py` files. 2023-08-31T18:12:07,828 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,829 directory, all directories are treated like packages. 2023-08-31T18:12:07,829 ******************************************************************************** 2023-08-31T18:12:07,830 !! 2023-08-31T18:12:07,830 check.warn(importable) 2023-08-31T18:12:07,830 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-08-31T18:12:07,831 !! 2023-08-31T18:12:07,831 ******************************************************************************** 2023-08-31T18:12:07,832 ############################ 2023-08-31T18:12:07,832 # Package would be ignored # 2023-08-31T18:12:07,832 ############################ 2023-08-31T18:12:07,833 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-08-31T18:12:07,833 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,834 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,834 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-08-31T18:12:07,834 to the `packages` configuration field. 2023-08-31T18:12:07,835 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,835 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,836 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,836 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,837 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,838 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-08-31T18:12:07,838 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-08-31T18:12:07,838 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,839 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,839 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,840 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,840 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,841 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,842 even if it does not contain any `.py` files. 2023-08-31T18:12:07,842 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,842 directory, all directories are treated like packages. 2023-08-31T18:12:07,843 ******************************************************************************** 2023-08-31T18:12:07,843 !! 2023-08-31T18:12:07,844 check.warn(importable) 2023-08-31T18:12:07,844 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-08-31T18:12:07,844 !! 2023-08-31T18:12:07,845 ******************************************************************************** 2023-08-31T18:12:07,845 ############################ 2023-08-31T18:12:07,846 # Package would be ignored # 2023-08-31T18:12:07,846 ############################ 2023-08-31T18:12:07,846 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-08-31T18:12:07,847 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,847 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,848 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-08-31T18:12:07,848 to the `packages` configuration field. 2023-08-31T18:12:07,849 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,849 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,849 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,850 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,851 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,851 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-08-31T18:12:07,852 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-08-31T18:12:07,852 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,852 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,853 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,853 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,854 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,855 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,855 even if it does not contain any `.py` files. 2023-08-31T18:12:07,856 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,856 directory, all directories are treated like packages. 2023-08-31T18:12:07,856 ******************************************************************************** 2023-08-31T18:12:07,857 !! 2023-08-31T18:12:07,857 check.warn(importable) 2023-08-31T18:12:07,858 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-08-31T18:12:07,858 !! 2023-08-31T18:12:07,859 ******************************************************************************** 2023-08-31T18:12:07,859 ############################ 2023-08-31T18:12:07,859 # Package would be ignored # 2023-08-31T18:12:07,860 ############################ 2023-08-31T18:12:07,860 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-08-31T18:12:07,860 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,861 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,861 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-08-31T18:12:07,862 to the `packages` configuration field. 2023-08-31T18:12:07,862 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,863 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,863 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,864 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,864 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,865 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-08-31T18:12:07,865 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-08-31T18:12:07,866 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,866 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,866 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,867 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,868 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,869 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,869 even if it does not contain any `.py` files. 2023-08-31T18:12:07,869 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,869 directory, all directories are treated like packages. 2023-08-31T18:12:07,870 ******************************************************************************** 2023-08-31T18:12:07,871 !! 2023-08-31T18:12:07,871 check.warn(importable) 2023-08-31T18:12:07,871 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-08-31T18:12:07,872 !! 2023-08-31T18:12:07,872 ******************************************************************************** 2023-08-31T18:12:07,873 ############################ 2023-08-31T18:12:07,873 # Package would be ignored # 2023-08-31T18:12:07,873 ############################ 2023-08-31T18:12:07,874 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-08-31T18:12:07,874 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,875 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,875 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-08-31T18:12:07,875 to the `packages` configuration field. 2023-08-31T18:12:07,876 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,876 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,877 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,877 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,878 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,879 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-08-31T18:12:07,879 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-08-31T18:12:07,879 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,880 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,880 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,881 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,881 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,882 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,883 even if it does not contain any `.py` files. 2023-08-31T18:12:07,883 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,883 directory, all directories are treated like packages. 2023-08-31T18:12:07,884 ******************************************************************************** 2023-08-31T18:12:07,884 !! 2023-08-31T18:12:07,885 check.warn(importable) 2023-08-31T18:12:07,885 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-08-31T18:12:07,885 !! 2023-08-31T18:12:07,886 ******************************************************************************** 2023-08-31T18:12:07,886 ############################ 2023-08-31T18:12:07,887 # Package would be ignored # 2023-08-31T18:12:07,887 ############################ 2023-08-31T18:12:07,887 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-08-31T18:12:07,888 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,888 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,889 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-08-31T18:12:07,889 to the `packages` configuration field. 2023-08-31T18:12:07,890 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,890 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,890 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,891 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,892 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,892 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-08-31T18:12:07,893 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-08-31T18:12:07,893 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,893 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,894 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,894 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,895 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,896 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,896 even if it does not contain any `.py` files. 2023-08-31T18:12:07,897 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,897 directory, all directories are treated like packages. 2023-08-31T18:12:07,897 ******************************************************************************** 2023-08-31T18:12:07,898 !! 2023-08-31T18:12:07,898 check.warn(importable) 2023-08-31T18:12:07,899 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-08-31T18:12:07,899 !! 2023-08-31T18:12:07,900 ******************************************************************************** 2023-08-31T18:12:07,900 ############################ 2023-08-31T18:12:07,900 # Package would be ignored # 2023-08-31T18:12:07,901 ############################ 2023-08-31T18:12:07,901 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-08-31T18:12:07,902 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,902 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,903 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-08-31T18:12:07,903 to the `packages` configuration field. 2023-08-31T18:12:07,904 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,904 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,904 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,905 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,906 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,906 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-08-31T18:12:07,907 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-08-31T18:12:07,907 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,907 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,908 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,908 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,909 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,910 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,910 even if it does not contain any `.py` files. 2023-08-31T18:12:07,911 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,911 directory, all directories are treated like packages. 2023-08-31T18:12:07,911 ******************************************************************************** 2023-08-31T18:12:07,912 !! 2023-08-31T18:12:07,912 check.warn(importable) 2023-08-31T18:12:07,913 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-08-31T18:12:07,913 !! 2023-08-31T18:12:07,914 ******************************************************************************** 2023-08-31T18:12:07,914 ############################ 2023-08-31T18:12:07,914 # Package would be ignored # 2023-08-31T18:12:07,915 ############################ 2023-08-31T18:12:07,915 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-08-31T18:12:07,915 but it is absent from setuptools' `packages` configuration. 2023-08-31T18:12:07,916 This leads to an ambiguous overall configuration. If you want to distribute this 2023-08-31T18:12:07,916 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-08-31T18:12:07,917 to the `packages` configuration field. 2023-08-31T18:12:07,917 Alternatively, you can also rely on setuptools' discovery methods 2023-08-31T18:12:07,918 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-08-31T18:12:07,918 instead of `find_packages(...)`/`find:`). 2023-08-31T18:12:07,919 You can read more about "package discovery" on setuptools documentation page: 2023-08-31T18:12:07,919 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-08-31T18:12:07,920 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-08-31T18:12:07,920 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-08-31T18:12:07,921 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-08-31T18:12:07,921 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-08-31T18:12:07,921 combination with a more fine grained `package-data` configuration. 2023-08-31T18:12:07,922 You can read more about "package data files" on setuptools documentation page: 2023-08-31T18:12:07,923 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-08-31T18:12:07,924 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-08-31T18:12:07,924 even if it does not contain any `.py` files. 2023-08-31T18:12:07,924 On the other hand, currently there is no concept of package data 2023-08-31T18:12:07,925 directory, all directories are treated like packages. 2023-08-31T18:12:07,925 ******************************************************************************** 2023-08-31T18:12:07,926 !! 2023-08-31T18:12:07,926 check.warn(importable) 2023-08-31T18:12:07,926 creating build/lib/deepspeed/ops/csrc 2023-08-31T18:12:07,927 creating build/lib/deepspeed/ops/csrc/adagrad 2023-08-31T18:12:07,927 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-08-31T18:12:07,927 creating build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,928 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,928 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,928 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,929 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,929 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-08-31T18:12:07,929 creating build/lib/deepspeed/ops/csrc/aio 2023-08-31T18:12:07,930 creating build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,930 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,931 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,931 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,931 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,932 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,932 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:07,932 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,933 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,933 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,933 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,934 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,934 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,934 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,935 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,935 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,935 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,936 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,936 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:07,936 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-08-31T18:12:07,937 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-08-31T18:12:07,937 creating build/lib/deepspeed/ops/csrc/common 2023-08-31T18:12:07,937 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-08-31T18:12:07,938 creating build/lib/deepspeed/ops/csrc/cpu 2023-08-31T18:12:07,938 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-08-31T18:12:07,938 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-08-31T18:12:07,939 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-08-31T18:12:07,939 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-08-31T18:12:07,939 creating build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,940 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,940 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,940 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,941 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,941 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,941 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,942 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,945 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,949 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,955 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,960 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,965 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,969 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,974 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,978 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,982 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,988 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,992 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:07,999 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,004 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,009 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,015 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,019 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,025 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,029 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,034 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,039 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-08-31T18:12:08,044 creating build/lib/deepspeed/ops/csrc/lamb 2023-08-31T18:12:08,046 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-08-31T18:12:08,051 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-08-31T18:12:08,057 creating build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,059 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,064 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,071 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,076 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,081 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,086 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-08-31T18:12:08,091 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:08,092 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:08,097 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:08,102 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:08,107 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:08,112 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-08-31T18:12:08,114 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-08-31T18:12:08,119 creating build/lib/deepspeed/ops/csrc/spatial 2023-08-31T18:12:08,119 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:08,122 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:08,127 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:08,132 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-08-31T18:12:08,133 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-08-31T18:12:08,138 creating build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,139 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,145 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,151 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,158 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,163 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,168 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,177 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,183 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-08-31T18:12:08,190 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-08-31T18:12:08,191 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,194 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,200 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,205 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,211 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,217 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,222 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,230 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,234 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,239 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,246 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:08,252 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:08,254 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:08,260 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:08,267 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:08,272 creating build/lib/deepspeed/ops/csrc/utils 2023-08-31T18:12:08,274 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-08-31T18:12:08,279 creating build/lib/deepspeed/autotuning/config_templates 2023-08-31T18:12:08,281 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-08-31T18:12:08,286 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-08-31T18:12:08,291 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-08-31T18:12:08,296 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-08-31T18:12:08,300 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:08,305 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:08,310 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:08,397 running build_scripts 2023-08-31T18:12:08,398 creating build/scripts-3.7 2023-08-31T18:12:08,400 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-08-31T18:12:08,404 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-08-31T18:12:08,407 copying and adjusting bin/ds -> build/scripts-3.7 2023-08-31T18:12:08,410 copying bin/ds_ssh -> build/scripts-3.7 2023-08-31T18:12:08,414 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-08-31T18:12:08,417 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-08-31T18:12:08,420 copying and adjusting bin/dsr -> build/scripts-3.7 2023-08-31T18:12:08,423 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-08-31T18:12:08,426 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-08-31T18:12:08,426 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-08-31T18:12:08,427 changing mode of build/scripts-3.7/ds from 644 to 755 2023-08-31T18:12:08,428 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-08-31T18:12:08,429 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-08-31T18:12:08,429 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-08-31T18:12:08,430 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-08-31T18:12:08,552 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-08-31T18:12:08,552 !! 2023-08-31T18:12:08,553 ******************************************************************************** 2023-08-31T18:12:08,553 Please avoid running ``setup.py`` directly. 2023-08-31T18:12:08,554 Instead, use pypa/build, pypa/installer, pypa/build or 2023-08-31T18:12:08,554 other standards-based tools. 2023-08-31T18:12:08,555 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-08-31T18:12:08,555 ******************************************************************************** 2023-08-31T18:12:08,556 !! 2023-08-31T18:12:08,556 self.initialize_options() 2023-08-31T18:12:08,668 installing to build/bdist.linux-armv7l/wheel 2023-08-31T18:12:08,668 running install 2023-08-31T18:12:08,726 running install_lib 2023-08-31T18:12:08,845 creating build/bdist.linux-armv7l 2023-08-31T18:12:08,846 creating build/bdist.linux-armv7l/wheel 2023-08-31T18:12:08,850 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:08,854 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-08-31T18:12:08,856 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-08-31T18:12:08,860 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-08-31T18:12:08,864 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-08-31T18:12:08,868 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-08-31T18:12:08,870 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-08-31T18:12:08,874 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-08-31T18:12:08,883 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,885 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,889 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,892 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,897 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,901 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,905 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-08-31T18:12:08,911 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,913 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,916 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,920 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,923 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,927 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,930 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,934 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,938 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,943 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,946 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,952 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:08,957 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,959 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,963 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,967 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,971 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,974 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,978 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,982 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,985 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,989 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,993 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:08,998 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,003 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,007 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,010 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,016 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,018 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,023 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,026 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,031 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,035 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,040 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,045 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-08-31T18:12:09,050 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,054 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,058 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-08-31T18:12:09,062 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-08-31T18:12:09,068 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:09,073 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,074 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,078 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,083 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,090 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,096 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,101 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,106 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,113 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-08-31T18:12:09,118 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:09,124 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-08-31T18:12:09,126 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-08-31T18:12:09,131 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-08-31T18:12:09,136 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-08-31T18:12:09,144 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-08-31T18:12:09,146 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-08-31T18:12:09,150 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:09,157 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-08-31T18:12:09,159 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-08-31T18:12:09,164 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-08-31T18:12:09,170 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,172 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,177 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,183 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,187 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,192 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,196 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,199 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,203 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,207 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-08-31T18:12:09,213 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,215 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,220 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,223 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,228 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,231 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,237 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,241 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,246 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,251 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,255 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,259 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,263 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,267 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,271 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-08-31T18:12:09,275 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:09,280 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,282 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,286 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,289 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,294 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,298 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,303 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,307 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-08-31T18:12:09,312 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,314 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,318 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,322 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,326 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,330 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,334 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-08-31T18:12:09,341 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,344 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-08-31T18:12:09,347 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-08-31T18:12:09,352 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-08-31T18:12:09,357 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,360 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,365 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,369 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,375 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,380 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,387 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-08-31T18:12:09,393 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,398 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,403 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,407 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,412 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,418 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,423 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,428 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,430 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,435 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,439 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,443 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,447 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,451 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,455 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,461 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,466 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-08-31T18:12:09,469 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,474 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,480 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-08-31T18:12:09,482 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-08-31T18:12:09,486 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-08-31T18:12:09,491 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-08-31T18:12:09,495 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-08-31T18:12:09,499 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,508 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,513 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,520 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-08-31T18:12:09,522 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-08-31T18:12:09,527 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-08-31T18:12:09,533 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:09,535 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:09,540 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:09,545 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:09,548 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-08-31T18:12:09,554 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-08-31T18:12:09,560 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-08-31T18:12:09,565 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,572 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,577 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,590 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-08-31T18:12:09,596 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-08-31T18:12:09,597 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-08-31T18:12:09,603 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,604 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,610 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,614 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,618 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,623 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-08-31T18:12:09,629 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-08-31T18:12:09,635 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-08-31T18:12:09,642 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,643 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,647 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,651 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,654 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,659 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-08-31T18:12:09,663 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-08-31T18:12:09,670 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,673 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,680 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,687 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,694 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,701 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,710 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,715 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,720 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,725 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,730 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,734 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,740 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,752 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,763 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,767 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,772 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-08-31T18:12:09,783 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:09,785 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:09,791 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:09,795 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-08-31T18:12:09,799 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:09,801 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:09,805 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:09,809 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:09,813 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-08-31T18:12:09,817 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-08-31T18:12:09,820 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-08-31T18:12:09,823 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-08-31T18:12:09,826 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-08-31T18:12:09,832 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-08-31T18:12:09,834 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-08-31T18:12:09,836 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-08-31T18:12:09,842 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,845 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,849 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,855 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,860 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,865 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,872 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-08-31T18:12:09,878 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-08-31T18:12:09,880 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-08-31T18:12:09,885 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-08-31T18:12:09,891 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-08-31T18:12:09,892 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-08-31T18:12:09,898 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-08-31T18:12:09,900 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-08-31T18:12:09,905 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-08-31T18:12:09,908 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,910 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,914 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,919 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,923 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,928 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,933 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-08-31T18:12:09,938 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,941 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,945 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,949 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,954 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,958 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,962 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,967 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,971 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,976 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,980 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,984 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-08-31T18:12:09,990 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-08-31T18:12:09,991 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-08-31T18:12:09,996 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:09,998 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,005 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-08-31T18:12:10,008 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,010 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,015 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,020 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,025 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,030 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,034 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,042 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,047 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,051 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,057 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-08-31T18:12:10,062 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:10,064 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:10,068 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:10,073 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-08-31T18:12:10,078 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,084 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,092 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,097 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,102 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,108 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,112 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-08-31T18:12:10,119 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-08-31T18:12:10,121 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-08-31T18:12:10,123 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-08-31T18:12:10,130 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-08-31T18:12:10,132 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-08-31T18:12:10,137 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,139 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,144 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,148 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,152 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,156 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-08-31T18:12:10,161 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-08-31T18:12:10,163 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-08-31T18:12:10,169 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-08-31T18:12:10,171 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:10,173 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:10,178 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-08-31T18:12:10,183 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-08-31T18:12:10,185 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-08-31T18:12:10,190 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:10,192 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:10,196 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:10,202 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:10,206 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-08-31T18:12:10,213 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,214 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,219 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,224 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,228 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,232 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,237 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,241 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,245 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,249 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,254 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,258 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,263 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,267 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,271 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,276 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,281 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,285 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,289 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,294 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,298 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,303 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,306 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,310 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,314 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,318 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,322 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,326 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-08-31T18:12:10,332 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-08-31T18:12:10,336 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-08-31T18:12:10,338 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-08-31T18:12:10,341 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-08-31T18:12:10,347 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-08-31T18:12:10,348 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-08-31T18:12:10,354 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-08-31T18:12:10,357 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,360 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,362 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,366 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,370 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,374 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,378 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,383 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,387 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,390 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,395 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,398 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-08-31T18:12:10,402 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,406 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,410 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,414 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,417 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,422 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,426 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,430 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,435 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,437 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,442 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,445 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,448 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,452 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,456 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,459 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,463 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,466 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,470 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-08-31T18:12:10,473 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,478 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-08-31T18:12:10,482 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-08-31T18:12:10,486 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-08-31T18:12:10,491 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,493 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,497 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-08-31T18:12:10,499 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-08-31T18:12:10,503 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-08-31T18:12:10,506 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-08-31T18:12:10,509 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,513 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,516 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,520 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,525 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,528 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,532 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,536 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,538 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,542 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,545 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,548 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,552 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,555 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-08-31T18:12:10,559 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,562 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,566 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,569 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,573 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,576 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,579 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-08-31T18:12:10,584 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-08-31T18:12:10,586 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-08-31T18:12:10,590 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-08-31T18:12:10,594 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-08-31T18:12:10,598 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-08-31T18:12:10,603 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,605 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:10,607 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:10,612 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:10,615 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:10,619 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-08-31T18:12:10,622 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,626 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,630 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,636 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,640 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,646 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,651 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-08-31T18:12:10,655 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-08-31T18:12:10,657 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-08-31T18:12:10,660 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-08-31T18:12:10,665 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-08-31T18:12:10,667 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-08-31T18:12:10,671 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-08-31T18:12:10,676 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,678 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,681 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,685 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,688 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,691 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,695 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,700 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,704 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,708 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-08-31T18:12:10,714 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,715 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,723 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,728 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-08-31T18:12:10,729 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-08-31T18:12:10,733 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-08-31T18:12:10,736 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-08-31T18:12:10,740 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-08-31T18:12:10,743 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,748 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,752 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,757 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-08-31T18:12:10,763 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,764 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,768 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,773 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,776 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,780 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,784 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-08-31T18:12:10,788 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-08-31T18:12:10,793 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-08-31T18:12:10,794 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-08-31T18:12:10,799 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-08-31T18:12:10,801 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-08-31T18:12:10,806 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-08-31T18:12:10,809 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-08-31T18:12:10,815 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,817 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,822 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,825 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,829 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,832 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,836 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,840 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,843 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,847 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-08-31T18:12:10,851 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-08-31T18:12:10,853 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-08-31T18:12:10,857 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-08-31T18:12:10,862 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,863 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,867 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,870 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,876 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,881 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-08-31T18:12:10,887 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-08-31T18:12:10,888 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-08-31T18:12:10,893 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-08-31T18:12:10,897 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-08-31T18:12:10,902 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,904 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,907 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,911 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,914 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,918 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,921 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,925 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-08-31T18:12:10,928 running install_egg_info 2023-08-31T18:12:11,053 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.10.2-py3.7.egg-info 2023-08-31T18:12:11,080 running install_scripts 2023-08-31T18:12:11,083 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data 2023-08-31T18:12:11,083 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,086 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,089 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,093 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,096 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,100 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,103 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,107 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,111 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts 2023-08-31T18:12:11,114 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/ds to 755 2023-08-31T18:12:11,114 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/deepspeed to 755 2023-08-31T18:12:11,115 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/ds_bench to 755 2023-08-31T18:12:11,116 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/ds_report to 755 2023-08-31T18:12:11,117 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/ds_ssh to 755 2023-08-31T18:12:11,117 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/deepspeed.pt to 755 2023-08-31T18:12:11,118 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/dsr to 755 2023-08-31T18:12:11,119 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.data/scripts/ds_elastic to 755 2023-08-31T18:12:11,247 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.2.dist-info/WHEEL 2023-08-31T18:12:11,252 creating '/tmp/pip-wheel-ojlyxsi5/deepspeed-0.10.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-08-31T18:12:11,260 adding 'deepspeed/__init__.py' 2023-08-31T18:12:11,264 adding 'deepspeed/constants.py' 2023-08-31T18:12:11,267 adding 'deepspeed/env_report.py' 2023-08-31T18:12:11,270 adding 'deepspeed/git_version_info.py' 2023-08-31T18:12:11,272 adding 'deepspeed/git_version_info_installed.py' 2023-08-31T18:12:11,276 adding 'deepspeed/accelerator/__init__.py' 2023-08-31T18:12:11,279 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-08-31T18:12:11,283 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-08-31T18:12:11,287 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-08-31T18:12:11,290 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-08-31T18:12:11,294 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-08-31T18:12:11,297 adding 'deepspeed/accelerator/real_accelerator.py' 2023-08-31T18:12:11,301 adding 'deepspeed/autotuning/__init__.py' 2023-08-31T18:12:11,314 adding 'deepspeed/autotuning/autotuner.py' 2023-08-31T18:12:11,318 adding 'deepspeed/autotuning/config.py' 2023-08-31T18:12:11,322 adding 'deepspeed/autotuning/constants.py' 2023-08-31T18:12:11,327 adding 'deepspeed/autotuning/scheduler.py' 2023-08-31T18:12:11,332 adding 'deepspeed/autotuning/utils.py' 2023-08-31T18:12:11,336 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-08-31T18:12:11,339 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-08-31T18:12:11,341 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-08-31T18:12:11,344 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-08-31T18:12:11,348 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-08-31T18:12:11,350 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-08-31T18:12:11,353 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-08-31T18:12:11,356 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-08-31T18:12:11,359 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-08-31T18:12:11,362 adding 'deepspeed/autotuning/tuner/utils.py' 2023-08-31T18:12:11,366 adding 'deepspeed/checkpoint/__init__.py' 2023-08-31T18:12:11,369 adding 'deepspeed/checkpoint/constants.py' 2023-08-31T18:12:11,373 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-08-31T18:12:11,377 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-08-31T18:12:11,380 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-08-31T18:12:11,383 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-08-31T18:12:11,387 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-08-31T18:12:11,389 adding 'deepspeed/checkpoint/utils.py' 2023-08-31T18:12:11,393 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-08-31T18:12:11,397 adding 'deepspeed/comm/__init__.py' 2023-08-31T18:12:11,399 adding 'deepspeed/comm/backend.py' 2023-08-31T18:12:11,402 adding 'deepspeed/comm/ccl.py' 2023-08-31T18:12:11,410 adding 'deepspeed/comm/comm.py' 2023-08-31T18:12:11,413 adding 'deepspeed/comm/config.py' 2023-08-31T18:12:11,416 adding 'deepspeed/comm/constants.py' 2023-08-31T18:12:11,418 adding 'deepspeed/comm/reduce_op.py' 2023-08-31T18:12:11,423 adding 'deepspeed/comm/torch.py' 2023-08-31T18:12:11,426 adding 'deepspeed/comm/utils.py' 2023-08-31T18:12:11,430 adding 'deepspeed/compression/__init__.py' 2023-08-31T18:12:11,437 adding 'deepspeed/compression/basic_layer.py' 2023-08-31T18:12:11,442 adding 'deepspeed/compression/compress.py' 2023-08-31T18:12:11,447 adding 'deepspeed/compression/config.py' 2023-08-31T18:12:11,451 adding 'deepspeed/compression/constants.py' 2023-08-31T18:12:11,455 adding 'deepspeed/compression/helper.py' 2023-08-31T18:12:11,458 adding 'deepspeed/compression/scheduler.py' 2023-08-31T18:12:11,462 adding 'deepspeed/compression/utils.py' 2023-08-31T18:12:11,466 adding 'deepspeed/elasticity/__init__.py' 2023-08-31T18:12:11,469 adding 'deepspeed/elasticity/config.py' 2023-08-31T18:12:11,472 adding 'deepspeed/elasticity/constants.py' 2023-08-31T18:12:11,476 adding 'deepspeed/elasticity/elastic_agent.py' 2023-08-31T18:12:11,481 adding 'deepspeed/elasticity/elasticity.py' 2023-08-31T18:12:11,484 adding 'deepspeed/elasticity/utils.py' 2023-08-31T18:12:11,488 adding 'deepspeed/inference/__init__.py' 2023-08-31T18:12:11,492 adding 'deepspeed/inference/config.py' 2023-08-31T18:12:11,500 adding 'deepspeed/inference/engine.py' 2023-08-31T18:12:11,505 adding 'deepspeed/launcher/__init__.py' 2023-08-31T18:12:11,507 adding 'deepspeed/launcher/constants.py' 2023-08-31T18:12:11,512 adding 'deepspeed/launcher/launch.py' 2023-08-31T18:12:11,517 adding 'deepspeed/launcher/multinode_runner.py' 2023-08-31T18:12:11,524 adding 'deepspeed/launcher/runner.py' 2023-08-31T18:12:11,528 adding 'deepspeed/model_implementations/__init__.py' 2023-08-31T18:12:11,532 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-08-31T18:12:11,535 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-08-31T18:12:11,538 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-08-31T18:12:11,541 adding 'deepspeed/model_implementations/features/__init__.py' 2023-08-31T18:12:11,544 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-08-31T18:12:11,547 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-08-31T18:12:11,550 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-08-31T18:12:11,553 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-08-31T18:12:11,556 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-08-31T18:12:11,558 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-08-31T18:12:11,561 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-08-31T18:12:11,563 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-08-31T18:12:11,566 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-08-31T18:12:11,569 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-08-31T18:12:11,573 adding 'deepspeed/module_inject/__init__.py' 2023-08-31T18:12:11,579 adding 'deepspeed/module_inject/auto_tp.py' 2023-08-31T18:12:11,583 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-08-31T18:12:11,586 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-08-31T18:12:11,589 adding 'deepspeed/module_inject/inject.py' 2023-08-31T18:12:11,592 adding 'deepspeed/module_inject/layers.py' 2023-08-31T18:12:11,597 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-08-31T18:12:11,600 adding 'deepspeed/module_inject/module_quantize.py' 2023-08-31T18:12:11,603 adding 'deepspeed/module_inject/policy.py' 2023-08-31T18:12:11,611 adding 'deepspeed/module_inject/replace_module.py' 2023-08-31T18:12:11,615 adding 'deepspeed/module_inject/replace_policy.py' 2023-08-31T18:12:11,617 adding 'deepspeed/module_inject/utils.py' 2023-08-31T18:12:11,621 adding 'deepspeed/module_inject/containers/__init__.py' 2023-08-31T18:12:11,626 adding 'deepspeed/module_inject/containers/base.py' 2023-08-31T18:12:11,629 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-08-31T18:12:11,632 adding 'deepspeed/module_inject/containers/bert.py' 2023-08-31T18:12:11,636 adding 'deepspeed/module_inject/containers/bloom.py' 2023-08-31T18:12:11,639 adding 'deepspeed/module_inject/containers/clip.py' 2023-08-31T18:12:11,641 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-08-31T18:12:11,644 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-08-31T18:12:11,647 adding 'deepspeed/module_inject/containers/gptj.py' 2023-08-31T18:12:11,651 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-08-31T18:12:11,654 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-08-31T18:12:11,658 adding 'deepspeed/module_inject/containers/llama.py' 2023-08-31T18:12:11,661 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-08-31T18:12:11,664 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-08-31T18:12:11,667 adding 'deepspeed/module_inject/containers/opt.py' 2023-08-31T18:12:11,670 adding 'deepspeed/module_inject/containers/unet.py' 2023-08-31T18:12:11,673 adding 'deepspeed/module_inject/containers/vae.py' 2023-08-31T18:12:11,677 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-08-31T18:12:11,680 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-08-31T18:12:11,684 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-08-31T18:12:11,687 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-08-31T18:12:11,690 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-08-31T18:12:11,693 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-08-31T18:12:11,697 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-08-31T18:12:11,701 adding 'deepspeed/moe/__init__.py' 2023-08-31T18:12:11,703 adding 'deepspeed/moe/experts.py' 2023-08-31T18:12:11,707 adding 'deepspeed/moe/layer.py' 2023-08-31T18:12:11,710 adding 'deepspeed/moe/mappings.py' 2023-08-31T18:12:11,716 adding 'deepspeed/moe/sharded_moe.py' 2023-08-31T18:12:11,720 adding 'deepspeed/moe/utils.py' 2023-08-31T18:12:11,723 adding 'deepspeed/monitor/__init__.py' 2023-08-31T18:12:11,726 adding 'deepspeed/monitor/config.py' 2023-08-31T18:12:11,729 adding 'deepspeed/monitor/csv_monitor.py' 2023-08-31T18:12:11,732 adding 'deepspeed/monitor/monitor.py' 2023-08-31T18:12:11,734 adding 'deepspeed/monitor/tensorboard.py' 2023-08-31T18:12:11,737 adding 'deepspeed/monitor/utils.py' 2023-08-31T18:12:11,739 adding 'deepspeed/monitor/wandb.py' 2023-08-31T18:12:11,743 adding 'deepspeed/nebula/__init__.py' 2023-08-31T18:12:11,745 adding 'deepspeed/nebula/config.py' 2023-08-31T18:12:11,748 adding 'deepspeed/nebula/constants.py' 2023-08-31T18:12:11,752 adding 'deepspeed/ops/__init__.py' 2023-08-31T18:12:11,755 adding 'deepspeed/ops/adagrad/__init__.py' 2023-08-31T18:12:11,758 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-08-31T18:12:11,762 adding 'deepspeed/ops/adam/__init__.py' 2023-08-31T18:12:11,766 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-08-31T18:12:11,770 adding 'deepspeed/ops/adam/fused_adam.py' 2023-08-31T18:12:11,772 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-08-31T18:12:11,776 adding 'deepspeed/ops/aio/__init__.py' 2023-08-31T18:12:11,782 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-08-31T18:12:11,785 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-08-31T18:12:11,789 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-08-31T18:12:11,792 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-08-31T18:12:11,795 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-08-31T18:12:11,799 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-08-31T18:12:11,805 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-08-31T18:12:11,808 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-08-31T18:12:11,811 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-08-31T18:12:11,814 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-08-31T18:12:11,817 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-08-31T18:12:11,820 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-08-31T18:12:11,824 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-08-31T18:12:11,827 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-08-31T18:12:11,829 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-08-31T18:12:11,832 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-08-31T18:12:11,835 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-08-31T18:12:11,837 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-08-31T18:12:11,841 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-08-31T18:12:11,844 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-08-31T18:12:11,847 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-08-31T18:12:11,850 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-08-31T18:12:11,852 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-08-31T18:12:11,856 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-08-31T18:12:11,859 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-08-31T18:12:11,864 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-08-31T18:12:11,872 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-08-31T18:12:11,877 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-08-31T18:12:11,879 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-08-31T18:12:11,882 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-08-31T18:12:11,885 adding 'deepspeed/ops/csrc/includes/context.h' 2023-08-31T18:12:11,889 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-08-31T18:12:11,893 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-08-31T18:12:11,897 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-08-31T18:12:11,900 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-08-31T18:12:11,904 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-08-31T18:12:11,908 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-08-31T18:12:11,911 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-08-31T18:12:11,914 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-08-31T18:12:11,917 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-08-31T18:12:11,920 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-08-31T18:12:11,923 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-08-31T18:12:11,926 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-08-31T18:12:11,929 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-08-31T18:12:11,935 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-08-31T18:12:11,939 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-08-31T18:12:11,942 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-08-31T18:12:11,946 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-08-31T18:12:11,949 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-08-31T18:12:11,954 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-08-31T18:12:11,957 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-08-31T18:12:11,960 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-08-31T18:12:11,964 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-08-31T18:12:11,967 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-08-31T18:12:11,971 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-08-31T18:12:11,975 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-08-31T18:12:11,980 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-08-31T18:12:11,986 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-08-31T18:12:11,991 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-08-31T18:12:11,995 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-08-31T18:12:11,999 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-08-31T18:12:12,002 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-08-31T18:12:12,007 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-08-31T18:12:12,011 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-08-31T18:12:12,014 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-08-31T18:12:12,017 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-08-31T18:12:12,022 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-08-31T18:12:12,027 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-08-31T18:12:12,030 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-08-31T18:12:12,034 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-08-31T18:12:12,039 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-08-31T18:12:12,045 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-08-31T18:12:12,054 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-08-31T18:12:12,059 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-08-31T18:12:12,063 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-08-31T18:12:12,077 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-08-31T18:12:12,084 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-08-31T18:12:12,090 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-08-31T18:12:12,097 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-08-31T18:12:12,100 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-08-31T18:12:12,107 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-08-31T18:12:12,112 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-08-31T18:12:12,115 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-08-31T18:12:12,129 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-08-31T18:12:12,134 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-08-31T18:12:12,138 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-08-31T18:12:12,144 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-08-31T18:12:12,151 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-08-31T18:12:12,157 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-08-31T18:12:12,161 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-08-31T18:12:12,165 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-08-31T18:12:12,169 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-08-31T18:12:12,172 adding 'deepspeed/ops/lamb/__init__.py' 2023-08-31T18:12:12,176 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-08-31T18:12:12,180 adding 'deepspeed/ops/op_builder/__init__.py' 2023-08-31T18:12:12,183 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-08-31T18:12:12,186 adding 'deepspeed/ops/op_builder/async_io.py' 2023-08-31T18:12:12,194 adding 'deepspeed/ops/op_builder/builder.py' 2023-08-31T18:12:12,198 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-08-31T18:12:12,200 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-08-31T18:12:12,203 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-08-31T18:12:12,206 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-08-31T18:12:12,208 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-08-31T18:12:12,211 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-08-31T18:12:12,214 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-08-31T18:12:12,217 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-08-31T18:12:12,219 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-08-31T18:12:12,222 adding 'deepspeed/ops/op_builder/transformer.py' 2023-08-31T18:12:12,225 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-08-31T18:12:12,228 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-08-31T18:12:12,231 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-08-31T18:12:12,234 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-08-31T18:12:12,236 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-08-31T18:12:12,238 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-08-31T18:12:12,241 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-08-31T18:12:12,245 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-08-31T18:12:12,247 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-08-31T18:12:12,250 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-08-31T18:12:12,253 adding 'deepspeed/ops/quantizer/__init__.py' 2023-08-31T18:12:12,256 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-08-31T18:12:12,259 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-08-31T18:12:12,263 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-08-31T18:12:12,267 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-08-31T18:12:12,270 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-08-31T18:12:12,279 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-08-31T18:12:12,284 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-08-31T18:12:12,288 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-08-31T18:12:12,292 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-08-31T18:12:12,299 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-08-31T18:12:12,304 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-08-31T18:12:12,308 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-08-31T18:12:12,311 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-08-31T18:12:12,314 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-08-31T18:12:12,318 adding 'deepspeed/ops/transformer/__init__.py' 2023-08-31T18:12:12,323 adding 'deepspeed/ops/transformer/transformer.py' 2023-08-31T18:12:12,328 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-08-31T18:12:12,330 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-08-31T18:12:12,334 adding 'deepspeed/ops/transformer/inference/config.py' 2023-08-31T18:12:12,336 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-08-31T18:12:12,340 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-08-31T18:12:12,343 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-08-31T18:12:12,348 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-08-31T18:12:12,351 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-08-31T18:12:12,356 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-08-31T18:12:12,360 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-08-31T18:12:12,365 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-08-31T18:12:12,367 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-08-31T18:12:12,370 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-08-31T18:12:12,373 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-08-31T18:12:12,376 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-08-31T18:12:12,379 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-08-31T18:12:12,382 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-08-31T18:12:12,385 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-08-31T18:12:12,388 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-08-31T18:12:12,391 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-08-31T18:12:12,394 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-08-31T18:12:12,398 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-08-31T18:12:12,401 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-08-31T18:12:12,405 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-08-31T18:12:12,409 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-08-31T18:12:12,413 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-08-31T18:12:12,416 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-08-31T18:12:12,418 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-08-31T18:12:12,422 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-08-31T18:12:12,426 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-08-31T18:12:12,430 adding 'deepspeed/pipe/__init__.py' 2023-08-31T18:12:12,433 adding 'deepspeed/profiling/__init__.py' 2023-08-31T18:12:12,436 adding 'deepspeed/profiling/config.py' 2023-08-31T18:12:12,439 adding 'deepspeed/profiling/constants.py' 2023-08-31T18:12:12,442 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-08-31T18:12:12,455 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-08-31T18:12:12,461 adding 'deepspeed/runtime/__init__.py' 2023-08-31T18:12:12,467 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-08-31T18:12:12,476 adding 'deepspeed/runtime/config.py' 2023-08-31T18:12:12,481 adding 'deepspeed/runtime/config_utils.py' 2023-08-31T18:12:12,486 adding 'deepspeed/runtime/constants.py' 2023-08-31T18:12:12,489 adding 'deepspeed/runtime/dataloader.py' 2023-08-31T18:12:12,492 adding 'deepspeed/runtime/eigenvalue.py' 2023-08-31T18:12:12,535 adding 'deepspeed/runtime/engine.py' 2023-08-31T18:12:12,545 adding 'deepspeed/runtime/hybrid_engine.py' 2023-08-31T18:12:12,554 adding 'deepspeed/runtime/lr_schedules.py' 2023-08-31T18:12:12,557 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-08-31T18:12:12,561 adding 'deepspeed/runtime/quantize.py' 2023-08-31T18:12:12,564 adding 'deepspeed/runtime/sparse_tensor.py' 2023-08-31T18:12:12,569 adding 'deepspeed/runtime/state_dict_factory.py' 2023-08-31T18:12:12,579 adding 'deepspeed/runtime/utils.py' 2023-08-31T18:12:12,583 adding 'deepspeed/runtime/weight_quantizer.py' 2023-08-31T18:12:12,587 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-08-31T18:12:12,599 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-08-31T18:12:12,602 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-08-31T18:12:12,606 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-08-31T18:12:12,609 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-08-31T18:12:12,612 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-08-31T18:12:12,615 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-08-31T18:12:12,618 adding 'deepspeed/runtime/comm/__init__.py' 2023-08-31T18:12:12,621 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-08-31T18:12:12,625 adding 'deepspeed/runtime/comm/mpi.py' 2023-08-31T18:12:12,629 adding 'deepspeed/runtime/comm/nccl.py' 2023-08-31T18:12:12,632 adding 'deepspeed/runtime/compression/__init__.py' 2023-08-31T18:12:12,635 adding 'deepspeed/runtime/compression/cupy.py' 2023-08-31T18:12:12,639 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-08-31T18:12:12,642 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-08-31T18:12:12,645 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-08-31T18:12:12,648 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-08-31T18:12:12,652 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-08-31T18:12:12,656 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-08-31T18:12:12,659 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-08-31T18:12:12,662 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-08-31T18:12:12,665 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-08-31T18:12:12,668 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-08-31T18:12:12,674 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-08-31T18:12:12,680 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-08-31T18:12:12,687 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-08-31T18:12:12,690 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-08-31T18:12:12,693 adding 'deepspeed/runtime/fp16/__init__.py' 2023-08-31T18:12:12,699 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-08-31T18:12:12,704 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-08-31T18:12:12,709 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-08-31T18:12:12,713 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-08-31T18:12:12,718 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-08-31T18:12:12,725 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-08-31T18:12:12,730 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-08-31T18:12:12,734 adding 'deepspeed/runtime/pipe/__init__.py' 2023-08-31T18:12:12,749 adding 'deepspeed/runtime/pipe/engine.py' 2023-08-31T18:12:12,758 adding 'deepspeed/runtime/pipe/module.py' 2023-08-31T18:12:12,762 adding 'deepspeed/runtime/pipe/p2p.py' 2023-08-31T18:12:12,767 adding 'deepspeed/runtime/pipe/schedule.py' 2023-08-31T18:12:12,773 adding 'deepspeed/runtime/pipe/topology.py' 2023-08-31T18:12:12,777 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-08-31T18:12:12,780 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-08-31T18:12:12,783 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-08-31T18:12:12,785 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-08-31T18:12:12,791 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-08-31T18:12:12,795 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-08-31T18:12:12,801 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-08-31T18:12:12,805 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-08-31T18:12:12,808 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-08-31T18:12:12,813 adding 'deepspeed/runtime/zero/__init__.py' 2023-08-31T18:12:12,817 adding 'deepspeed/runtime/zero/config.py' 2023-08-31T18:12:12,822 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-08-31T18:12:12,826 adding 'deepspeed/runtime/zero/linear.py' 2023-08-31T18:12:12,832 adding 'deepspeed/runtime/zero/mics.py' 2023-08-31T18:12:12,836 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-08-31T18:12:12,839 adding 'deepspeed/runtime/zero/offload_config.py' 2023-08-31T18:12:12,845 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-08-31T18:12:12,872 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-08-31T18:12:12,881 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-08-31T18:12:12,885 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-08-31T18:12:12,919 adding 'deepspeed/runtime/zero/stage3.py' 2023-08-31T18:12:12,954 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-08-31T18:12:12,960 adding 'deepspeed/runtime/zero/test.py' 2023-08-31T18:12:12,964 adding 'deepspeed/runtime/zero/tiling.py' 2023-08-31T18:12:12,967 adding 'deepspeed/runtime/zero/utils.py' 2023-08-31T18:12:12,971 adding 'deepspeed/sequence/__init__.py' 2023-08-31T18:12:12,974 adding 'deepspeed/sequence/layer.py' 2023-08-31T18:12:12,978 adding 'deepspeed/utils/__init__.py' 2023-08-31T18:12:12,981 adding 'deepspeed/utils/comms_logging.py' 2023-08-31T18:12:12,985 adding 'deepspeed/utils/debug.py' 2023-08-31T18:12:12,987 adding 'deepspeed/utils/exceptions.py' 2023-08-31T18:12:12,993 adding 'deepspeed/utils/groups.py' 2023-08-31T18:12:12,996 adding 'deepspeed/utils/init_on_device.py' 2023-08-31T18:12:12,999 adding 'deepspeed/utils/logging.py' 2023-08-31T18:12:13,002 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-08-31T18:12:13,006 adding 'deepspeed/utils/numa.py' 2023-08-31T18:12:13,008 adding 'deepspeed/utils/nvtx.py' 2023-08-31T18:12:13,012 adding 'deepspeed/utils/tensor_fragment.py' 2023-08-31T18:12:13,016 adding 'deepspeed/utils/timer.py' 2023-08-31T18:12:13,019 adding 'deepspeed/utils/types.py' 2023-08-31T18:12:13,025 adding 'deepspeed/utils/zero_to_fp32.py' 2023-08-31T18:12:13,030 adding 'deepspeed-0.10.2.data/scripts/deepspeed' 2023-08-31T18:12:13,033 adding 'deepspeed-0.10.2.data/scripts/deepspeed.pt' 2023-08-31T18:12:13,035 adding 'deepspeed-0.10.2.data/scripts/ds' 2023-08-31T18:12:13,037 adding 'deepspeed-0.10.2.data/scripts/ds_bench' 2023-08-31T18:12:13,040 adding 'deepspeed-0.10.2.data/scripts/ds_elastic' 2023-08-31T18:12:13,043 adding 'deepspeed-0.10.2.data/scripts/ds_report' 2023-08-31T18:12:13,045 adding 'deepspeed-0.10.2.data/scripts/ds_ssh' 2023-08-31T18:12:13,047 adding 'deepspeed-0.10.2.data/scripts/dsr' 2023-08-31T18:12:13,054 adding 'deepspeed-0.10.2.dist-info/LICENSE' 2023-08-31T18:12:13,064 adding 'deepspeed-0.10.2.dist-info/METADATA' 2023-08-31T18:12:13,067 adding 'deepspeed-0.10.2.dist-info/WHEEL' 2023-08-31T18:12:13,069 adding 'deepspeed-0.10.2.dist-info/entry_points.txt' 2023-08-31T18:12:13,071 adding 'deepspeed-0.10.2.dist-info/top_level.txt' 2023-08-31T18:12:13,089 adding 'deepspeed-0.10.2.dist-info/RECORD' 2023-08-31T18:12:13,130 removing build/bdist.linux-armv7l/wheel 2023-08-31T18:12:13,385 deepspeed build time = 13.354021549224854 secs 2023-08-31T18:12:13,553 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-08-31T18:12:13,587 Created wheel for deepspeed: filename=deepspeed-0.10.2-py3-none-any.whl size=898081 sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 2023-08-31T18:12:13,589 Stored in directory: /tmp/pip-ephem-wheel-cache-o29k8lbk/wheels/0e/a8/7e/3c0ea2d534a3a0275d0c5fb121a7dae85ce1287478ed944950 2023-08-31T18:12:13,660 Successfully built deepspeed 2023-08-31T18:12:13,735 Removed build tracker: '/tmp/pip-build-tracker-i3mcxbka'