2023-10-09T18:18:01,881 Created temporary directory: /tmp/pip-build-tracker-u68yckz5 2023-10-09T18:18:01,882 Initialized build tracking at /tmp/pip-build-tracker-u68yckz5 2023-10-09T18:18:01,883 Created build tracker: /tmp/pip-build-tracker-u68yckz5 2023-10-09T18:18:01,883 Entered build tracker: /tmp/pip-build-tracker-u68yckz5 2023-10-09T18:18:01,884 Created temporary directory: /tmp/pip-wheel-t446fk8m 2023-10-09T18:18:01,887 Created temporary directory: /tmp/pip-ephem-wheel-cache-n0z99aq1 2023-10-09T18:18:01,909 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-10-09T18:18:01,913 2 location(s) to search for versions of deepspeed: 2023-10-09T18:18:01,913 * https://pypi.org/simple/deepspeed/ 2023-10-09T18:18:01,913 * https://www.piwheels.org/simple/deepspeed/ 2023-10-09T18:18:01,913 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-10-09T18:18:01,914 Getting page https://pypi.org/simple/deepspeed/ 2023-10-09T18:18:01,916 Found index url https://pypi.org/simple/ 2023-10-09T18:18:02,136 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-10-09T18:18:02,150 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-10-09T18:18:02,151 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-10-09T18:18:02,151 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-10-09T18:18:02,152 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-10-09T18:18:02,153 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-10-09T18:18:02,153 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-10-09T18:18:02,154 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-10-09T18:18:02,155 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-10-09T18:18:02,156 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-10-09T18:18:02,156 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-10-09T18:18:02,157 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-10-09T18:18:02,158 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-10-09T18:18:02,159 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-10-09T18:18:02,160 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-10-09T18:18:02,160 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-10-09T18:18:02,161 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-10-09T18:18:02,161 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-10-09T18:18:02,162 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-10-09T18:18:02,163 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-10-09T18:18:02,163 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-10-09T18:18:02,164 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-10-09T18:18:02,164 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-10-09T18:18:02,165 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-10-09T18:18:02,166 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-10-09T18:18:02,166 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-10-09T18:18:02,167 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-10-09T18:18:02,168 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-10-09T18:18:02,169 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-10-09T18:18:02,169 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-10-09T18:18:02,170 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-10-09T18:18:02,171 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-10-09T18:18:02,172 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-10-09T18:18:02,172 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-10-09T18:18:02,173 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-10-09T18:18:02,173 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-10-09T18:18:02,174 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-10-09T18:18:02,174 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-10-09T18:18:02,175 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-10-09T18:18:02,176 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-10-09T18:18:02,176 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-10-09T18:18:02,177 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-10-09T18:18:02,177 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-10-09T18:18:02,178 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-10-09T18:18:02,179 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-10-09T18:18:02,179 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-10-09T18:18:02,180 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-10-09T18:18:02,181 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-10-09T18:18:02,181 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-10-09T18:18:02,182 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-10-09T18:18:02,183 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-10-09T18:18:02,184 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-10-09T18:18:02,184 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-10-09T18:18:02,185 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-10-09T18:18:02,185 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-10-09T18:18:02,186 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-10-09T18:18:02,186 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-10-09T18:18:02,187 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-10-09T18:18:02,187 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-10-09T18:18:02,188 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-10-09T18:18:02,188 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-10-09T18:18:02,189 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-10-09T18:18:02,190 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-10-09T18:18:02,191 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-10-09T18:18:02,191 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-10-09T18:18:02,192 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-10-09T18:18:02,192 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-10-09T18:18:02,193 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-10-09T18:18:02,194 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-10-09T18:18:02,195 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-10-09T18:18:02,196 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-10-09T18:18:02,196 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-10-09T18:18:02,197 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-10-09T18:18:02,197 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-10-09T18:18:02,198 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-10-09T18:18:02,198 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-10-09T18:18:02,199 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-10-09T18:18:02,199 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-10-09T18:18:02,200 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-10-09T18:18:02,201 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-10-09T18:18:02,203 Found index url https://www.piwheels.org/simple/ 2023-10-09T18:18:02,376 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-10-09T18:18:02,388 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,389 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,390 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,390 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,391 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,392 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,392 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,393 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,393 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,394 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,394 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,395 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,395 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,396 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,396 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,397 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,397 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,398 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,399 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,399 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,400 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,401 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,401 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,401 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,402 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,402 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,403 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,403 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,404 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,405 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,405 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,406 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,407 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,407 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,408 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,408 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,409 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,409 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,410 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,411 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,411 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,411 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,412 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,413 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,413 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,414 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,415 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-10-09T18:18:02,415 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-10-09T18:18:02,416 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-10-09T18:18:02,442 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-10-09T18:18:02,461 Collecting deepspeed==0.11.1 2023-10-09T18:18:02,463 Created temporary directory: /tmp/pip-unpack-eg2sig49 2023-10-09T18:18:02,694 Downloading deepspeed-0.11.1.tar.gz (1.1 MB) 2023-10-09T18:18:04,323 Added deepspeed==0.11.1 from https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz to build tracker '/tmp/pip-build-tracker-u68yckz5' 2023-10-09T18:18:04,324 Running setup.py (path:/tmp/pip-wheel-t446fk8m/deepspeed_7ccddb31ce114482ab51c59607cbf8da/setup.py) egg_info for package deepspeed 2023-10-09T18:18:04,325 Created temporary directory: /tmp/pip-pip-egg-info-1dmc_97u 2023-10-09T18:18:04,326 Preparing metadata (setup.py): started 2023-10-09T18:18:04,327 Running command python setup.py egg_info 2023-10-09T18:18:05,194 fatal: not a git repository (or any of the parent directories): .git 2023-10-09T18:18:05,835 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-10-09T18:18:05,836  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-10-09T18:18:05,836 DS_BUILD_OPS=0 2023-10-09T18:18:05,837  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-10-09T18:18:05,837  [WARNING]  async_io: please install the libaio-dev package with apt 2023-10-09T18:18:05,838  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-10-09T18:18:05,838  [WARNING]  Please install torch if trying to pre-compile kernels 2023-10-09T18:18:05,839  [WARNING]  unable to import torch, please install it first 2023-10-09T18:18:05,839  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-10-09T18:18:05,840  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-10-09T18:18:05,840 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-10-09T18:18:05,841 version=0.11.1, git_hash=unknown, git_branch=unknown 2023-10-09T18:18:05,841 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-10-09T18:18:05,842 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-10-09T18:18:05,842 ext_modules=[] 2023-10-09T18:18:05,843 running egg_info 2023-10-09T18:18:05,844 creating /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info 2023-10-09T18:18:05,862 writing /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/PKG-INFO 2023-10-09T18:18:05,893 writing dependency_links to /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/dependency_links.txt 2023-10-09T18:18:05,894 writing entry points to /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/entry_points.txt 2023-10-09T18:18:05,910 writing requirements to /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/requires.txt 2023-10-09T18:18:05,911 writing top-level names to /tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/top_level.txt 2023-10-09T18:18:05,913 writing manifest file '/tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/SOURCES.txt' 2023-10-09T18:18:06,052 reading manifest file '/tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/SOURCES.txt' 2023-10-09T18:18:06,054 reading manifest template 'MANIFEST.in' 2023-10-09T18:18:06,792 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-10-09T18:18:07,392 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-10-09T18:18:07,838 warning: no files found matching '*.tr' under directory 'csrc' 2023-10-09T18:18:07,941 warning: no files found matching '*.cc' under directory 'csrc' 2023-10-09T18:18:07,961 warning: no files found matching '*.py' under directory 'benchmarks' 2023-10-09T18:18:07,987 writing manifest file '/tmp/pip-pip-egg-info-1dmc_97u/deepspeed.egg-info/SOURCES.txt' 2023-10-09T18:18:07,989 deepspeed build time = 2.7885849475860596 secs 2023-10-09T18:18:08,102 Preparing metadata (setup.py): finished with status 'done' 2023-10-09T18:18:08,108 Source in /tmp/pip-wheel-t446fk8m/deepspeed_7ccddb31ce114482ab51c59607cbf8da has version 0.11.1, which satisfies requirement deepspeed==0.11.1 from https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz 2023-10-09T18:18:08,109 Removed deepspeed==0.11.1 from https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz from build tracker '/tmp/pip-build-tracker-u68yckz5' 2023-10-09T18:18:08,119 Created temporary directory: /tmp/pip-unpack-4f7gkza_ 2023-10-09T18:18:08,120 Created temporary directory: /tmp/pip-unpack-ai2nw94_ 2023-10-09T18:18:08,348 Building wheels for collected packages: deepspeed 2023-10-09T18:18:08,352 Created temporary directory: /tmp/pip-wheel-wuazm6js 2023-10-09T18:18:08,353 Building wheel for deepspeed (setup.py): started 2023-10-09T18:18:08,354 Destination directory: /tmp/pip-wheel-wuazm6js 2023-10-09T18:18:08,354 Running command python setup.py bdist_wheel 2023-10-09T18:18:08,814 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-10-09T18:18:08,822  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-10-09T18:18:08,871 DS_BUILD_OPS=0 2023-10-09T18:18:08,986  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-10-09T18:18:09,046  [WARNING]  async_io: please install the libaio-dev package with apt 2023-10-09T18:18:09,047  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-10-09T18:18:09,048  [WARNING]  Please install torch if trying to pre-compile kernels 2023-10-09T18:18:09,048  [WARNING]  unable to import torch, please install it first 2023-10-09T18:18:09,049  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-10-09T18:18:09,049  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-10-09T18:18:09,050 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-10-09T18:18:09,059 fatal: not a git repository (or any of the parent directories): .git 2023-10-09T18:18:09,060 version=0.11.1, git_hash=unknown, git_branch=unknown 2023-10-09T18:18:09,061 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-10-09T18:18:09,062 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-10-09T18:18:09,063 ext_modules=[] 2023-10-09T18:18:09,686 running bdist_wheel 2023-10-09T18:18:09,784 running build 2023-10-09T18:18:09,784 running build_py 2023-10-09T18:18:09,812 creating build 2023-10-09T18:18:09,813 creating build/lib 2023-10-09T18:18:09,814 creating build/lib/deepspeed 2023-10-09T18:18:09,815 copying deepspeed/constants.py -> build/lib/deepspeed 2023-10-09T18:18:09,817 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-10-09T18:18:09,819 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-10-09T18:18:09,821 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-10-09T18:18:09,824 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-10-09T18:18:09,826 creating build/lib/deepspeed/inference 2023-10-09T18:18:09,827 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-10-09T18:18:09,828 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-10-09T18:18:09,831 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-10-09T18:18:09,834 creating build/lib/deepspeed/monitor 2023-10-09T18:18:09,835 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,837 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,839 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,840 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,842 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,844 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,846 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-10-09T18:18:09,848 creating build/lib/deepspeed/moe 2023-10-09T18:18:09,849 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,851 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,853 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,854 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,856 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,859 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-10-09T18:18:09,861 creating build/lib/deepspeed/sequence 2023-10-09T18:18:09,863 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-10-09T18:18:09,864 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-10-09T18:18:09,867 creating build/lib/deepspeed/autotuning 2023-10-09T18:18:09,868 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,871 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,872 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,876 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,879 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,881 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-10-09T18:18:09,884 creating build/lib/deepspeed/launcher 2023-10-09T18:18:09,885 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-10-09T18:18:09,887 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-10-09T18:18:09,888 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-10-09T18:18:09,891 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-10-09T18:18:09,894 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-10-09T18:18:09,897 creating build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,898 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,900 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,902 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,904 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,906 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,908 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,911 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,913 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,915 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-10-09T18:18:09,918 creating build/lib/deepspeed/compression 2023-10-09T18:18:09,919 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,921 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,923 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,925 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,927 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,929 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,932 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,935 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-10-09T18:18:09,938 creating build/lib/deepspeed/accelerator 2023-10-09T18:18:09,939 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,941 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,943 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,945 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,948 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,950 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,952 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-10-09T18:18:09,955 creating build/lib/deepspeed/model_implementations 2023-10-09T18:18:09,956 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-10-09T18:18:09,959 creating build/lib/deepspeed/utils 2023-10-09T18:18:09,960 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,962 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,964 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,966 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,968 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,970 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,972 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,975 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,977 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,980 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,982 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,984 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,987 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,989 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-10-09T18:18:09,991 creating build/lib/deepspeed/ops 2023-10-09T18:18:09,992 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-10-09T18:18:09,995 creating build/lib/deepspeed/comm 2023-10-09T18:18:09,996 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-10-09T18:18:09,998 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,001 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,003 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,004 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,006 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,008 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,010 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,012 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-10-09T18:18:10,014 creating build/lib/deepspeed/module_inject 2023-10-09T18:18:10,015 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,017 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,019 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,021 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,023 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,026 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,027 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,029 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,032 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,034 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,036 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,039 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-10-09T18:18:10,041 creating build/lib/deepspeed/pipe 2023-10-09T18:18:10,042 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-10-09T18:18:10,045 creating build/lib/deepspeed/runtime 2023-10-09T18:18:10,046 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,049 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,051 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,053 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,055 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,057 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,059 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,063 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,066 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,068 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,070 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,075 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,078 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,080 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,083 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,086 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-10-09T18:18:10,089 creating build/lib/deepspeed/elasticity 2023-10-09T18:18:10,090 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,092 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,093 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,095 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,097 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,099 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-10-09T18:18:10,102 creating build/lib/deepspeed/profiling 2023-10-09T18:18:10,103 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-10-09T18:18:10,105 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-10-09T18:18:10,106 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-10-09T18:18:10,108 creating build/lib/deepspeed/nebula 2023-10-09T18:18:10,109 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-10-09T18:18:10,111 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-10-09T18:18:10,112 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-10-09T18:18:10,115 creating build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,115 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,117 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,119 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,121 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,123 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-10-09T18:18:10,125 creating build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,126 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,128 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,129 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,131 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,133 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,134 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-10-09T18:18:10,137 creating build/lib/deepspeed/model_implementations/features 2023-10-09T18:18:10,138 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-10-09T18:18:10,139 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-10-09T18:18:10,141 creating build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,142 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,145 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,146 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,148 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,149 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,151 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,153 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,155 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,156 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,158 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-10-09T18:18:10,160 creating build/lib/deepspeed/model_implementations/diffusers 2023-10-09T18:18:10,161 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-10-09T18:18:10,162 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-10-09T18:18:10,164 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-10-09T18:18:10,166 creating build/lib/deepspeed/ops/lion 2023-10-09T18:18:10,167 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-10-09T18:18:10,169 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-10-09T18:18:10,170 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-10-09T18:18:10,172 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-10-09T18:18:10,175 creating build/lib/deepspeed/ops/random_ltd 2023-10-09T18:18:10,176 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-10-09T18:18:10,178 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-10-09T18:18:10,181 creating build/lib/deepspeed/ops/deepspeed4science 2023-10-09T18:18:10,181 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-10-09T18:18:10,183 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-10-09T18:18:10,186 creating build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,187 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,188 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,190 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,192 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,194 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,195 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,197 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,198 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,200 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,202 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,203 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,206 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,207 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,209 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,210 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,212 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,214 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,215 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-10-09T18:18:10,218 creating build/lib/deepspeed/ops/lamb 2023-10-09T18:18:10,219 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-10-09T18:18:10,220 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-10-09T18:18:10,223 creating build/lib/deepspeed/ops/adam 2023-10-09T18:18:10,223 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-10-09T18:18:10,225 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-10-09T18:18:10,227 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-10-09T18:18:10,229 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-10-09T18:18:10,231 creating build/lib/deepspeed/ops/transformer 2023-10-09T18:18:10,232 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-10-09T18:18:10,233 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-10-09T18:18:10,236 creating build/lib/deepspeed/ops/adagrad 2023-10-09T18:18:10,237 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-10-09T18:18:10,239 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-10-09T18:18:10,241 creating build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,242 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,244 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,245 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,247 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,250 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,253 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,255 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-10-09T18:18:10,258 creating build/lib/deepspeed/ops/quantizer 2023-10-09T18:18:10,258 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-10-09T18:18:10,260 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-10-09T18:18:10,262 creating build/lib/deepspeed/ops/aio 2023-10-09T18:18:10,263 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-10-09T18:18:10,265 creating build/lib/deepspeed/ops/op_builder/npu 2023-10-09T18:18:10,266 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-10-09T18:18:10,268 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-10-09T18:18:10,269 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-10-09T18:18:10,272 creating build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,273 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,275 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,276 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,278 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,280 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,281 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:10,284 creating build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,285 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,287 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,289 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,291 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,292 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,294 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,296 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,298 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,300 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,302 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-10-09T18:18:10,305 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,306 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,307 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,309 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,311 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,313 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,315 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,317 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,320 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,321 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,324 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:10,326 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,327 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,329 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,331 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,333 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,334 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,336 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,338 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,340 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,342 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,344 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:10,346 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:10,347 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:10,350 creating build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,351 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,353 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,354 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,356 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,358 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,360 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,362 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,364 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,366 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,368 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,371 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,373 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,376 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,377 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,379 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,381 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,383 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,385 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,388 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-10-09T18:18:10,390 creating build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,391 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,393 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,395 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,397 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,400 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,401 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,404 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-10-09T18:18:10,406 creating build/lib/deepspeed/runtime/data_pipeline 2023-10-09T18:18:10,407 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-10-09T18:18:10,410 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-10-09T18:18:10,411 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-10-09T18:18:10,414 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-10-09T18:18:10,416 creating build/lib/deepspeed/runtime/compression 2023-10-09T18:18:10,417 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-10-09T18:18:10,419 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-10-09T18:18:10,421 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:10,422 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:10,424 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:10,425 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:10,427 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:10,430 creating build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,431 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,433 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,435 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,437 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,439 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,442 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,444 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,446 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,448 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-10-09T18:18:10,451 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:10,452 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:10,454 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:10,457 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:10,460 creating build/lib/deepspeed/runtime/comm 2023-10-09T18:18:10,461 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-10-09T18:18:10,463 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-10-09T18:18:10,465 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-10-09T18:18:10,468 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-10-09T18:18:10,470 creating build/lib/deepspeed/runtime/fp16 2023-10-09T18:18:10,471 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-10-09T18:18:10,473 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-10-09T18:18:10,476 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-10-09T18:18:10,479 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-10-09T18:18:10,482 creating build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,482 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,484 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,487 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,489 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,491 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,495 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-10-09T18:18:10,498 creating build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,499 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,501 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,505 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,507 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,510 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,512 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,514 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,518 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,521 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,523 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,527 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,530 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,532 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,535 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,536 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,539 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-10-09T18:18:10,541 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,542 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,544 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,546 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,548 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,551 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:10,553 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,554 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,556 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,559 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,561 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,564 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:10,567 creating build/lib/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:10,567 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:10,569 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:10,572 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:10,574 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:10,577 creating build/lib/deepspeed/profiling/flops_profiler 2023-10-09T18:18:10,578 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-10-09T18:18:10,580 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-10-09T18:18:10,584 running egg_info 2023-10-09T18:18:10,632 writing deepspeed.egg-info/PKG-INFO 2023-10-09T18:18:10,662 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-10-09T18:18:10,664 writing entry points to deepspeed.egg-info/entry_points.txt 2023-10-09T18:18:10,678 writing requirements to deepspeed.egg-info/requires.txt 2023-10-09T18:18:10,680 writing top-level names to deepspeed.egg-info/top_level.txt 2023-10-09T18:18:10,739 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-10-09T18:18:10,773 reading manifest template 'MANIFEST.in' 2023-10-09T18:18:11,509 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-10-09T18:18:12,068 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-10-09T18:18:12,499 warning: no files found matching '*.tr' under directory 'csrc' 2023-10-09T18:18:12,600 warning: no files found matching '*.cc' under directory 'csrc' 2023-10-09T18:18:12,622 warning: no files found matching '*.py' under directory 'benchmarks' 2023-10-09T18:18:12,654 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-10-09T18:18:12,661 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-10-09T18:18:12,662 !! 2023-10-09T18:18:12,663 ******************************************************************************** 2023-10-09T18:18:12,664 ############################ 2023-10-09T18:18:12,664 # Package would be ignored # 2023-10-09T18:18:12,665 ############################ 2023-10-09T18:18:12,666 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-10-09T18:18:12,666 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,667 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,668 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-10-09T18:18:12,668 to the `packages` configuration field. 2023-10-09T18:18:12,670 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,670 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,671 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,672 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,673 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,675 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-10-09T18:18:12,675 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-10-09T18:18:12,676 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,677 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,677 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,678 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,679 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,680 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,680 even if it does not contain any `.py` files. 2023-10-09T18:18:12,681 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,681 directory, all directories are treated like packages. 2023-10-09T18:18:12,682 ******************************************************************************** 2023-10-09T18:18:12,682 !! 2023-10-09T18:18:12,683 check.warn(importable) 2023-10-09T18:18:12,683 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-10-09T18:18:12,684 !! 2023-10-09T18:18:12,685 ******************************************************************************** 2023-10-09T18:18:12,685 ############################ 2023-10-09T18:18:12,686 # Package would be ignored # 2023-10-09T18:18:12,686 ############################ 2023-10-09T18:18:12,687 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-10-09T18:18:12,687 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,688 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,688 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-10-09T18:18:12,689 to the `packages` configuration field. 2023-10-09T18:18:12,690 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,691 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,691 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,692 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,694 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,695 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-10-09T18:18:12,695 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-10-09T18:18:12,696 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,696 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,697 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,698 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,699 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,700 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,701 even if it does not contain any `.py` files. 2023-10-09T18:18:12,701 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,702 directory, all directories are treated like packages. 2023-10-09T18:18:12,702 ******************************************************************************** 2023-10-09T18:18:12,704 !! 2023-10-09T18:18:12,704 check.warn(importable) 2023-10-09T18:18:12,705 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-10-09T18:18:12,706 !! 2023-10-09T18:18:12,706 ******************************************************************************** 2023-10-09T18:18:12,707 ############################ 2023-10-09T18:18:12,707 # Package would be ignored # 2023-10-09T18:18:12,708 ############################ 2023-10-09T18:18:12,708 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-10-09T18:18:12,708 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,709 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,709 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-10-09T18:18:12,710 to the `packages` configuration field. 2023-10-09T18:18:12,710 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,711 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,711 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,712 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,713 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,714 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-10-09T18:18:12,714 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-10-09T18:18:12,714 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,715 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,715 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,716 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,718 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,719 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,720 even if it does not contain any `.py` files. 2023-10-09T18:18:12,720 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,721 directory, all directories are treated like packages. 2023-10-09T18:18:12,721 ******************************************************************************** 2023-10-09T18:18:12,723 !! 2023-10-09T18:18:12,723 check.warn(importable) 2023-10-09T18:18:12,723 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-10-09T18:18:12,724 !! 2023-10-09T18:18:12,725 ******************************************************************************** 2023-10-09T18:18:12,725 ############################ 2023-10-09T18:18:12,726 # Package would be ignored # 2023-10-09T18:18:12,726 ############################ 2023-10-09T18:18:12,727 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-10-09T18:18:12,727 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,728 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,729 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-10-09T18:18:12,729 to the `packages` configuration field. 2023-10-09T18:18:12,730 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,731 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,732 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,733 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,734 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,734 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-10-09T18:18:12,735 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-10-09T18:18:12,735 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,735 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,736 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,737 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,737 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,739 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,739 even if it does not contain any `.py` files. 2023-10-09T18:18:12,739 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,740 directory, all directories are treated like packages. 2023-10-09T18:18:12,740 ******************************************************************************** 2023-10-09T18:18:12,741 !! 2023-10-09T18:18:12,741 check.warn(importable) 2023-10-09T18:18:12,742 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-10-09T18:18:12,742 !! 2023-10-09T18:18:12,743 ******************************************************************************** 2023-10-09T18:18:12,744 ############################ 2023-10-09T18:18:12,745 # Package would be ignored # 2023-10-09T18:18:12,745 ############################ 2023-10-09T18:18:12,746 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-10-09T18:18:12,746 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,748 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,748 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-10-09T18:18:12,749 to the `packages` configuration field. 2023-10-09T18:18:12,750 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,750 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,751 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,752 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,753 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,754 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-10-09T18:18:12,755 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-10-09T18:18:12,755 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,756 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,756 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,757 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,759 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,760 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,761 even if it does not contain any `.py` files. 2023-10-09T18:18:12,761 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,762 directory, all directories are treated like packages. 2023-10-09T18:18:12,763 ******************************************************************************** 2023-10-09T18:18:12,764 !! 2023-10-09T18:18:12,764 check.warn(importable) 2023-10-09T18:18:12,765 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-10-09T18:18:12,765 !! 2023-10-09T18:18:12,766 ******************************************************************************** 2023-10-09T18:18:12,766 ############################ 2023-10-09T18:18:12,767 # Package would be ignored # 2023-10-09T18:18:12,767 ############################ 2023-10-09T18:18:12,768 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-10-09T18:18:12,768 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,769 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,769 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-10-09T18:18:12,769 to the `packages` configuration field. 2023-10-09T18:18:12,770 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,771 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,771 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,772 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,774 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,775 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-10-09T18:18:12,775 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-10-09T18:18:12,776 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,776 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,777 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,778 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,779 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,781 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,781 even if it does not contain any `.py` files. 2023-10-09T18:18:12,782 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,782 directory, all directories are treated like packages. 2023-10-09T18:18:12,783 ******************************************************************************** 2023-10-09T18:18:12,784 !! 2023-10-09T18:18:12,784 check.warn(importable) 2023-10-09T18:18:12,785 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-10-09T18:18:12,785 !! 2023-10-09T18:18:12,787 ******************************************************************************** 2023-10-09T18:18:12,787 ############################ 2023-10-09T18:18:12,788 # Package would be ignored # 2023-10-09T18:18:12,788 ############################ 2023-10-09T18:18:12,789 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-10-09T18:18:12,789 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,790 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,791 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-10-09T18:18:12,792 to the `packages` configuration field. 2023-10-09T18:18:12,793 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,793 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,793 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,794 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,795 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,796 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-10-09T18:18:12,796 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-10-09T18:18:12,797 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,797 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,797 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,798 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,799 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,800 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,801 even if it does not contain any `.py` files. 2023-10-09T18:18:12,801 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,801 directory, all directories are treated like packages. 2023-10-09T18:18:12,802 ******************************************************************************** 2023-10-09T18:18:12,803 !! 2023-10-09T18:18:12,803 check.warn(importable) 2023-10-09T18:18:12,804 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-10-09T18:18:12,805 !! 2023-10-09T18:18:12,806 ******************************************************************************** 2023-10-09T18:18:12,806 ############################ 2023-10-09T18:18:12,807 # Package would be ignored # 2023-10-09T18:18:12,808 ############################ 2023-10-09T18:18:12,808 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-10-09T18:18:12,809 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,810 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,810 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-10-09T18:18:12,811 to the `packages` configuration field. 2023-10-09T18:18:12,812 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,812 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,813 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,814 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,815 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,816 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-10-09T18:18:12,817 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-10-09T18:18:12,817 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,818 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,818 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,820 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,821 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,822 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,822 even if it does not contain any `.py` files. 2023-10-09T18:18:12,823 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,823 directory, all directories are treated like packages. 2023-10-09T18:18:12,823 ******************************************************************************** 2023-10-09T18:18:12,824 !! 2023-10-09T18:18:12,825 check.warn(importable) 2023-10-09T18:18:12,825 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-10-09T18:18:12,825 !! 2023-10-09T18:18:12,826 ******************************************************************************** 2023-10-09T18:18:12,827 ############################ 2023-10-09T18:18:12,827 # Package would be ignored # 2023-10-09T18:18:12,828 ############################ 2023-10-09T18:18:12,828 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-10-09T18:18:12,828 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,829 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,830 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-10-09T18:18:12,830 to the `packages` configuration field. 2023-10-09T18:18:12,832 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,832 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,833 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,834 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,835 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,836 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-10-09T18:18:12,837 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-10-09T18:18:12,837 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,838 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,838 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,840 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,841 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,842 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,843 even if it does not contain any `.py` files. 2023-10-09T18:18:12,843 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,844 directory, all directories are treated like packages. 2023-10-09T18:18:12,844 ******************************************************************************** 2023-10-09T18:18:12,846 !! 2023-10-09T18:18:12,846 check.warn(importable) 2023-10-09T18:18:12,847 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-10-09T18:18:12,848 !! 2023-10-09T18:18:12,849 ******************************************************************************** 2023-10-09T18:18:12,850 ############################ 2023-10-09T18:18:12,850 # Package would be ignored # 2023-10-09T18:18:12,851 ############################ 2023-10-09T18:18:12,851 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-10-09T18:18:12,852 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,853 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,853 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-10-09T18:18:12,853 to the `packages` configuration field. 2023-10-09T18:18:12,854 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,855 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,855 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,856 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,857 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,858 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-10-09T18:18:12,859 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-10-09T18:18:12,859 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,860 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,860 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,861 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,862 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,864 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,864 even if it does not contain any `.py` files. 2023-10-09T18:18:12,865 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,866 directory, all directories are treated like packages. 2023-10-09T18:18:12,866 ******************************************************************************** 2023-10-09T18:18:12,867 !! 2023-10-09T18:18:12,868 check.warn(importable) 2023-10-09T18:18:12,868 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-10-09T18:18:12,869 !! 2023-10-09T18:18:12,870 ******************************************************************************** 2023-10-09T18:18:12,871 ############################ 2023-10-09T18:18:12,872 # Package would be ignored # 2023-10-09T18:18:12,872 ############################ 2023-10-09T18:18:12,873 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-10-09T18:18:12,874 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,875 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,875 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-10-09T18:18:12,876 to the `packages` configuration field. 2023-10-09T18:18:12,877 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,878 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,878 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,879 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,881 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,882 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-10-09T18:18:12,882 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-10-09T18:18:12,883 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,883 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,884 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,885 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,886 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,888 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,888 even if it does not contain any `.py` files. 2023-10-09T18:18:12,889 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,889 directory, all directories are treated like packages. 2023-10-09T18:18:12,889 ******************************************************************************** 2023-10-09T18:18:12,890 !! 2023-10-09T18:18:12,891 check.warn(importable) 2023-10-09T18:18:12,892 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-10-09T18:18:12,892 !! 2023-10-09T18:18:12,894 ******************************************************************************** 2023-10-09T18:18:12,894 ############################ 2023-10-09T18:18:12,895 # Package would be ignored # 2023-10-09T18:18:12,895 ############################ 2023-10-09T18:18:12,896 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-10-09T18:18:12,896 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,898 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,898 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-10-09T18:18:12,899 to the `packages` configuration field. 2023-10-09T18:18:12,900 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,900 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,901 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,902 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,904 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,905 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-10-09T18:18:12,906 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-10-09T18:18:12,907 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,908 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,908 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,910 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,911 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,913 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,914 even if it does not contain any `.py` files. 2023-10-09T18:18:12,914 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,915 directory, all directories are treated like packages. 2023-10-09T18:18:12,916 ******************************************************************************** 2023-10-09T18:18:12,917 !! 2023-10-09T18:18:12,918 check.warn(importable) 2023-10-09T18:18:12,918 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-10-09T18:18:12,919 !! 2023-10-09T18:18:12,920 ******************************************************************************** 2023-10-09T18:18:12,921 ############################ 2023-10-09T18:18:12,921 # Package would be ignored # 2023-10-09T18:18:12,922 ############################ 2023-10-09T18:18:12,922 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-10-09T18:18:12,923 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,924 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,924 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-10-09T18:18:12,925 to the `packages` configuration field. 2023-10-09T18:18:12,926 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,926 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,927 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,928 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,929 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,930 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-10-09T18:18:12,931 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-10-09T18:18:12,931 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,932 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,933 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,934 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,935 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,937 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,938 even if it does not contain any `.py` files. 2023-10-09T18:18:12,939 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,939 directory, all directories are treated like packages. 2023-10-09T18:18:12,940 ******************************************************************************** 2023-10-09T18:18:12,941 !! 2023-10-09T18:18:12,942 check.warn(importable) 2023-10-09T18:18:12,942 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-10-09T18:18:12,943 !! 2023-10-09T18:18:12,944 ******************************************************************************** 2023-10-09T18:18:12,945 ############################ 2023-10-09T18:18:12,945 # Package would be ignored # 2023-10-09T18:18:12,946 ############################ 2023-10-09T18:18:12,947 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-10-09T18:18:12,947 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,948 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,949 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-10-09T18:18:12,949 to the `packages` configuration field. 2023-10-09T18:18:12,950 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,951 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,951 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,952 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,953 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,954 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-10-09T18:18:12,956 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-10-09T18:18:12,956 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,957 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,957 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,959 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,960 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,962 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,963 even if it does not contain any `.py` files. 2023-10-09T18:18:12,963 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,964 directory, all directories are treated like packages. 2023-10-09T18:18:12,965 ******************************************************************************** 2023-10-09T18:18:12,967 !! 2023-10-09T18:18:12,967 check.warn(importable) 2023-10-09T18:18:12,968 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-10-09T18:18:12,969 !! 2023-10-09T18:18:12,971 ******************************************************************************** 2023-10-09T18:18:12,971 ############################ 2023-10-09T18:18:12,972 # Package would be ignored # 2023-10-09T18:18:12,973 ############################ 2023-10-09T18:18:12,974 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-10-09T18:18:12,975 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:12,977 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:12,977 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-10-09T18:18:12,978 to the `packages` configuration field. 2023-10-09T18:18:12,980 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:12,981 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:12,982 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:12,984 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:12,985 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:12,987 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-10-09T18:18:12,987 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-10-09T18:18:12,988 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:12,989 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:12,990 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:12,991 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:12,992 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:12,993 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:12,994 even if it does not contain any `.py` files. 2023-10-09T18:18:12,995 On the other hand, currently there is no concept of package data 2023-10-09T18:18:12,995 directory, all directories are treated like packages. 2023-10-09T18:18:12,996 ******************************************************************************** 2023-10-09T18:18:12,997 !! 2023-10-09T18:18:12,998 check.warn(importable) 2023-10-09T18:18:12,998 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-10-09T18:18:12,999 !! 2023-10-09T18:18:13,000 ******************************************************************************** 2023-10-09T18:18:13,001 ############################ 2023-10-09T18:18:13,001 # Package would be ignored # 2023-10-09T18:18:13,002 ############################ 2023-10-09T18:18:13,002 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-10-09T18:18:13,003 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,004 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,005 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-10-09T18:18:13,005 to the `packages` configuration field. 2023-10-09T18:18:13,007 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,007 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,008 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,009 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,010 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,012 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-10-09T18:18:13,013 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-10-09T18:18:13,013 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,014 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,015 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,016 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,017 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,019 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,020 even if it does not contain any `.py` files. 2023-10-09T18:18:13,021 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,021 directory, all directories are treated like packages. 2023-10-09T18:18:13,022 ******************************************************************************** 2023-10-09T18:18:13,023 !! 2023-10-09T18:18:13,024 check.warn(importable) 2023-10-09T18:18:13,025 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-10-09T18:18:13,025 !! 2023-10-09T18:18:13,026 ******************************************************************************** 2023-10-09T18:18:13,027 ############################ 2023-10-09T18:18:13,027 # Package would be ignored # 2023-10-09T18:18:13,028 ############################ 2023-10-09T18:18:13,028 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-10-09T18:18:13,029 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,030 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,031 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-10-09T18:18:13,032 to the `packages` configuration field. 2023-10-09T18:18:13,033 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,034 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,035 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,036 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,038 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,039 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-10-09T18:18:13,040 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-10-09T18:18:13,041 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,042 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,043 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,044 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,048 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,051 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,051 even if it does not contain any `.py` files. 2023-10-09T18:18:13,052 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,052 directory, all directories are treated like packages. 2023-10-09T18:18:13,053 ******************************************************************************** 2023-10-09T18:18:13,054 !! 2023-10-09T18:18:13,055 check.warn(importable) 2023-10-09T18:18:13,056 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-10-09T18:18:13,057 !! 2023-10-09T18:18:13,059 ******************************************************************************** 2023-10-09T18:18:13,059 ############################ 2023-10-09T18:18:13,060 # Package would be ignored # 2023-10-09T18:18:13,061 ############################ 2023-10-09T18:18:13,061 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-10-09T18:18:13,062 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,063 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,064 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-10-09T18:18:13,064 to the `packages` configuration field. 2023-10-09T18:18:13,065 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,066 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,066 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,067 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,068 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,069 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-10-09T18:18:13,070 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-10-09T18:18:13,070 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,070 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,071 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,072 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,073 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,074 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,075 even if it does not contain any `.py` files. 2023-10-09T18:18:13,075 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,075 directory, all directories are treated like packages. 2023-10-09T18:18:13,076 ******************************************************************************** 2023-10-09T18:18:13,077 !! 2023-10-09T18:18:13,077 check.warn(importable) 2023-10-09T18:18:13,078 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-10-09T18:18:13,078 !! 2023-10-09T18:18:13,079 ******************************************************************************** 2023-10-09T18:18:13,080 ############################ 2023-10-09T18:18:13,080 # Package would be ignored # 2023-10-09T18:18:13,081 ############################ 2023-10-09T18:18:13,081 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-10-09T18:18:13,082 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,083 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,083 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-10-09T18:18:13,084 to the `packages` configuration field. 2023-10-09T18:18:13,085 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,085 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,086 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,087 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,088 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,089 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-10-09T18:18:13,089 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-10-09T18:18:13,090 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,091 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,091 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,092 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,093 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,095 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,095 even if it does not contain any `.py` files. 2023-10-09T18:18:13,096 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,096 directory, all directories are treated like packages. 2023-10-09T18:18:13,097 ******************************************************************************** 2023-10-09T18:18:13,098 !! 2023-10-09T18:18:13,098 check.warn(importable) 2023-10-09T18:18:13,099 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-10-09T18:18:13,099 !! 2023-10-09T18:18:13,100 ******************************************************************************** 2023-10-09T18:18:13,100 ############################ 2023-10-09T18:18:13,101 # Package would be ignored # 2023-10-09T18:18:13,101 ############################ 2023-10-09T18:18:13,102 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-10-09T18:18:13,102 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,103 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,104 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-10-09T18:18:13,104 to the `packages` configuration field. 2023-10-09T18:18:13,105 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,105 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,106 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,107 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,108 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,109 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-10-09T18:18:13,109 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-10-09T18:18:13,110 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,110 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,111 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,112 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,113 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,115 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,115 even if it does not contain any `.py` files. 2023-10-09T18:18:13,116 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,116 directory, all directories are treated like packages. 2023-10-09T18:18:13,117 ******************************************************************************** 2023-10-09T18:18:13,118 !! 2023-10-09T18:18:13,119 check.warn(importable) 2023-10-09T18:18:13,119 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-10-09T18:18:13,120 !! 2023-10-09T18:18:13,121 ******************************************************************************** 2023-10-09T18:18:13,121 ############################ 2023-10-09T18:18:13,122 # Package would be ignored # 2023-10-09T18:18:13,122 ############################ 2023-10-09T18:18:13,123 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-10-09T18:18:13,124 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,125 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,125 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-10-09T18:18:13,126 to the `packages` configuration field. 2023-10-09T18:18:13,127 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,128 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,128 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,129 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,130 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,131 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-10-09T18:18:13,131 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-10-09T18:18:13,132 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,132 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,133 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,134 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,134 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,136 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,137 even if it does not contain any `.py` files. 2023-10-09T18:18:13,137 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,137 directory, all directories are treated like packages. 2023-10-09T18:18:13,138 ******************************************************************************** 2023-10-09T18:18:13,139 !! 2023-10-09T18:18:13,139 check.warn(importable) 2023-10-09T18:18:13,140 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-10-09T18:18:13,140 !! 2023-10-09T18:18:13,141 ******************************************************************************** 2023-10-09T18:18:13,142 ############################ 2023-10-09T18:18:13,143 # Package would be ignored # 2023-10-09T18:18:13,143 ############################ 2023-10-09T18:18:13,144 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-10-09T18:18:13,144 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,145 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,146 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-10-09T18:18:13,146 to the `packages` configuration field. 2023-10-09T18:18:13,147 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,148 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,148 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,149 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,151 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,152 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-10-09T18:18:13,152 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-10-09T18:18:13,153 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,153 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,154 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,155 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,156 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,157 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,158 even if it does not contain any `.py` files. 2023-10-09T18:18:13,158 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,159 directory, all directories are treated like packages. 2023-10-09T18:18:13,159 ******************************************************************************** 2023-10-09T18:18:13,160 !! 2023-10-09T18:18:13,161 check.warn(importable) 2023-10-09T18:18:13,162 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-10-09T18:18:13,162 !! 2023-10-09T18:18:13,163 ******************************************************************************** 2023-10-09T18:18:13,164 ############################ 2023-10-09T18:18:13,164 # Package would be ignored # 2023-10-09T18:18:13,165 ############################ 2023-10-09T18:18:13,165 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-10-09T18:18:13,166 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,167 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,167 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-10-09T18:18:13,167 to the `packages` configuration field. 2023-10-09T18:18:13,168 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,169 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,169 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,171 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,172 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,173 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-10-09T18:18:13,173 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-10-09T18:18:13,173 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,174 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,175 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,176 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,177 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,178 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,179 even if it does not contain any `.py` files. 2023-10-09T18:18:13,179 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,180 directory, all directories are treated like packages. 2023-10-09T18:18:13,180 ******************************************************************************** 2023-10-09T18:18:13,181 !! 2023-10-09T18:18:13,182 check.warn(importable) 2023-10-09T18:18:13,182 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-10-09T18:18:13,183 !! 2023-10-09T18:18:13,184 ******************************************************************************** 2023-10-09T18:18:13,185 ############################ 2023-10-09T18:18:13,185 # Package would be ignored # 2023-10-09T18:18:13,186 ############################ 2023-10-09T18:18:13,186 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-10-09T18:18:13,187 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,188 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,188 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-10-09T18:18:13,189 to the `packages` configuration field. 2023-10-09T18:18:13,190 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,190 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,190 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,191 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,192 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,193 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-10-09T18:18:13,194 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-10-09T18:18:13,194 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,195 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,195 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,196 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,197 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,198 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,199 even if it does not contain any `.py` files. 2023-10-09T18:18:13,199 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,200 directory, all directories are treated like packages. 2023-10-09T18:18:13,200 ******************************************************************************** 2023-10-09T18:18:13,201 !! 2023-10-09T18:18:13,202 check.warn(importable) 2023-10-09T18:18:13,202 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-10-09T18:18:13,203 !! 2023-10-09T18:18:13,204 ******************************************************************************** 2023-10-09T18:18:13,205 ############################ 2023-10-09T18:18:13,205 # Package would be ignored # 2023-10-09T18:18:13,206 ############################ 2023-10-09T18:18:13,206 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-10-09T18:18:13,207 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,208 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,208 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-10-09T18:18:13,209 to the `packages` configuration field. 2023-10-09T18:18:13,210 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,210 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,211 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,212 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,213 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,214 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-10-09T18:18:13,215 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-10-09T18:18:13,215 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,215 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,216 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,217 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,218 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,219 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,219 even if it does not contain any `.py` files. 2023-10-09T18:18:13,220 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,220 directory, all directories are treated like packages. 2023-10-09T18:18:13,221 ******************************************************************************** 2023-10-09T18:18:13,222 !! 2023-10-09T18:18:13,222 check.warn(importable) 2023-10-09T18:18:13,223 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-10-09T18:18:13,223 !! 2023-10-09T18:18:13,224 ******************************************************************************** 2023-10-09T18:18:13,224 ############################ 2023-10-09T18:18:13,225 # Package would be ignored # 2023-10-09T18:18:13,225 ############################ 2023-10-09T18:18:13,226 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-10-09T18:18:13,226 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,227 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,228 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-10-09T18:18:13,228 to the `packages` configuration field. 2023-10-09T18:18:13,229 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,230 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,231 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,232 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,233 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,234 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-10-09T18:18:13,235 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-10-09T18:18:13,235 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,236 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,237 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,238 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,239 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,240 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,241 even if it does not contain any `.py` files. 2023-10-09T18:18:13,241 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,242 directory, all directories are treated like packages. 2023-10-09T18:18:13,242 ******************************************************************************** 2023-10-09T18:18:13,243 !! 2023-10-09T18:18:13,244 check.warn(importable) 2023-10-09T18:18:13,244 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-10-09T18:18:13,245 !! 2023-10-09T18:18:13,246 ******************************************************************************** 2023-10-09T18:18:13,246 ############################ 2023-10-09T18:18:13,247 # Package would be ignored # 2023-10-09T18:18:13,247 ############################ 2023-10-09T18:18:13,248 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-10-09T18:18:13,248 but it is absent from setuptools' `packages` configuration. 2023-10-09T18:18:13,249 This leads to an ambiguous overall configuration. If you want to distribute this 2023-10-09T18:18:13,249 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-10-09T18:18:13,250 to the `packages` configuration field. 2023-10-09T18:18:13,251 Alternatively, you can also rely on setuptools' discovery methods 2023-10-09T18:18:13,252 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-10-09T18:18:13,252 instead of `find_packages(...)`/`find:`). 2023-10-09T18:18:13,253 You can read more about "package discovery" on setuptools documentation page: 2023-10-09T18:18:13,254 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-10-09T18:18:13,255 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-10-09T18:18:13,256 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-10-09T18:18:13,256 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-10-09T18:18:13,257 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-10-09T18:18:13,257 combination with a more fine grained `package-data` configuration. 2023-10-09T18:18:13,258 You can read more about "package data files" on setuptools documentation page: 2023-10-09T18:18:13,259 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-10-09T18:18:13,261 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-10-09T18:18:13,261 even if it does not contain any `.py` files. 2023-10-09T18:18:13,262 On the other hand, currently there is no concept of package data 2023-10-09T18:18:13,262 directory, all directories are treated like packages. 2023-10-09T18:18:13,263 ******************************************************************************** 2023-10-09T18:18:13,264 !! 2023-10-09T18:18:13,265 check.warn(importable) 2023-10-09T18:18:13,265 creating build/lib/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,266 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,266 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,267 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,267 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,268 creating build/lib/deepspeed/ops/csrc 2023-10-09T18:18:13,268 creating build/lib/deepspeed/ops/csrc/adagrad 2023-10-09T18:18:13,269 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-10-09T18:18:13,269 creating build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,270 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,271 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,271 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,272 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,272 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-10-09T18:18:13,272 creating build/lib/deepspeed/ops/csrc/aio 2023-10-09T18:18:13,273 creating build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,273 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,274 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,274 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,275 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,275 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,276 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:13,276 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,277 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,277 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,278 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,278 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,279 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,279 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,280 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,280 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,281 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,282 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,283 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:13,283 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-10-09T18:18:13,284 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-10-09T18:18:13,284 creating build/lib/deepspeed/ops/csrc/common 2023-10-09T18:18:13,285 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-10-09T18:18:13,285 creating build/lib/deepspeed/ops/csrc/cpu 2023-10-09T18:18:13,286 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-10-09T18:18:13,286 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-10-09T18:18:13,287 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-10-09T18:18:13,287 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-10-09T18:18:13,288 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-10-09T18:18:13,288 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-10-09T18:18:13,289 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-10-09T18:18:13,290 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,290 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,290 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,291 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,291 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,292 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,292 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,293 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,293 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,294 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,294 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,295 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,295 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,296 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,296 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,297 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,297 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,298 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,298 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,299 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,299 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,300 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,300 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,301 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,301 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,302 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,302 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,303 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,303 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,304 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,304 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,305 creating build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,305 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,305 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,306 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,307 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,307 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,307 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,308 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,308 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,309 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,309 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,310 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,310 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,311 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,311 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,312 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,312 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,313 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,314 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,314 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,315 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,315 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,316 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,316 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,317 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,317 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,318 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,318 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,318 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,319 creating build/lib/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,319 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,320 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,320 creating build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,321 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,321 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,322 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,322 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,322 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,323 creating build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,323 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,324 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,324 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,325 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,325 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,326 copying deepspeed/ops/csrc/quantization/quantize_int4.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,326 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-10-09T18:18:13,327 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,328 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,328 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,329 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,329 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,330 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-10-09T18:18:13,330 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-10-09T18:18:13,331 creating build/lib/deepspeed/ops/csrc/spatial 2023-10-09T18:18:13,331 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:13,332 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:13,332 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:13,333 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-10-09T18:18:13,333 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-10-09T18:18:13,334 creating build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,334 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,335 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,335 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,336 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,336 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,337 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,337 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,337 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-10-09T18:18:13,338 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-10-09T18:18:13,338 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,339 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,339 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,340 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,340 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,340 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,341 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,342 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,342 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,343 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,343 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:13,344 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:13,344 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:13,345 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:13,345 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:13,346 creating build/lib/deepspeed/ops/csrc/utils 2023-10-09T18:18:13,346 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-10-09T18:18:13,347 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:13,348 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:13,348 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:13,357 running build_scripts 2023-10-09T18:18:13,358 creating build/scripts-3.11 2023-10-09T18:18:13,359 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-10-09T18:18:13,361 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-10-09T18:18:13,362 copying and adjusting bin/ds -> build/scripts-3.11 2023-10-09T18:18:13,364 copying bin/ds_ssh -> build/scripts-3.11 2023-10-09T18:18:13,366 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-10-09T18:18:13,367 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-10-09T18:18:13,368 copying and adjusting bin/dsr -> build/scripts-3.11 2023-10-09T18:18:13,369 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-10-09T18:18:13,371 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-10-09T18:18:13,371 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-10-09T18:18:13,371 changing mode of build/scripts-3.11/ds from 644 to 755 2023-10-09T18:18:13,372 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-10-09T18:18:13,372 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-10-09T18:18:13,373 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-10-09T18:18:13,373 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-10-09T18:18:13,398 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-10-09T18:18:13,399 !! 2023-10-09T18:18:13,400 ******************************************************************************** 2023-10-09T18:18:13,400 Please avoid running ``setup.py`` directly. 2023-10-09T18:18:13,401 Instead, use pypa/build, pypa/installer or other 2023-10-09T18:18:13,401 standards-based tools. 2023-10-09T18:18:13,402 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-10-09T18:18:13,403 ******************************************************************************** 2023-10-09T18:18:13,404 !! 2023-10-09T18:18:13,405 self.initialize_options() 2023-10-09T18:18:13,423 installing to build/bdist.linux-armv7l/wheel 2023-10-09T18:18:13,424 running install 2023-10-09T18:18:13,448 running install_lib 2023-10-09T18:18:13,472 creating build/bdist.linux-armv7l 2023-10-09T18:18:13,473 creating build/bdist.linux-armv7l/wheel 2023-10-09T18:18:13,475 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:13,476 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:13,478 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:13,480 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-10-09T18:18:13,481 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-10-09T18:18:13,483 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-10-09T18:18:13,486 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,487 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,489 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,491 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,493 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,495 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-10-09T18:18:13,497 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-10-09T18:18:13,499 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:13,502 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,503 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,504 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,506 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,508 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,509 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,511 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,513 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-10-09T18:18:13,515 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,516 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,518 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,520 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,521 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,523 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,526 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-10-09T18:18:13,528 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-10-09T18:18:13,529 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-10-09T18:18:13,531 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-10-09T18:18:13,533 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,534 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,536 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,538 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,541 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,543 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,546 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,547 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,549 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,551 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,553 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,554 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,556 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-10-09T18:18:13,558 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-10-09T18:18:13,561 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,562 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,564 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,565 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,567 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-10-09T18:18:13,569 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,570 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,571 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,573 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,576 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,578 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-10-09T18:18:13,581 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,582 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,584 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,586 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,588 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,590 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,592 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,594 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,596 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,598 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-10-09T18:18:13,601 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,602 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,605 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,606 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,609 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,611 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,613 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,616 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,618 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-10-09T18:18:13,621 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:13,624 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,625 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,626 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,629 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,631 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,633 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,635 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,638 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-10-09T18:18:13,640 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-10-09T18:18:13,641 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-10-09T18:18:13,644 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-10-09T18:18:13,644 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-10-09T18:18:13,646 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-10-09T18:18:13,648 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,649 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,652 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,653 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,655 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,657 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,659 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,661 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,663 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,664 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,666 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-10-09T18:18:13,668 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-10-09T18:18:13,669 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-10-09T18:18:13,671 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-10-09T18:18:13,673 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-10-09T18:18:13,676 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,677 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,679 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,681 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,683 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,685 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,687 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,689 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,691 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,693 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,695 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,698 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,700 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,702 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,704 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-10-09T18:18:13,706 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-10-09T18:18:13,707 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-10-09T18:18:13,708 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-10-09T18:18:13,710 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-10-09T18:18:13,712 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-10-09T18:18:13,714 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-10-09T18:18:13,716 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-10-09T18:18:13,718 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-10-09T18:18:13,719 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-10-09T18:18:13,721 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-10-09T18:18:13,724 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-10-09T18:18:13,725 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-10-09T18:18:13,727 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-10-09T18:18:13,729 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,730 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,732 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,734 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,736 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,738 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-10-09T18:18:13,739 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-10-09T18:18:13,741 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-10-09T18:18:13,743 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-10-09T18:18:13,744 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,746 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,748 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,748 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,750 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,752 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,753 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,755 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,757 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-10-09T18:18:13,759 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,761 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,763 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,765 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,767 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,771 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,773 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,776 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,778 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,781 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,784 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,786 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-10-09T18:18:13,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-10-09T18:18:13,790 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-10-09T18:18:13,793 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-10-09T18:18:13,797 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-10-09T18:18:13,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,800 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,803 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,805 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,808 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,810 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-10-09T18:18:13,814 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,815 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,818 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,821 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,824 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-10-09T18:18:13,827 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2023-10-09T18:18:13,829 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,831 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,834 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,835 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,838 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,842 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,846 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,849 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,853 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,857 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-10-09T18:18:13,860 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,861 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,864 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,866 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,869 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-10-09T18:18:13,872 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,873 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,875 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,878 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,881 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,883 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,887 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,889 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-10-09T18:18:13,892 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,894 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,897 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,898 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,901 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-10-09T18:18:13,903 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,905 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,909 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-10-09T18:18:13,913 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,914 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,916 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-10-09T18:18:13,919 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,920 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,923 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,925 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,927 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,928 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,930 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,932 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,934 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,936 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,939 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,941 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,944 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,946 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,948 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,950 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,952 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,955 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,957 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,960 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,961 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,964 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,966 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,968 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,970 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,972 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,974 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,976 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,979 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-10-09T18:18:13,982 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-10-09T18:18:13,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-10-09T18:18:13,984 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-10-09T18:18:13,986 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-10-09T18:18:13,987 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-10-09T18:18:13,990 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-10-09T18:18:13,994 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-10-09T18:18:13,997 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-10-09T18:18:13,999 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-10-09T18:18:14,000 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-10-09T18:18:14,002 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:14,003 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:14,005 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-10-09T18:18:14,008 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,009 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,011 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,013 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,015 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,018 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-10-09T18:18:14,020 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,022 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-10-09T18:18:14,024 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:14,025 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:14,028 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:14,031 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-10-09T18:18:14,034 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,035 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,038 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,040 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,044 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,046 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,048 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,050 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,052 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,055 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,057 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-10-09T18:18:14,060 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,063 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,066 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,069 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,071 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,075 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,078 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,080 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-10-09T18:18:14,085 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,086 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,088 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,092 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,094 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,097 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,099 copying build/lib/deepspeed/ops/csrc/quantization/quantize_int4.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,101 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-10-09T18:18:14,104 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-10-09T18:18:14,105 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-10-09T18:18:14,108 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-10-09T18:18:14,109 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-10-09T18:18:14,112 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-10-09T18:18:14,113 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-10-09T18:18:14,116 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-10-09T18:18:14,117 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-10-09T18:18:14,120 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-10-09T18:18:14,121 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,122 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,124 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,126 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,128 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,130 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,132 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,135 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,136 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,139 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,141 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,143 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-10-09T18:18:14,145 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,146 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,148 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,151 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,153 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,155 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,158 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-10-09T18:18:14,160 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-10-09T18:18:14,161 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-10-09T18:18:14,164 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-10-09T18:18:14,165 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-10-09T18:18:14,167 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-10-09T18:18:14,169 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-10-09T18:18:14,171 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-10-09T18:18:14,173 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-10-09T18:18:14,174 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-10-09T18:18:14,177 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,178 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,180 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,183 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,184 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,186 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,188 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,190 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,192 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,195 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,197 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,200 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,202 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,204 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-10-09T18:18:14,206 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,209 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,211 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,213 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,215 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,217 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,220 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,223 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,224 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,226 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,228 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,230 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,232 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,234 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,236 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,237 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,240 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,242 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-10-09T18:18:14,244 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-10-09T18:18:14,246 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-10-09T18:18:14,249 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-10-09T18:18:14,250 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-10-09T18:18:14,251 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-10-09T18:18:14,254 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,255 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,257 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,259 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,261 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:14,263 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:14,264 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:14,267 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:14,269 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-10-09T18:18:14,271 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,274 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,276 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,279 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-10-09T18:18:14,281 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-10-09T18:18:14,282 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-10-09T18:18:14,284 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-10-09T18:18:14,286 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-10-09T18:18:14,286 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-10-09T18:18:14,288 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-10-09T18:18:14,290 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,291 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,293 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,295 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,297 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,299 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,301 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,302 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,305 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,307 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-10-09T18:18:14,309 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,310 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,312 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,314 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,316 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,318 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,320 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,323 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,324 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,326 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,328 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,329 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,330 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,332 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,334 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,337 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,338 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,340 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-10-09T18:18:14,342 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,344 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,346 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,348 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,350 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,352 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,354 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,356 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,359 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,361 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,363 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,365 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,367 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,369 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,371 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,373 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,375 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-10-09T18:18:14,377 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,379 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,381 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,384 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,385 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,388 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-10-09T18:18:14,390 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-10-09T18:18:14,391 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-10-09T18:18:14,393 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,394 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,396 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,398 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,400 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,402 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,404 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,407 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-10-09T18:18:14,407 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-10-09T18:18:14,410 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-10-09T18:18:14,412 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,413 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,414 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,416 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,418 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,420 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-10-09T18:18:14,422 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-10-09T18:18:14,425 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,426 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,428 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,430 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,432 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,435 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-10-09T18:18:14,437 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-10-09T18:18:14,439 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,442 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,444 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,447 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-10-09T18:18:14,447 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-10-09T18:18:14,449 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-10-09T18:18:14,451 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,453 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,457 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,459 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,461 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,464 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:14,465 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:14,467 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:14,468 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:14,470 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-10-09T18:18:14,473 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,474 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,475 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,477 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,480 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,482 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,484 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,486 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,488 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,490 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-10-09T18:18:14,492 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,495 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:14,496 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:14,498 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:14,501 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-10-09T18:18:14,503 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-10-09T18:18:14,504 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-10-09T18:18:14,505 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-10-09T18:18:14,508 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-10-09T18:18:14,510 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-10-09T18:18:14,512 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-10-09T18:18:14,513 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-10-09T18:18:14,515 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-10-09T18:18:14,517 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:14,519 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:14,520 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:14,523 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:14,525 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-10-09T18:18:14,528 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-10-09T18:18:14,530 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-10-09T18:18:14,533 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,534 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,536 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,539 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,541 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,544 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,547 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-10-09T18:18:14,549 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-10-09T18:18:14,551 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,552 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,554 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,558 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,560 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,562 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,564 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,566 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,570 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,573 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,575 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,578 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,581 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,583 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,586 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,587 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,590 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-10-09T18:18:14,592 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,593 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,595 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,597 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,599 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,601 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,603 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-10-09T18:18:14,605 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-10-09T18:18:14,606 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-10-09T18:18:14,608 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-10-09T18:18:14,610 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-10-09T18:18:14,611 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-10-09T18:18:14,613 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-10-09T18:18:14,616 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-10-09T18:18:14,618 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-10-09T18:18:14,619 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-10-09T18:18:14,621 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-10-09T18:18:14,623 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-10-09T18:18:14,625 running install_egg_info 2023-10-09T18:18:14,657 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.11.1-py3.11.egg-info 2023-10-09T18:18:14,670 running install_scripts 2023-10-09T18:18:14,671 creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data 2023-10-09T18:18:14,671 creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,673 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,675 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,676 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,678 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,680 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,682 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,684 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,686 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts 2023-10-09T18:18:14,688 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/dsr to 755 2023-10-09T18:18:14,688 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/ds_ssh to 755 2023-10-09T18:18:14,689 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/ds_bench to 755 2023-10-09T18:18:14,689 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/deepspeed.pt to 755 2023-10-09T18:18:14,690 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/deepspeed to 755 2023-10-09T18:18:14,690 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/ds to 755 2023-10-09T18:18:14,691 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/ds_report to 755 2023-10-09T18:18:14,691 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.data/scripts/ds_elastic to 755 2023-10-09T18:18:14,733 creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.1.dist-info/WHEEL 2023-10-09T18:18:14,736 creating '/tmp/pip-wheel-wuazm6js/deepspeed-0.11.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-10-09T18:18:14,739 adding 'deepspeed/__init__.py' 2023-10-09T18:18:14,741 adding 'deepspeed/constants.py' 2023-10-09T18:18:14,742 adding 'deepspeed/env_report.py' 2023-10-09T18:18:14,744 adding 'deepspeed/git_version_info.py' 2023-10-09T18:18:14,745 adding 'deepspeed/git_version_info_installed.py' 2023-10-09T18:18:14,747 adding 'deepspeed/accelerator/__init__.py' 2023-10-09T18:18:14,748 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-10-09T18:18:14,750 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-10-09T18:18:14,752 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-10-09T18:18:14,753 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-10-09T18:18:14,755 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-10-09T18:18:14,756 adding 'deepspeed/accelerator/real_accelerator.py' 2023-10-09T18:18:14,758 adding 'deepspeed/autotuning/__init__.py' 2023-10-09T18:18:14,763 adding 'deepspeed/autotuning/autotuner.py' 2023-10-09T18:18:14,765 adding 'deepspeed/autotuning/config.py' 2023-10-09T18:18:14,767 adding 'deepspeed/autotuning/constants.py' 2023-10-09T18:18:14,769 adding 'deepspeed/autotuning/scheduler.py' 2023-10-09T18:18:14,771 adding 'deepspeed/autotuning/utils.py' 2023-10-09T18:18:14,773 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-10-09T18:18:14,774 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-10-09T18:18:14,776 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-10-09T18:18:14,777 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-10-09T18:18:14,778 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-10-09T18:18:14,780 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-10-09T18:18:14,781 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-10-09T18:18:14,782 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-10-09T18:18:14,784 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-10-09T18:18:14,785 adding 'deepspeed/autotuning/tuner/utils.py' 2023-10-09T18:18:14,787 adding 'deepspeed/checkpoint/__init__.py' 2023-10-09T18:18:14,788 adding 'deepspeed/checkpoint/constants.py' 2023-10-09T18:18:14,790 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-10-09T18:18:14,791 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-10-09T18:18:14,793 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-10-09T18:18:14,794 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-10-09T18:18:14,796 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-10-09T18:18:14,797 adding 'deepspeed/checkpoint/utils.py' 2023-10-09T18:18:14,799 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-10-09T18:18:14,801 adding 'deepspeed/comm/__init__.py' 2023-10-09T18:18:14,802 adding 'deepspeed/comm/backend.py' 2023-10-09T18:18:14,803 adding 'deepspeed/comm/ccl.py' 2023-10-09T18:18:14,806 adding 'deepspeed/comm/comm.py' 2023-10-09T18:18:14,808 adding 'deepspeed/comm/config.py' 2023-10-09T18:18:14,809 adding 'deepspeed/comm/constants.py' 2023-10-09T18:18:14,810 adding 'deepspeed/comm/reduce_op.py' 2023-10-09T18:18:14,812 adding 'deepspeed/comm/torch.py' 2023-10-09T18:18:14,813 adding 'deepspeed/comm/utils.py' 2023-10-09T18:18:14,815 adding 'deepspeed/compression/__init__.py' 2023-10-09T18:18:14,819 adding 'deepspeed/compression/basic_layer.py' 2023-10-09T18:18:14,821 adding 'deepspeed/compression/compress.py' 2023-10-09T18:18:14,823 adding 'deepspeed/compression/config.py' 2023-10-09T18:18:14,824 adding 'deepspeed/compression/constants.py' 2023-10-09T18:18:14,826 adding 'deepspeed/compression/helper.py' 2023-10-09T18:18:14,828 adding 'deepspeed/compression/scheduler.py' 2023-10-09T18:18:14,829 adding 'deepspeed/compression/utils.py' 2023-10-09T18:18:14,831 adding 'deepspeed/elasticity/__init__.py' 2023-10-09T18:18:14,833 adding 'deepspeed/elasticity/config.py' 2023-10-09T18:18:14,834 adding 'deepspeed/elasticity/constants.py' 2023-10-09T18:18:14,836 adding 'deepspeed/elasticity/elastic_agent.py' 2023-10-09T18:18:14,838 adding 'deepspeed/elasticity/elasticity.py' 2023-10-09T18:18:14,839 adding 'deepspeed/elasticity/utils.py' 2023-10-09T18:18:14,841 adding 'deepspeed/inference/__init__.py' 2023-10-09T18:18:14,843 adding 'deepspeed/inference/config.py' 2023-10-09T18:18:14,847 adding 'deepspeed/inference/engine.py' 2023-10-09T18:18:14,849 adding 'deepspeed/inference/quantization/__init__.py' 2023-10-09T18:18:14,850 adding 'deepspeed/inference/quantization/layers.py' 2023-10-09T18:18:14,852 adding 'deepspeed/inference/quantization/quantization.py' 2023-10-09T18:18:14,853 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-10-09T18:18:14,855 adding 'deepspeed/inference/quantization/utils.py' 2023-10-09T18:18:14,857 adding 'deepspeed/launcher/__init__.py' 2023-10-09T18:18:14,858 adding 'deepspeed/launcher/constants.py' 2023-10-09T18:18:14,860 adding 'deepspeed/launcher/launch.py' 2023-10-09T18:18:14,862 adding 'deepspeed/launcher/multinode_runner.py' 2023-10-09T18:18:14,865 adding 'deepspeed/launcher/runner.py' 2023-10-09T18:18:14,867 adding 'deepspeed/model_implementations/__init__.py' 2023-10-09T18:18:14,869 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-10-09T18:18:14,870 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-10-09T18:18:14,872 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-10-09T18:18:14,874 adding 'deepspeed/model_implementations/features/__init__.py' 2023-10-09T18:18:14,875 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-10-09T18:18:14,877 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-10-09T18:18:14,878 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-10-09T18:18:14,879 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-10-09T18:18:14,880 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-10-09T18:18:14,881 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-10-09T18:18:14,882 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-10-09T18:18:14,884 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-10-09T18:18:14,885 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-10-09T18:18:14,886 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-10-09T18:18:14,888 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-10-09T18:18:14,890 adding 'deepspeed/module_inject/__init__.py' 2023-10-09T18:18:14,892 adding 'deepspeed/module_inject/auto_tp.py' 2023-10-09T18:18:14,894 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-10-09T18:18:14,895 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-10-09T18:18:14,897 adding 'deepspeed/module_inject/inject.py' 2023-10-09T18:18:14,898 adding 'deepspeed/module_inject/layers.py' 2023-10-09T18:18:14,900 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-10-09T18:18:14,901 adding 'deepspeed/module_inject/module_quantize.py' 2023-10-09T18:18:14,903 adding 'deepspeed/module_inject/policy.py' 2023-10-09T18:18:14,906 adding 'deepspeed/module_inject/replace_module.py' 2023-10-09T18:18:14,908 adding 'deepspeed/module_inject/replace_policy.py' 2023-10-09T18:18:14,909 adding 'deepspeed/module_inject/utils.py' 2023-10-09T18:18:14,911 adding 'deepspeed/module_inject/containers/__init__.py' 2023-10-09T18:18:14,913 adding 'deepspeed/module_inject/containers/base.py' 2023-10-09T18:18:14,914 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-10-09T18:18:14,916 adding 'deepspeed/module_inject/containers/bert.py' 2023-10-09T18:18:14,917 adding 'deepspeed/module_inject/containers/bloom.py' 2023-10-09T18:18:14,919 adding 'deepspeed/module_inject/containers/clip.py' 2023-10-09T18:18:14,920 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-10-09T18:18:14,921 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-10-09T18:18:14,923 adding 'deepspeed/module_inject/containers/gptj.py' 2023-10-09T18:18:14,924 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-10-09T18:18:14,925 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-10-09T18:18:14,927 adding 'deepspeed/module_inject/containers/internlm.py' 2023-10-09T18:18:14,929 adding 'deepspeed/module_inject/containers/llama.py' 2023-10-09T18:18:14,930 adding 'deepspeed/module_inject/containers/llama2.py' 2023-10-09T18:18:14,932 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-10-09T18:18:14,933 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-10-09T18:18:14,935 adding 'deepspeed/module_inject/containers/opt.py' 2023-10-09T18:18:14,936 adding 'deepspeed/module_inject/containers/unet.py' 2023-10-09T18:18:14,937 adding 'deepspeed/module_inject/containers/vae.py' 2023-10-09T18:18:14,939 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-10-09T18:18:14,940 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-10-09T18:18:14,942 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-10-09T18:18:14,944 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-10-09T18:18:14,945 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-10-09T18:18:14,946 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-10-09T18:18:14,948 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-10-09T18:18:14,950 adding 'deepspeed/moe/__init__.py' 2023-10-09T18:18:14,951 adding 'deepspeed/moe/experts.py' 2023-10-09T18:18:14,952 adding 'deepspeed/moe/layer.py' 2023-10-09T18:18:14,953 adding 'deepspeed/moe/mappings.py' 2023-10-09T18:18:14,956 adding 'deepspeed/moe/sharded_moe.py' 2023-10-09T18:18:14,958 adding 'deepspeed/moe/utils.py' 2023-10-09T18:18:14,959 adding 'deepspeed/monitor/__init__.py' 2023-10-09T18:18:14,960 adding 'deepspeed/monitor/config.py' 2023-10-09T18:18:14,962 adding 'deepspeed/monitor/csv_monitor.py' 2023-10-09T18:18:14,963 adding 'deepspeed/monitor/monitor.py' 2023-10-09T18:18:14,964 adding 'deepspeed/monitor/tensorboard.py' 2023-10-09T18:18:14,965 adding 'deepspeed/monitor/utils.py' 2023-10-09T18:18:14,966 adding 'deepspeed/monitor/wandb.py' 2023-10-09T18:18:14,968 adding 'deepspeed/nebula/__init__.py' 2023-10-09T18:18:14,969 adding 'deepspeed/nebula/config.py' 2023-10-09T18:18:14,971 adding 'deepspeed/nebula/constants.py' 2023-10-09T18:18:14,972 adding 'deepspeed/ops/__init__.py' 2023-10-09T18:18:14,974 adding 'deepspeed/ops/adagrad/__init__.py' 2023-10-09T18:18:14,975 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-10-09T18:18:14,977 adding 'deepspeed/ops/adam/__init__.py' 2023-10-09T18:18:14,979 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-10-09T18:18:14,980 adding 'deepspeed/ops/adam/fused_adam.py' 2023-10-09T18:18:14,981 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-10-09T18:18:14,983 adding 'deepspeed/ops/aio/__init__.py' 2023-10-09T18:18:14,986 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-10-09T18:18:14,987 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-10-09T18:18:14,989 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-10-09T18:18:14,990 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-10-09T18:18:14,992 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-10-09T18:18:14,993 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-10-09T18:18:14,996 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-10-09T18:18:14,997 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-10-09T18:18:14,999 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-10-09T18:18:15,000 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-10-09T18:18:15,001 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-10-09T18:18:15,003 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-10-09T18:18:15,005 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-10-09T18:18:15,006 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-10-09T18:18:15,007 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-10-09T18:18:15,008 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-10-09T18:18:15,010 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-10-09T18:18:15,011 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-10-09T18:18:15,013 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-10-09T18:18:15,014 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-10-09T18:18:15,015 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-10-09T18:18:15,017 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-10-09T18:18:15,018 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-10-09T18:18:15,020 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-10-09T18:18:15,021 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-10-09T18:18:15,024 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-10-09T18:18:15,027 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-10-09T18:18:15,029 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-10-09T18:18:15,031 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-10-09T18:18:15,033 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cu' 2023-10-09T18:18:15,035 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-10-09T18:18:15,036 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-10-09T18:18:15,044 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-10-09T18:18:15,049 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-10-09T18:18:15,052 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-10-09T18:18:15,054 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-10-09T18:18:15,056 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-10-09T18:18:15,058 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-10-09T18:18:15,060 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-10-09T18:18:15,061 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-10-09T18:18:15,064 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-10-09T18:18:15,067 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-10-09T18:18:15,068 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-10-09T18:18:15,070 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-10-09T18:18:15,078 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-10-09T18:18:15,081 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-10-09T18:18:15,083 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-10-09T18:18:15,087 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-10-09T18:18:15,091 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-10-09T18:18:15,094 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-10-09T18:18:15,096 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-10-09T18:18:15,098 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-10-09T18:18:15,100 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-10-09T18:18:15,102 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-10-09T18:18:15,104 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-10-09T18:18:15,105 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-10-09T18:18:15,106 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-10-09T18:18:15,108 adding 'deepspeed/ops/csrc/includes/context.h' 2023-10-09T18:18:15,110 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-10-09T18:18:15,111 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-10-09T18:18:15,113 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-10-09T18:18:15,115 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-10-09T18:18:15,116 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-10-09T18:18:15,118 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-10-09T18:18:15,120 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-10-09T18:18:15,121 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-10-09T18:18:15,122 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-10-09T18:18:15,124 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-10-09T18:18:15,125 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-10-09T18:18:15,126 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-10-09T18:18:15,128 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-10-09T18:18:15,129 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-10-09T18:18:15,131 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-10-09T18:18:15,133 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-10-09T18:18:15,134 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-10-09T18:18:15,136 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-10-09T18:18:15,137 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-10-09T18:18:15,139 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-10-09T18:18:15,141 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-10-09T18:18:15,142 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-10-09T18:18:15,144 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-10-09T18:18:15,145 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-10-09T18:18:15,147 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-10-09T18:18:15,149 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-10-09T18:18:15,151 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-10-09T18:18:15,153 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-10-09T18:18:15,154 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-10-09T18:18:15,155 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-10-09T18:18:15,157 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-10-09T18:18:15,159 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-10-09T18:18:15,161 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-10-09T18:18:15,163 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-10-09T18:18:15,165 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-10-09T18:18:15,166 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-10-09T18:18:15,168 adding 'deepspeed/ops/csrc/quantization/quantize_int4.cu' 2023-10-09T18:18:15,170 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-10-09T18:18:15,172 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-10-09T18:18:15,173 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-10-09T18:18:15,175 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-10-09T18:18:15,176 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-10-09T18:18:15,178 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-10-09T18:18:15,181 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-10-09T18:18:15,183 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-10-09T18:18:15,184 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-10-09T18:18:15,187 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-10-09T18:18:15,189 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-10-09T18:18:15,194 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-10-09T18:18:15,196 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-10-09T18:18:15,197 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-10-09T18:18:15,202 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-10-09T18:18:15,205 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-10-09T18:18:15,207 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-10-09T18:18:15,210 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-10-09T18:18:15,212 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-10-09T18:18:15,214 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-10-09T18:18:15,217 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-10-09T18:18:15,218 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-10-09T18:18:15,224 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-10-09T18:18:15,226 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-10-09T18:18:15,228 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-10-09T18:18:15,231 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-10-09T18:18:15,234 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-10-09T18:18:15,237 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-10-09T18:18:15,238 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-10-09T18:18:15,240 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-10-09T18:18:15,242 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-10-09T18:18:15,243 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-10-09T18:18:15,245 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-10-09T18:18:15,246 adding 'deepspeed/ops/lamb/__init__.py' 2023-10-09T18:18:15,248 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-10-09T18:18:15,250 adding 'deepspeed/ops/lion/__init__.py' 2023-10-09T18:18:15,251 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-10-09T18:18:15,253 adding 'deepspeed/ops/lion/fused_lion.py' 2023-10-09T18:18:15,254 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-10-09T18:18:15,256 adding 'deepspeed/ops/op_builder/__init__.py' 2023-10-09T18:18:15,257 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-10-09T18:18:15,259 adding 'deepspeed/ops/op_builder/async_io.py' 2023-10-09T18:18:15,262 adding 'deepspeed/ops/op_builder/builder.py' 2023-10-09T18:18:15,264 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-10-09T18:18:15,265 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-10-09T18:18:15,266 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-10-09T18:18:15,268 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-10-09T18:18:15,270 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-10-09T18:18:15,271 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-10-09T18:18:15,273 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-10-09T18:18:15,274 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-10-09T18:18:15,275 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-10-09T18:18:15,277 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-10-09T18:18:15,278 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-10-09T18:18:15,279 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-10-09T18:18:15,281 adding 'deepspeed/ops/op_builder/transformer.py' 2023-10-09T18:18:15,282 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-10-09T18:18:15,284 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-10-09T18:18:15,285 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-10-09T18:18:15,287 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-10-09T18:18:15,288 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-10-09T18:18:15,289 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-10-09T18:18:15,290 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-10-09T18:18:15,292 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-10-09T18:18:15,293 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-10-09T18:18:15,295 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-10-09T18:18:15,296 adding 'deepspeed/ops/quantizer/__init__.py' 2023-10-09T18:18:15,298 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-10-09T18:18:15,299 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-10-09T18:18:15,301 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-10-09T18:18:15,303 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-10-09T18:18:15,305 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-10-09T18:18:15,309 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-10-09T18:18:15,311 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-10-09T18:18:15,314 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-10-09T18:18:15,315 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-10-09T18:18:15,319 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-10-09T18:18:15,321 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-10-09T18:18:15,323 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-10-09T18:18:15,324 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-10-09T18:18:15,325 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-10-09T18:18:15,327 adding 'deepspeed/ops/transformer/__init__.py' 2023-10-09T18:18:15,329 adding 'deepspeed/ops/transformer/transformer.py' 2023-10-09T18:18:15,331 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-10-09T18:18:15,332 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-10-09T18:18:15,334 adding 'deepspeed/ops/transformer/inference/config.py' 2023-10-09T18:18:15,335 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-10-09T18:18:15,336 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-10-09T18:18:15,338 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-10-09T18:18:15,340 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-10-09T18:18:15,341 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-10-09T18:18:15,344 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-10-09T18:18:15,345 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-10-09T18:18:15,347 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-10-09T18:18:15,348 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-10-09T18:18:15,350 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-10-09T18:18:15,351 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-10-09T18:18:15,352 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-10-09T18:18:15,354 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-10-09T18:18:15,355 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-10-09T18:18:15,357 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-10-09T18:18:15,358 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-10-09T18:18:15,359 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-10-09T18:18:15,361 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-10-09T18:18:15,363 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-10-09T18:18:15,365 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-10-09T18:18:15,366 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-10-09T18:18:15,368 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-10-09T18:18:15,370 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-10-09T18:18:15,371 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-10-09T18:18:15,373 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-10-09T18:18:15,374 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-10-09T18:18:15,376 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-10-09T18:18:15,378 adding 'deepspeed/pipe/__init__.py' 2023-10-09T18:18:15,380 adding 'deepspeed/profiling/__init__.py' 2023-10-09T18:18:15,381 adding 'deepspeed/profiling/config.py' 2023-10-09T18:18:15,382 adding 'deepspeed/profiling/constants.py' 2023-10-09T18:18:15,384 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-10-09T18:18:15,389 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-10-09T18:18:15,392 adding 'deepspeed/runtime/__init__.py' 2023-10-09T18:18:15,394 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-10-09T18:18:15,398 adding 'deepspeed/runtime/config.py' 2023-10-09T18:18:15,400 adding 'deepspeed/runtime/config_utils.py' 2023-10-09T18:18:15,402 adding 'deepspeed/runtime/constants.py' 2023-10-09T18:18:15,404 adding 'deepspeed/runtime/dataloader.py' 2023-10-09T18:18:15,405 adding 'deepspeed/runtime/eigenvalue.py' 2023-10-09T18:18:15,422 adding 'deepspeed/runtime/engine.py' 2023-10-09T18:18:15,426 adding 'deepspeed/runtime/hybrid_engine.py' 2023-10-09T18:18:15,430 adding 'deepspeed/runtime/lr_schedules.py' 2023-10-09T18:18:15,431 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-10-09T18:18:15,433 adding 'deepspeed/runtime/quantize.py' 2023-10-09T18:18:15,434 adding 'deepspeed/runtime/sparse_tensor.py' 2023-10-09T18:18:15,436 adding 'deepspeed/runtime/state_dict_factory.py' 2023-10-09T18:18:15,440 adding 'deepspeed/runtime/utils.py' 2023-10-09T18:18:15,442 adding 'deepspeed/runtime/weight_quantizer.py' 2023-10-09T18:18:15,444 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-10-09T18:18:15,449 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-10-09T18:18:15,450 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-10-09T18:18:15,452 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-10-09T18:18:15,453 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-10-09T18:18:15,455 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-10-09T18:18:15,456 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-10-09T18:18:15,458 adding 'deepspeed/runtime/comm/__init__.py' 2023-10-09T18:18:15,459 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-10-09T18:18:15,461 adding 'deepspeed/runtime/comm/mpi.py' 2023-10-09T18:18:15,462 adding 'deepspeed/runtime/comm/nccl.py' 2023-10-09T18:18:15,464 adding 'deepspeed/runtime/compression/__init__.py' 2023-10-09T18:18:15,465 adding 'deepspeed/runtime/compression/cupy.py' 2023-10-09T18:18:15,467 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-10-09T18:18:15,468 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-10-09T18:18:15,470 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-10-09T18:18:15,471 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-10-09T18:18:15,473 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-10-09T18:18:15,475 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-10-09T18:18:15,476 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-10-09T18:18:15,477 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-10-09T18:18:15,479 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-10-09T18:18:15,480 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-10-09T18:18:15,483 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-10-09T18:18:15,485 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-10-09T18:18:15,488 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-10-09T18:18:15,489 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-10-09T18:18:15,491 adding 'deepspeed/runtime/fp16/__init__.py' 2023-10-09T18:18:15,494 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-10-09T18:18:15,496 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-10-09T18:18:15,498 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-10-09T18:18:15,500 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-10-09T18:18:15,502 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-10-09T18:18:15,505 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-10-09T18:18:15,507 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-10-09T18:18:15,509 adding 'deepspeed/runtime/pipe/__init__.py' 2023-10-09T18:18:15,516 adding 'deepspeed/runtime/pipe/engine.py' 2023-10-09T18:18:15,519 adding 'deepspeed/runtime/pipe/module.py' 2023-10-09T18:18:15,521 adding 'deepspeed/runtime/pipe/p2p.py' 2023-10-09T18:18:15,523 adding 'deepspeed/runtime/pipe/schedule.py' 2023-10-09T18:18:15,526 adding 'deepspeed/runtime/pipe/topology.py' 2023-10-09T18:18:15,527 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-10-09T18:18:15,529 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-10-09T18:18:15,530 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-10-09T18:18:15,531 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-10-09T18:18:15,534 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-10-09T18:18:15,535 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-10-09T18:18:15,538 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-10-09T18:18:15,540 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-10-09T18:18:15,541 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-10-09T18:18:15,543 adding 'deepspeed/runtime/zero/__init__.py' 2023-10-09T18:18:15,545 adding 'deepspeed/runtime/zero/config.py' 2023-10-09T18:18:15,547 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-10-09T18:18:15,549 adding 'deepspeed/runtime/zero/linear.py' 2023-10-09T18:18:15,551 adding 'deepspeed/runtime/zero/mics.py' 2023-10-09T18:18:15,553 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-10-09T18:18:15,555 adding 'deepspeed/runtime/zero/offload_config.py' 2023-10-09T18:18:15,557 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-10-09T18:18:15,568 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-10-09T18:18:15,572 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-10-09T18:18:15,573 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-10-09T18:18:15,587 adding 'deepspeed/runtime/zero/stage3.py' 2023-10-09T18:18:15,600 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-10-09T18:18:15,602 adding 'deepspeed/runtime/zero/test.py' 2023-10-09T18:18:15,604 adding 'deepspeed/runtime/zero/tiling.py' 2023-10-09T18:18:15,606 adding 'deepspeed/runtime/zero/utils.py' 2023-10-09T18:18:15,607 adding 'deepspeed/sequence/__init__.py' 2023-10-09T18:18:15,609 adding 'deepspeed/sequence/layer.py' 2023-10-09T18:18:15,611 adding 'deepspeed/utils/__init__.py' 2023-10-09T18:18:15,613 adding 'deepspeed/utils/comms_logging.py' 2023-10-09T18:18:15,614 adding 'deepspeed/utils/debug.py' 2023-10-09T18:18:15,615 adding 'deepspeed/utils/exceptions.py' 2023-10-09T18:18:15,618 adding 'deepspeed/utils/groups.py' 2023-10-09T18:18:15,619 adding 'deepspeed/utils/init_on_device.py' 2023-10-09T18:18:15,621 adding 'deepspeed/utils/logging.py' 2023-10-09T18:18:15,622 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-10-09T18:18:15,624 adding 'deepspeed/utils/numa.py' 2023-10-09T18:18:15,625 adding 'deepspeed/utils/nvtx.py' 2023-10-09T18:18:15,627 adding 'deepspeed/utils/tensor_fragment.py' 2023-10-09T18:18:15,629 adding 'deepspeed/utils/timer.py' 2023-10-09T18:18:15,630 adding 'deepspeed/utils/types.py' 2023-10-09T18:18:15,633 adding 'deepspeed/utils/zero_to_fp32.py' 2023-10-09T18:18:15,635 adding 'deepspeed-0.11.1.data/scripts/deepspeed' 2023-10-09T18:18:15,636 adding 'deepspeed-0.11.1.data/scripts/deepspeed.pt' 2023-10-09T18:18:15,638 adding 'deepspeed-0.11.1.data/scripts/ds' 2023-10-09T18:18:15,639 adding 'deepspeed-0.11.1.data/scripts/ds_bench' 2023-10-09T18:18:15,640 adding 'deepspeed-0.11.1.data/scripts/ds_elastic' 2023-10-09T18:18:15,641 adding 'deepspeed-0.11.1.data/scripts/ds_report' 2023-10-09T18:18:15,643 adding 'deepspeed-0.11.1.data/scripts/ds_ssh' 2023-10-09T18:18:15,644 adding 'deepspeed-0.11.1.data/scripts/dsr' 2023-10-09T18:18:15,649 adding 'deepspeed-0.11.1.dist-info/METADATA' 2023-10-09T18:18:15,650 adding 'deepspeed-0.11.1.dist-info/WHEEL' 2023-10-09T18:18:15,651 adding 'deepspeed-0.11.1.dist-info/entry_points.txt' 2023-10-09T18:18:15,652 adding 'deepspeed-0.11.1.dist-info/top_level.txt' 2023-10-09T18:18:15,660 adding 'deepspeed-0.11.1.dist-info/RECORD' 2023-10-09T18:18:15,676 removing build/bdist.linux-armv7l/wheel 2023-10-09T18:18:15,817 deepspeed build time = 6.754851341247559 secs 2023-10-09T18:18:15,935 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-10-09T18:18:15,950 Created wheel for deepspeed: filename=deepspeed-0.11.1-py3-none-any.whl size=1047079 sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba 2023-10-09T18:18:15,951 Stored in directory: /tmp/pip-ephem-wheel-cache-n0z99aq1/wheels/cd/39/97/850a533fcbc4825db4dcbbec257577c09d1d711029de83a82c 2023-10-09T18:18:15,982 Successfully built deepspeed 2023-10-09T18:18:16,012 Removed build tracker: '/tmp/pip-build-tracker-u68yckz5'