2023-09-28T07:13:38,181 Created temporary directory: /tmp/pip-build-tracker-snphqkq7 2023-09-28T07:13:38,182 Initialized build tracking at /tmp/pip-build-tracker-snphqkq7 2023-09-28T07:13:38,183 Created build tracker: /tmp/pip-build-tracker-snphqkq7 2023-09-28T07:13:38,183 Entered build tracker: /tmp/pip-build-tracker-snphqkq7 2023-09-28T07:13:38,184 Created temporary directory: /tmp/pip-wheel-l753zh7n 2023-09-28T07:13:38,187 Created temporary directory: /tmp/pip-ephem-wheel-cache-siu0_dak 2023-09-28T07:13:38,211 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-09-28T07:13:38,215 2 location(s) to search for versions of deepspeed: 2023-09-28T07:13:38,215 * https://pypi.org/simple/deepspeed/ 2023-09-28T07:13:38,215 * https://www.piwheels.org/simple/deepspeed/ 2023-09-28T07:13:38,216 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-09-28T07:13:38,217 Getting page https://pypi.org/simple/deepspeed/ 2023-09-28T07:13:38,218 Found index url https://pypi.org/simple/ 2023-09-28T07:13:38,436 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-09-28T07:13:38,449 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-09-28T07:13:38,450 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-09-28T07:13:38,451 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-09-28T07:13:38,451 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-09-28T07:13:38,452 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-09-28T07:13:38,453 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-09-28T07:13:38,454 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-09-28T07:13:38,454 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-09-28T07:13:38,455 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-09-28T07:13:38,456 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-09-28T07:13:38,457 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-09-28T07:13:38,457 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-09-28T07:13:38,458 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-09-28T07:13:38,459 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-09-28T07:13:38,460 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-09-28T07:13:38,460 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-09-28T07:13:38,461 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-09-28T07:13:38,461 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-09-28T07:13:38,462 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-09-28T07:13:38,463 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-09-28T07:13:38,463 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-09-28T07:13:38,464 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-09-28T07:13:38,465 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-09-28T07:13:38,465 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-09-28T07:13:38,466 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-09-28T07:13:38,467 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-09-28T07:13:38,468 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-09-28T07:13:38,469 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-09-28T07:13:38,469 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-09-28T07:13:38,470 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-09-28T07:13:38,471 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-09-28T07:13:38,472 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-09-28T07:13:38,472 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-09-28T07:13:38,473 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-09-28T07:13:38,473 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-09-28T07:13:38,474 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-09-28T07:13:38,475 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-09-28T07:13:38,475 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-09-28T07:13:38,476 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-09-28T07:13:38,476 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-09-28T07:13:38,477 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-09-28T07:13:38,478 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-09-28T07:13:38,479 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-09-28T07:13:38,479 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-09-28T07:13:38,480 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-09-28T07:13:38,481 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-09-28T07:13:38,481 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-09-28T07:13:38,482 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-09-28T07:13:38,483 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-09-28T07:13:38,484 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-09-28T07:13:38,485 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-09-28T07:13:38,486 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-09-28T07:13:38,486 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-09-28T07:13:38,487 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-09-28T07:13:38,487 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-09-28T07:13:38,488 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-09-28T07:13:38,488 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-09-28T07:13:38,489 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-09-28T07:13:38,490 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-09-28T07:13:38,491 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-09-28T07:13:38,491 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-09-28T07:13:38,492 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-09-28T07:13:38,493 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-09-28T07:13:38,493 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-09-28T07:13:38,494 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-09-28T07:13:38,495 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-09-28T07:13:38,496 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-09-28T07:13:38,496 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-09-28T07:13:38,497 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-09-28T07:13:38,498 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-09-28T07:13:38,499 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-09-28T07:13:38,499 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-09-28T07:13:38,500 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-09-28T07:13:38,500 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-09-28T07:13:38,501 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-09-28T07:13:38,502 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-09-28T07:13:38,503 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-09-28T07:13:38,504 Found index url https://www.piwheels.org/simple/ 2023-09-28T07:13:38,671 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-09-28T07:13:38,683 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,684 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,685 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,685 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,686 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,687 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,688 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,689 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,690 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,691 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,692 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,692 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,693 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,694 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,694 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,695 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,695 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,696 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,697 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,698 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,698 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,698 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,699 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,699 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,700 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,700 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,701 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,701 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,702 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,703 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,703 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,704 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,704 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,705 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,706 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,706 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,707 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,707 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,709 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-09-28T07:13:38,710 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-09-28T07:13:38,710 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-09-28T07:13:38,736 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-09-28T07:13:38,755 Collecting deepspeed==0.10.3 2023-09-28T07:13:38,757 Created temporary directory: /tmp/pip-unpack-6rkuk4lj 2023-09-28T07:13:38,895 Downloading deepspeed-0.10.3.tar.gz (867 kB) 2023-09-28T07:13:40,229 Added deepspeed==0.10.3 from https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz to build tracker '/tmp/pip-build-tracker-snphqkq7' 2023-09-28T07:13:40,231 Running setup.py (path:/tmp/pip-wheel-l753zh7n/deepspeed_222df7d1ba3a4a80afb8227de419eaca/setup.py) egg_info for package deepspeed 2023-09-28T07:13:40,232 Created temporary directory: /tmp/pip-pip-egg-info-04ui6vxw 2023-09-28T07:13:40,232 Preparing metadata (setup.py): started 2023-09-28T07:13:40,234 Running command python setup.py egg_info 2023-09-28T07:13:41,021 fatal: not a git repository (or any of the parent directories): .git 2023-09-28T07:13:41,653 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-09-28T07:13:41,654  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-09-28T07:13:41,654 DS_BUILD_OPS=0 2023-09-28T07:13:41,655  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-09-28T07:13:41,655  [WARNING]  async_io: please install the libaio-dev package with apt 2023-09-28T07:13:41,656  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-09-28T07:13:41,656  [WARNING]  unable to import torch, please install it first 2023-09-28T07:13:41,657  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-09-28T07:13:41,657  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-09-28T07:13:41,658 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-09-28T07:13:41,658 version=0.10.3, git_hash=unknown, git_branch=unknown 2023-09-28T07:13:41,658 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-09-28T07:13:41,659 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-09-28T07:13:41,659 ext_modules=[] 2023-09-28T07:13:41,660 running egg_info 2023-09-28T07:13:41,660 creating /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info 2023-09-28T07:13:41,679 writing /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/PKG-INFO 2023-09-28T07:13:41,709 writing dependency_links to /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/dependency_links.txt 2023-09-28T07:13:41,711 writing entry points to /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/entry_points.txt 2023-09-28T07:13:41,725 writing requirements to /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/requires.txt 2023-09-28T07:13:41,727 writing top-level names to /tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/top_level.txt 2023-09-28T07:13:41,728 writing manifest file '/tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/SOURCES.txt' 2023-09-28T07:13:41,860 reading manifest file '/tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/SOURCES.txt' 2023-09-28T07:13:41,861 reading manifest template 'MANIFEST.in' 2023-09-28T07:13:42,456 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-09-28T07:13:42,932 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-09-28T07:13:43,231 warning: no files found matching '*.tr' under directory 'csrc' 2023-09-28T07:13:43,308 warning: no files found matching '*.cc' under directory 'csrc' 2023-09-28T07:13:43,326 warning: no files found matching '*.py' under directory 'benchmarks' 2023-09-28T07:13:43,331 adding license file 'LICENSE' 2023-09-28T07:13:43,350 writing manifest file '/tmp/pip-pip-egg-info-04ui6vxw/deepspeed.egg-info/SOURCES.txt' 2023-09-28T07:13:43,352 deepspeed build time = 2.3278470039367676 secs 2023-09-28T07:13:43,467 Preparing metadata (setup.py): finished with status 'done' 2023-09-28T07:13:43,473 Source in /tmp/pip-wheel-l753zh7n/deepspeed_222df7d1ba3a4a80afb8227de419eaca has version 0.10.3, which satisfies requirement deepspeed==0.10.3 from https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz 2023-09-28T07:13:43,474 Removed deepspeed==0.10.3 from https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz from build tracker '/tmp/pip-build-tracker-snphqkq7' 2023-09-28T07:13:43,483 Created temporary directory: /tmp/pip-unpack-u979307o 2023-09-28T07:13:43,484 Created temporary directory: /tmp/pip-unpack-_pe0k0qi 2023-09-28T07:13:43,721 Building wheels for collected packages: deepspeed 2023-09-28T07:13:43,727 Created temporary directory: /tmp/pip-wheel-5o0qm8x3 2023-09-28T07:13:43,727 Building wheel for deepspeed (setup.py): started 2023-09-28T07:13:43,729 Destination directory: /tmp/pip-wheel-5o0qm8x3 2023-09-28T07:13:43,730 Running command python setup.py bdist_wheel 2023-09-28T07:13:44,166 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-09-28T07:13:44,174  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-09-28T07:13:44,216 DS_BUILD_OPS=0 2023-09-28T07:13:44,327  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-09-28T07:13:44,385  [WARNING]  async_io: please install the libaio-dev package with apt 2023-09-28T07:13:44,385  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-09-28T07:13:44,386  [WARNING]  unable to import torch, please install it first 2023-09-28T07:13:44,386  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-09-28T07:13:44,387  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-09-28T07:13:44,387 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-09-28T07:13:44,396 fatal: not a git repository (or any of the parent directories): .git 2023-09-28T07:13:44,398 version=0.10.3, git_hash=unknown, git_branch=unknown 2023-09-28T07:13:44,399 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-09-28T07:13:44,399 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-09-28T07:13:44,400 ext_modules=[] 2023-09-28T07:13:44,995 running bdist_wheel 2023-09-28T07:13:45,088 running build 2023-09-28T07:13:45,089 running build_py 2023-09-28T07:13:45,115 creating build 2023-09-28T07:13:45,116 creating build/lib 2023-09-28T07:13:45,116 creating build/lib/deepspeed 2023-09-28T07:13:45,118 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-09-28T07:13:45,120 copying deepspeed/constants.py -> build/lib/deepspeed 2023-09-28T07:13:45,122 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-09-28T07:13:45,123 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-09-28T07:13:45,125 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-09-28T07:13:45,127 creating build/lib/deepspeed/ops 2023-09-28T07:13:45,128 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-09-28T07:13:45,131 creating build/lib/deepspeed/accelerator 2023-09-28T07:13:45,132 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,134 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,136 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,138 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,140 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,142 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,144 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-09-28T07:13:45,146 creating build/lib/deepspeed/autotuning 2023-09-28T07:13:45,147 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,149 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,151 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,153 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,155 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,158 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-09-28T07:13:45,160 creating build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,161 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,163 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,165 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,166 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,168 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,170 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,172 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,174 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,176 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-09-28T07:13:45,178 creating build/lib/deepspeed/module_inject 2023-09-28T07:13:45,179 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,181 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,183 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,185 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,187 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,190 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,192 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,194 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,195 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,197 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,199 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,201 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-09-28T07:13:45,203 creating build/lib/deepspeed/sequence 2023-09-28T07:13:45,204 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-09-28T07:13:45,206 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-09-28T07:13:45,208 creating build/lib/deepspeed/launcher 2023-09-28T07:13:45,209 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-09-28T07:13:45,211 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-09-28T07:13:45,213 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-09-28T07:13:45,215 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-09-28T07:13:45,217 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-09-28T07:13:45,220 creating build/lib/deepspeed/pipe 2023-09-28T07:13:45,221 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-09-28T07:13:45,223 creating build/lib/deepspeed/inference 2023-09-28T07:13:45,224 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-09-28T07:13:45,226 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-09-28T07:13:45,227 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-09-28T07:13:45,230 creating build/lib/deepspeed/nebula 2023-09-28T07:13:45,231 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-09-28T07:13:45,233 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-09-28T07:13:45,234 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-09-28T07:13:45,236 creating build/lib/deepspeed/comm 2023-09-28T07:13:45,237 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,240 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,241 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,243 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,244 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,247 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,248 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,250 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,251 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-09-28T07:13:45,254 creating build/lib/deepspeed/runtime 2023-09-28T07:13:45,255 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,259 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,261 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,263 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,266 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,268 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,271 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,273 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,274 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,276 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,278 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,281 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,283 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,285 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,287 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,290 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-09-28T07:13:45,293 creating build/lib/deepspeed/utils 2023-09-28T07:13:45,294 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,297 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,298 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,300 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,302 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,304 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,306 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,308 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,310 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,312 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,314 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,316 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,318 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,319 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-09-28T07:13:45,321 creating build/lib/deepspeed/model_implementations 2023-09-28T07:13:45,322 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-09-28T07:13:45,324 creating build/lib/deepspeed/elasticity 2023-09-28T07:13:45,325 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,327 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,329 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,330 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,332 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,334 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-09-28T07:13:45,337 creating build/lib/deepspeed/moe 2023-09-28T07:13:45,337 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,339 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,341 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,343 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,345 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,347 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-09-28T07:13:45,350 creating build/lib/deepspeed/monitor 2023-09-28T07:13:45,351 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,352 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,354 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,356 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,357 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,359 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,361 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-09-28T07:13:45,363 creating build/lib/deepspeed/profiling 2023-09-28T07:13:45,364 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-09-28T07:13:45,366 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-09-28T07:13:45,367 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-09-28T07:13:45,370 creating build/lib/deepspeed/compression 2023-09-28T07:13:45,371 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,373 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,375 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,378 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,379 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,382 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,384 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,386 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-09-28T07:13:45,389 creating build/lib/deepspeed/ops/quantizer 2023-09-28T07:13:45,390 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-09-28T07:13:45,392 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-09-28T07:13:45,394 creating build/lib/deepspeed/ops/transformer 2023-09-28T07:13:45,394 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-09-28T07:13:45,397 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-09-28T07:13:45,399 creating build/lib/deepspeed/ops/adam 2023-09-28T07:13:45,400 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-09-28T07:13:45,402 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-09-28T07:13:45,404 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-09-28T07:13:45,405 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-09-28T07:13:45,407 creating build/lib/deepspeed/ops/lamb 2023-09-28T07:13:45,408 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-09-28T07:13:45,410 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-09-28T07:13:45,413 creating build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,414 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,415 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,417 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,418 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,420 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,422 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,423 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,425 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,427 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,428 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,430 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,432 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,433 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,436 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,437 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-09-28T07:13:45,440 creating build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,440 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,442 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,445 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,447 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,449 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,451 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,453 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-09-28T07:13:45,456 creating build/lib/deepspeed/ops/aio 2023-09-28T07:13:45,457 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-09-28T07:13:45,459 creating build/lib/deepspeed/ops/adagrad 2023-09-28T07:13:45,460 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-09-28T07:13:45,462 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-09-28T07:13:45,464 creating build/lib/deepspeed/ops/random_ltd 2023-09-28T07:13:45,465 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-09-28T07:13:45,467 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-09-28T07:13:45,469 creating build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,470 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,472 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,474 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,476 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,477 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,479 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,481 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,484 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,486 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,488 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-09-28T07:13:45,490 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,491 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,493 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,494 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,496 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,498 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,499 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,501 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,503 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,504 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,506 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:45,509 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,510 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,512 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,514 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,516 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,517 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,519 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,521 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,523 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,525 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,527 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:45,529 creating build/lib/deepspeed/ops/op_builder/npu 2023-09-28T07:13:45,530 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-09-28T07:13:45,532 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-09-28T07:13:45,533 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-09-28T07:13:45,535 creating build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,536 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,538 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,539 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,541 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,543 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,544 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:45,547 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:45,547 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:45,550 creating build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,551 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,552 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,554 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,556 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,558 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,559 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-09-28T07:13:45,562 creating build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,563 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,565 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,567 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,569 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,571 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,573 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,575 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,577 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,579 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,580 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,582 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,584 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,586 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,588 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,590 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,592 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,594 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-09-28T07:13:45,596 creating build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,597 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,599 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,601 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,603 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,605 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,607 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,608 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-09-28T07:13:45,611 creating build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,611 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,614 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,615 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,617 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,619 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-09-28T07:13:45,622 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:45,623 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:45,624 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:45,626 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:45,629 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:45,630 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:45,632 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:45,634 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:45,635 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:45,638 creating build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,638 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,641 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,643 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,645 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,647 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,649 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-09-28T07:13:45,652 creating build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,653 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,656 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,658 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,660 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,661 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,663 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,665 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,667 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,669 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,672 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,674 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,678 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,681 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,683 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,685 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,689 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-09-28T07:13:45,691 creating build/lib/deepspeed/runtime/data_pipeline 2023-09-28T07:13:45,692 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-09-28T07:13:45,694 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-09-28T07:13:45,696 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-09-28T07:13:45,698 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-09-28T07:13:45,700 creating build/lib/deepspeed/runtime/comm 2023-09-28T07:13:45,701 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-09-28T07:13:45,704 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-09-28T07:13:45,705 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-09-28T07:13:45,707 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-09-28T07:13:45,710 creating build/lib/deepspeed/runtime/fp16 2023-09-28T07:13:45,711 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-09-28T07:13:45,714 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-09-28T07:13:45,715 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-09-28T07:13:45,717 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-09-28T07:13:45,720 creating build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,721 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,723 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,726 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,727 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,729 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,730 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,732 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,734 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,736 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-09-28T07:13:45,739 creating build/lib/deepspeed/runtime/compression 2023-09-28T07:13:45,740 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-09-28T07:13:45,742 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-09-28T07:13:45,744 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,744 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,747 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,748 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,750 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,752 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:45,754 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,755 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,758 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,760 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,762 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,764 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:45,767 creating build/lib/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:45,767 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:45,770 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:45,771 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:45,774 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:45,777 creating build/lib/deepspeed/model_implementations/diffusers 2023-09-28T07:13:45,778 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-09-28T07:13:45,780 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-09-28T07:13:45,782 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-09-28T07:13:45,784 creating build/lib/deepspeed/model_implementations/features 2023-09-28T07:13:45,785 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-09-28T07:13:45,786 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-09-28T07:13:45,788 creating build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,789 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,791 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,793 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,794 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,796 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,797 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,799 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,801 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,803 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-09-28T07:13:45,805 creating build/lib/deepspeed/profiling/flops_profiler 2023-09-28T07:13:45,806 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-09-28T07:13:45,808 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-09-28T07:13:45,811 running egg_info 2023-09-28T07:13:45,860 writing deepspeed.egg-info/PKG-INFO 2023-09-28T07:13:45,890 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-09-28T07:13:45,892 writing entry points to deepspeed.egg-info/entry_points.txt 2023-09-28T07:13:45,906 writing requirements to deepspeed.egg-info/requires.txt 2023-09-28T07:13:45,908 writing top-level names to deepspeed.egg-info/top_level.txt 2023-09-28T07:13:45,986 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-09-28T07:13:46,017 reading manifest template 'MANIFEST.in' 2023-09-28T07:13:46,604 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-09-28T07:13:47,078 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-09-28T07:13:47,357 warning: no files found matching '*.tr' under directory 'csrc' 2023-09-28T07:13:47,421 warning: no files found matching '*.cc' under directory 'csrc' 2023-09-28T07:13:47,437 warning: no files found matching '*.py' under directory 'benchmarks' 2023-09-28T07:13:47,442 adding license file 'LICENSE' 2023-09-28T07:13:47,466 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-09-28T07:13:47,472 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-09-28T07:13:47,473 !! 2023-09-28T07:13:47,474 ******************************************************************************** 2023-09-28T07:13:47,474 ############################ 2023-09-28T07:13:47,474 # Package would be ignored # 2023-09-28T07:13:47,475 ############################ 2023-09-28T07:13:47,475 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-09-28T07:13:47,476 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,477 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,477 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-09-28T07:13:47,477 to the `packages` configuration field. 2023-09-28T07:13:47,478 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,478 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,479 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,480 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,481 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,481 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-09-28T07:13:47,482 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-09-28T07:13:47,482 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,483 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,484 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,485 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,486 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,488 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,489 even if it does not contain any `.py` files. 2023-09-28T07:13:47,489 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,490 directory, all directories are treated like packages. 2023-09-28T07:13:47,491 ******************************************************************************** 2023-09-28T07:13:47,492 !! 2023-09-28T07:13:47,493 check.warn(importable) 2023-09-28T07:13:47,493 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-09-28T07:13:47,494 !! 2023-09-28T07:13:47,495 ******************************************************************************** 2023-09-28T07:13:47,496 ############################ 2023-09-28T07:13:47,496 # Package would be ignored # 2023-09-28T07:13:47,497 ############################ 2023-09-28T07:13:47,497 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-09-28T07:13:47,498 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,499 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,499 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-09-28T07:13:47,500 to the `packages` configuration field. 2023-09-28T07:13:47,501 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,501 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,502 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,503 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,505 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-09-28T07:13:47,505 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-09-28T07:13:47,506 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,506 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,507 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,507 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,508 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,509 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,510 even if it does not contain any `.py` files. 2023-09-28T07:13:47,510 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,510 directory, all directories are treated like packages. 2023-09-28T07:13:47,511 ******************************************************************************** 2023-09-28T07:13:47,512 !! 2023-09-28T07:13:47,512 check.warn(importable) 2023-09-28T07:13:47,513 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-09-28T07:13:47,513 !! 2023-09-28T07:13:47,514 ******************************************************************************** 2023-09-28T07:13:47,514 ############################ 2023-09-28T07:13:47,515 # Package would be ignored # 2023-09-28T07:13:47,515 ############################ 2023-09-28T07:13:47,516 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-09-28T07:13:47,516 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,517 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,518 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-09-28T07:13:47,518 to the `packages` configuration field. 2023-09-28T07:13:47,519 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,520 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,520 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,521 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,522 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,523 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-09-28T07:13:47,524 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-09-28T07:13:47,524 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,525 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,525 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,526 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,527 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,529 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,529 even if it does not contain any `.py` files. 2023-09-28T07:13:47,530 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,531 directory, all directories are treated like packages. 2023-09-28T07:13:47,531 ******************************************************************************** 2023-09-28T07:13:47,532 !! 2023-09-28T07:13:47,532 check.warn(importable) 2023-09-28T07:13:47,533 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-09-28T07:13:47,533 !! 2023-09-28T07:13:47,534 ******************************************************************************** 2023-09-28T07:13:47,534 ############################ 2023-09-28T07:13:47,535 # Package would be ignored # 2023-09-28T07:13:47,535 ############################ 2023-09-28T07:13:47,536 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-09-28T07:13:47,536 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,537 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,537 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-09-28T07:13:47,537 to the `packages` configuration field. 2023-09-28T07:13:47,538 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,539 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,539 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,540 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,541 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,542 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-09-28T07:13:47,542 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-09-28T07:13:47,543 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,543 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,544 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,545 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,546 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,547 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,548 even if it does not contain any `.py` files. 2023-09-28T07:13:47,548 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,549 directory, all directories are treated like packages. 2023-09-28T07:13:47,549 ******************************************************************************** 2023-09-28T07:13:47,550 !! 2023-09-28T07:13:47,551 check.warn(importable) 2023-09-28T07:13:47,551 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-09-28T07:13:47,552 !! 2023-09-28T07:13:47,553 ******************************************************************************** 2023-09-28T07:13:47,554 ############################ 2023-09-28T07:13:47,554 # Package would be ignored # 2023-09-28T07:13:47,555 ############################ 2023-09-28T07:13:47,555 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-09-28T07:13:47,556 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,557 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,557 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-09-28T07:13:47,558 to the `packages` configuration field. 2023-09-28T07:13:47,559 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,559 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,560 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,560 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,561 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,561 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-09-28T07:13:47,562 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-09-28T07:13:47,562 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,563 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,563 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,564 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,564 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,565 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,566 even if it does not contain any `.py` files. 2023-09-28T07:13:47,566 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,567 directory, all directories are treated like packages. 2023-09-28T07:13:47,567 ******************************************************************************** 2023-09-28T07:13:47,568 !! 2023-09-28T07:13:47,569 check.warn(importable) 2023-09-28T07:13:47,569 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-09-28T07:13:47,570 !! 2023-09-28T07:13:47,571 ******************************************************************************** 2023-09-28T07:13:47,571 ############################ 2023-09-28T07:13:47,572 # Package would be ignored # 2023-09-28T07:13:47,572 ############################ 2023-09-28T07:13:47,573 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-09-28T07:13:47,573 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,574 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,575 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-09-28T07:13:47,575 to the `packages` configuration field. 2023-09-28T07:13:47,576 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,576 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,577 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,578 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,579 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,580 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-09-28T07:13:47,580 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-09-28T07:13:47,581 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,581 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,582 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,583 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,584 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,586 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,586 even if it does not contain any `.py` files. 2023-09-28T07:13:47,586 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,587 directory, all directories are treated like packages. 2023-09-28T07:13:47,587 ******************************************************************************** 2023-09-28T07:13:47,588 !! 2023-09-28T07:13:47,588 check.warn(importable) 2023-09-28T07:13:47,589 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-09-28T07:13:47,589 !! 2023-09-28T07:13:47,590 ******************************************************************************** 2023-09-28T07:13:47,590 ############################ 2023-09-28T07:13:47,591 # Package would be ignored # 2023-09-28T07:13:47,591 ############################ 2023-09-28T07:13:47,592 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-09-28T07:13:47,592 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,593 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,594 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-09-28T07:13:47,594 to the `packages` configuration field. 2023-09-28T07:13:47,595 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,595 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,596 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,597 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,598 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,599 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-09-28T07:13:47,599 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-09-28T07:13:47,600 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,600 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,601 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,602 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,602 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,604 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,605 even if it does not contain any `.py` files. 2023-09-28T07:13:47,605 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,606 directory, all directories are treated like packages. 2023-09-28T07:13:47,606 ******************************************************************************** 2023-09-28T07:13:47,607 !! 2023-09-28T07:13:47,607 check.warn(importable) 2023-09-28T07:13:47,608 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-09-28T07:13:47,608 !! 2023-09-28T07:13:47,610 ******************************************************************************** 2023-09-28T07:13:47,610 ############################ 2023-09-28T07:13:47,610 # Package would be ignored # 2023-09-28T07:13:47,611 ############################ 2023-09-28T07:13:47,612 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-09-28T07:13:47,613 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,613 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,614 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-09-28T07:13:47,614 to the `packages` configuration field. 2023-09-28T07:13:47,615 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,615 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,616 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,617 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,617 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,618 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-09-28T07:13:47,619 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-09-28T07:13:47,619 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,620 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,620 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,621 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,622 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,623 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,624 even if it does not contain any `.py` files. 2023-09-28T07:13:47,624 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,624 directory, all directories are treated like packages. 2023-09-28T07:13:47,625 ******************************************************************************** 2023-09-28T07:13:47,626 !! 2023-09-28T07:13:47,626 check.warn(importable) 2023-09-28T07:13:47,627 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-09-28T07:13:47,627 !! 2023-09-28T07:13:47,628 ******************************************************************************** 2023-09-28T07:13:47,629 ############################ 2023-09-28T07:13:47,629 # Package would be ignored # 2023-09-28T07:13:47,630 ############################ 2023-09-28T07:13:47,630 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-09-28T07:13:47,631 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,632 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,632 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-09-28T07:13:47,633 to the `packages` configuration field. 2023-09-28T07:13:47,634 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,634 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,635 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,636 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,637 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,638 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-09-28T07:13:47,638 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-09-28T07:13:47,639 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,639 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,640 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,640 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,641 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,643 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,643 even if it does not contain any `.py` files. 2023-09-28T07:13:47,643 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,644 directory, all directories are treated like packages. 2023-09-28T07:13:47,644 ******************************************************************************** 2023-09-28T07:13:47,645 !! 2023-09-28T07:13:47,646 check.warn(importable) 2023-09-28T07:13:47,646 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-09-28T07:13:47,646 !! 2023-09-28T07:13:47,647 ******************************************************************************** 2023-09-28T07:13:47,648 ############################ 2023-09-28T07:13:47,648 # Package would be ignored # 2023-09-28T07:13:47,649 ############################ 2023-09-28T07:13:47,649 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-09-28T07:13:47,650 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,650 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,651 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-09-28T07:13:47,651 to the `packages` configuration field. 2023-09-28T07:13:47,652 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,653 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,654 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,655 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,656 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,657 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-09-28T07:13:47,657 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-09-28T07:13:47,658 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,658 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,658 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,659 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,660 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,662 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,662 even if it does not contain any `.py` files. 2023-09-28T07:13:47,663 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,664 directory, all directories are treated like packages. 2023-09-28T07:13:47,664 ******************************************************************************** 2023-09-28T07:13:47,665 !! 2023-09-28T07:13:47,666 check.warn(importable) 2023-09-28T07:13:47,666 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-09-28T07:13:47,667 !! 2023-09-28T07:13:47,668 ******************************************************************************** 2023-09-28T07:13:47,668 ############################ 2023-09-28T07:13:47,669 # Package would be ignored # 2023-09-28T07:13:47,669 ############################ 2023-09-28T07:13:47,669 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-09-28T07:13:47,670 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,671 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,671 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-09-28T07:13:47,671 to the `packages` configuration field. 2023-09-28T07:13:47,672 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,673 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,673 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,674 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,675 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,676 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-09-28T07:13:47,676 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-09-28T07:13:47,677 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,677 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,678 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,678 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,679 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,681 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,681 even if it does not contain any `.py` files. 2023-09-28T07:13:47,682 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,682 directory, all directories are treated like packages. 2023-09-28T07:13:47,683 ******************************************************************************** 2023-09-28T07:13:47,684 !! 2023-09-28T07:13:47,684 check.warn(importable) 2023-09-28T07:13:47,685 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-09-28T07:13:47,685 !! 2023-09-28T07:13:47,686 ******************************************************************************** 2023-09-28T07:13:47,687 ############################ 2023-09-28T07:13:47,687 # Package would be ignored # 2023-09-28T07:13:47,688 ############################ 2023-09-28T07:13:47,688 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-09-28T07:13:47,689 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,690 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,690 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-09-28T07:13:47,691 to the `packages` configuration field. 2023-09-28T07:13:47,692 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,692 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,693 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,694 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,695 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,695 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-09-28T07:13:47,696 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-09-28T07:13:47,696 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,697 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,697 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,698 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,699 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,700 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,700 even if it does not contain any `.py` files. 2023-09-28T07:13:47,701 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,701 directory, all directories are treated like packages. 2023-09-28T07:13:47,702 ******************************************************************************** 2023-09-28T07:13:47,703 !! 2023-09-28T07:13:47,703 check.warn(importable) 2023-09-28T07:13:47,703 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-09-28T07:13:47,704 !! 2023-09-28T07:13:47,705 ******************************************************************************** 2023-09-28T07:13:47,705 ############################ 2023-09-28T07:13:47,706 # Package would be ignored # 2023-09-28T07:13:47,706 ############################ 2023-09-28T07:13:47,707 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-09-28T07:13:47,707 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,708 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,709 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-09-28T07:13:47,709 to the `packages` configuration field. 2023-09-28T07:13:47,710 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,710 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,711 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,712 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,713 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,714 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-09-28T07:13:47,714 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-09-28T07:13:47,715 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,715 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,716 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,717 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,718 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,719 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,720 even if it does not contain any `.py` files. 2023-09-28T07:13:47,720 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,721 directory, all directories are treated like packages. 2023-09-28T07:13:47,721 ******************************************************************************** 2023-09-28T07:13:47,722 !! 2023-09-28T07:13:47,723 check.warn(importable) 2023-09-28T07:13:47,723 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-09-28T07:13:47,723 !! 2023-09-28T07:13:47,724 ******************************************************************************** 2023-09-28T07:13:47,725 ############################ 2023-09-28T07:13:47,725 # Package would be ignored # 2023-09-28T07:13:47,725 ############################ 2023-09-28T07:13:47,726 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-09-28T07:13:47,726 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,727 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,728 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-09-28T07:13:47,728 to the `packages` configuration field. 2023-09-28T07:13:47,729 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,730 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,730 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,731 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,732 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,733 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-09-28T07:13:47,733 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-09-28T07:13:47,734 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,734 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,735 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,736 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,737 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,738 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,739 even if it does not contain any `.py` files. 2023-09-28T07:13:47,739 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,740 directory, all directories are treated like packages. 2023-09-28T07:13:47,740 ******************************************************************************** 2023-09-28T07:13:47,741 !! 2023-09-28T07:13:47,742 check.warn(importable) 2023-09-28T07:13:47,743 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-09-28T07:13:47,743 !! 2023-09-28T07:13:47,744 ******************************************************************************** 2023-09-28T07:13:47,745 ############################ 2023-09-28T07:13:47,745 # Package would be ignored # 2023-09-28T07:13:47,746 ############################ 2023-09-28T07:13:47,746 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-09-28T07:13:47,747 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,748 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,749 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-09-28T07:13:47,749 to the `packages` configuration field. 2023-09-28T07:13:47,750 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,751 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,752 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,753 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,753 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,754 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-09-28T07:13:47,755 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-09-28T07:13:47,755 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,756 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,756 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,757 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,758 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,759 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,760 even if it does not contain any `.py` files. 2023-09-28T07:13:47,760 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,761 directory, all directories are treated like packages. 2023-09-28T07:13:47,761 ******************************************************************************** 2023-09-28T07:13:47,762 !! 2023-09-28T07:13:47,763 check.warn(importable) 2023-09-28T07:13:47,763 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-09-28T07:13:47,763 !! 2023-09-28T07:13:47,764 ******************************************************************************** 2023-09-28T07:13:47,765 ############################ 2023-09-28T07:13:47,765 # Package would be ignored # 2023-09-28T07:13:47,766 ############################ 2023-09-28T07:13:47,766 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-09-28T07:13:47,767 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,768 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,768 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-09-28T07:13:47,769 to the `packages` configuration field. 2023-09-28T07:13:47,770 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,770 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,771 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,772 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,773 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,774 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-09-28T07:13:47,774 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-09-28T07:13:47,774 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,775 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,776 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,777 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,777 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,778 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,779 even if it does not contain any `.py` files. 2023-09-28T07:13:47,779 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,780 directory, all directories are treated like packages. 2023-09-28T07:13:47,780 ******************************************************************************** 2023-09-28T07:13:47,781 !! 2023-09-28T07:13:47,782 check.warn(importable) 2023-09-28T07:13:47,782 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-09-28T07:13:47,783 !! 2023-09-28T07:13:47,783 ******************************************************************************** 2023-09-28T07:13:47,784 ############################ 2023-09-28T07:13:47,784 # Package would be ignored # 2023-09-28T07:13:47,785 ############################ 2023-09-28T07:13:47,785 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-09-28T07:13:47,786 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,787 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,787 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-09-28T07:13:47,788 to the `packages` configuration field. 2023-09-28T07:13:47,789 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,789 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,790 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,791 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,791 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,793 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-09-28T07:13:47,793 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-09-28T07:13:47,794 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,794 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,795 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,796 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,797 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,798 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,799 even if it does not contain any `.py` files. 2023-09-28T07:13:47,799 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,799 directory, all directories are treated like packages. 2023-09-28T07:13:47,800 ******************************************************************************** 2023-09-28T07:13:47,801 !! 2023-09-28T07:13:47,802 check.warn(importable) 2023-09-28T07:13:47,802 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-09-28T07:13:47,803 !! 2023-09-28T07:13:47,804 ******************************************************************************** 2023-09-28T07:13:47,804 ############################ 2023-09-28T07:13:47,805 # Package would be ignored # 2023-09-28T07:13:47,805 ############################ 2023-09-28T07:13:47,805 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-09-28T07:13:47,806 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,807 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,807 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-09-28T07:13:47,808 to the `packages` configuration field. 2023-09-28T07:13:47,808 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,809 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,809 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,810 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,811 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,812 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-09-28T07:13:47,812 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-09-28T07:13:47,812 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,813 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,813 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,814 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,815 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,816 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,817 even if it does not contain any `.py` files. 2023-09-28T07:13:47,817 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,818 directory, all directories are treated like packages. 2023-09-28T07:13:47,818 ******************************************************************************** 2023-09-28T07:13:47,819 !! 2023-09-28T07:13:47,820 check.warn(importable) 2023-09-28T07:13:47,820 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-09-28T07:13:47,821 !! 2023-09-28T07:13:47,822 ******************************************************************************** 2023-09-28T07:13:47,822 ############################ 2023-09-28T07:13:47,823 # Package would be ignored # 2023-09-28T07:13:47,823 ############################ 2023-09-28T07:13:47,824 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-09-28T07:13:47,824 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,825 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,826 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-09-28T07:13:47,826 to the `packages` configuration field. 2023-09-28T07:13:47,827 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,828 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,829 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,830 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,831 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,832 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-09-28T07:13:47,832 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-09-28T07:13:47,833 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,833 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,834 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,834 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,835 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,837 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,837 even if it does not contain any `.py` files. 2023-09-28T07:13:47,837 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,838 directory, all directories are treated like packages. 2023-09-28T07:13:47,838 ******************************************************************************** 2023-09-28T07:13:47,839 !! 2023-09-28T07:13:47,840 check.warn(importable) 2023-09-28T07:13:47,840 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-09-28T07:13:47,840 !! 2023-09-28T07:13:47,841 ******************************************************************************** 2023-09-28T07:13:47,842 ############################ 2023-09-28T07:13:47,842 # Package would be ignored # 2023-09-28T07:13:47,843 ############################ 2023-09-28T07:13:47,843 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-09-28T07:13:47,844 but it is absent from setuptools' `packages` configuration. 2023-09-28T07:13:47,845 This leads to an ambiguous overall configuration. If you want to distribute this 2023-09-28T07:13:47,845 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-09-28T07:13:47,846 to the `packages` configuration field. 2023-09-28T07:13:47,847 Alternatively, you can also rely on setuptools' discovery methods 2023-09-28T07:13:47,848 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-09-28T07:13:47,848 instead of `find_packages(...)`/`find:`). 2023-09-28T07:13:47,849 You can read more about "package discovery" on setuptools documentation page: 2023-09-28T07:13:47,850 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-09-28T07:13:47,851 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-09-28T07:13:47,851 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-09-28T07:13:47,852 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-09-28T07:13:47,853 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-09-28T07:13:47,853 combination with a more fine grained `package-data` configuration. 2023-09-28T07:13:47,854 You can read more about "package data files" on setuptools documentation page: 2023-09-28T07:13:47,855 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-09-28T07:13:47,857 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-09-28T07:13:47,858 even if it does not contain any `.py` files. 2023-09-28T07:13:47,858 On the other hand, currently there is no concept of package data 2023-09-28T07:13:47,859 directory, all directories are treated like packages. 2023-09-28T07:13:47,859 ******************************************************************************** 2023-09-28T07:13:47,860 !! 2023-09-28T07:13:47,861 check.warn(importable) 2023-09-28T07:13:47,861 creating build/lib/deepspeed/ops/csrc 2023-09-28T07:13:47,862 creating build/lib/deepspeed/ops/csrc/adagrad 2023-09-28T07:13:47,862 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-09-28T07:13:47,862 creating build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,863 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,863 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,864 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,864 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,865 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-09-28T07:13:47,865 creating build/lib/deepspeed/ops/csrc/aio 2023-09-28T07:13:47,866 creating build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,866 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,866 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,867 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,867 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,868 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,868 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:47,869 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,869 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,870 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,870 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,871 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,871 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,872 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,872 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,873 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,874 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,874 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,874 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:47,875 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-09-28T07:13:47,876 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-09-28T07:13:47,876 creating build/lib/deepspeed/ops/csrc/common 2023-09-28T07:13:47,877 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-09-28T07:13:47,877 creating build/lib/deepspeed/ops/csrc/cpu 2023-09-28T07:13:47,878 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-09-28T07:13:47,879 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-09-28T07:13:47,879 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-09-28T07:13:47,880 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-09-28T07:13:47,880 creating build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,881 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,881 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,881 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,882 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,882 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,883 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,883 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,884 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,884 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,884 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,885 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,885 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,886 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,887 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,887 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,888 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,888 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,889 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,889 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,890 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,890 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,891 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,891 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,892 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,892 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,893 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,894 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-09-28T07:13:47,894 creating build/lib/deepspeed/ops/csrc/lamb 2023-09-28T07:13:47,895 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-09-28T07:13:47,895 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-09-28T07:13:47,896 creating build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,896 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,897 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,898 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,898 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,898 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,899 copying deepspeed/ops/csrc/quantization/quantize_int4.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,899 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-09-28T07:13:47,900 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:47,900 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:47,901 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:47,901 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:47,902 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:47,902 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-09-28T07:13:47,902 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-09-28T07:13:47,903 creating build/lib/deepspeed/ops/csrc/spatial 2023-09-28T07:13:47,903 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:47,904 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:47,904 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:47,905 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-09-28T07:13:47,905 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-09-28T07:13:47,906 creating build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,906 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,907 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,907 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,908 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,909 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,909 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,910 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,910 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-09-28T07:13:47,911 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-09-28T07:13:47,912 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,912 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,913 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,913 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,914 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,915 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,915 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,916 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,917 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,917 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,918 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:47,918 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:47,918 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:47,919 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:47,919 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:47,920 creating build/lib/deepspeed/ops/csrc/utils 2023-09-28T07:13:47,920 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-09-28T07:13:47,921 creating build/lib/deepspeed/autotuning/config_templates 2023-09-28T07:13:47,921 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-09-28T07:13:47,921 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-09-28T07:13:47,922 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-09-28T07:13:47,923 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-09-28T07:13:47,923 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:47,924 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:47,924 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:47,925 running build_scripts 2023-09-28T07:13:47,925 creating build/scripts-3.11 2023-09-28T07:13:47,926 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-09-28T07:13:47,926 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-09-28T07:13:47,927 copying and adjusting bin/ds -> build/scripts-3.11 2023-09-28T07:13:47,927 copying bin/ds_ssh -> build/scripts-3.11 2023-09-28T07:13:47,928 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-09-28T07:13:47,929 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-09-28T07:13:47,929 copying and adjusting bin/dsr -> build/scripts-3.11 2023-09-28T07:13:47,930 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-09-28T07:13:47,930 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-09-28T07:13:47,931 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-09-28T07:13:47,931 changing mode of build/scripts-3.11/ds from 644 to 755 2023-09-28T07:13:47,932 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-09-28T07:13:47,932 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-09-28T07:13:47,933 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-09-28T07:13:47,934 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-09-28T07:13:47,934 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-09-28T07:13:47,935 !! 2023-09-28T07:13:47,936 ******************************************************************************** 2023-09-28T07:13:47,936 Please avoid running ``setup.py`` directly. 2023-09-28T07:13:47,937 Instead, use pypa/build, pypa/installer or other 2023-09-28T07:13:47,937 standards-based tools. 2023-09-28T07:13:47,938 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-09-28T07:13:47,938 ******************************************************************************** 2023-09-28T07:13:47,939 !! 2023-09-28T07:13:47,940 self.initialize_options() 2023-09-28T07:13:47,943 installing to build/bdist.linux-armv7l/wheel 2023-09-28T07:13:47,944 running install 2023-09-28T07:13:47,967 running install_lib 2023-09-28T07:13:47,991 creating build/bdist.linux-armv7l 2023-09-28T07:13:47,992 creating build/bdist.linux-armv7l/wheel 2023-09-28T07:13:47,993 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:47,995 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-09-28T07:13:47,996 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-09-28T07:13:47,997 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-09-28T07:13:47,999 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-09-28T07:13:48,001 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-09-28T07:13:48,002 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-09-28T07:13:48,005 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,007 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,008 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,010 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,012 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,014 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,016 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,017 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,019 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,021 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,023 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,025 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-09-28T07:13:48,027 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,029 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,031 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,033 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,034 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,037 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,038 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,040 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,042 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,044 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,046 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,048 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,053 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,054 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,057 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,059 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-09-28T07:13:48,061 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,063 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,065 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,068 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,070 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-09-28T07:13:48,072 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-09-28T07:13:48,074 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-09-28T07:13:48,075 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-09-28T07:13:48,077 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-09-28T07:13:48,079 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-09-28T07:13:48,081 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-09-28T07:13:48,083 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-09-28T07:13:48,085 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,086 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,089 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,091 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,095 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-09-28T07:13:48,097 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:48,098 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:48,100 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:48,103 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-09-28T07:13:48,105 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,106 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,109 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,111 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,113 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,115 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,119 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,122 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,124 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,127 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,129 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-09-28T07:13:48,131 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,134 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,136 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,139 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,142 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-09-28T07:13:48,145 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,146 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,149 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,151 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,153 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,155 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,157 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,159 copying build/lib/deepspeed/ops/csrc/quantization/quantize_int4.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-09-28T07:13:48,162 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,163 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,165 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,167 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,169 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,171 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,173 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,175 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,178 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,180 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,181 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,184 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,186 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,187 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,189 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,191 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,193 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,195 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,197 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,199 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,201 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,203 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,205 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,207 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,209 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,211 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,214 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,215 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-09-28T07:13:48,218 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,219 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,221 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,223 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,225 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,228 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-09-28T07:13:48,230 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-09-28T07:13:48,231 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-09-28T07:13:48,232 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-09-28T07:13:48,235 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:48,236 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:48,238 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-09-28T07:13:48,241 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-09-28T07:13:48,242 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-09-28T07:13:48,244 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-09-28T07:13:48,247 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-09-28T07:13:48,248 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-09-28T07:13:48,251 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-09-28T07:13:48,253 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-09-28T07:13:48,255 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-09-28T07:13:48,256 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,258 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,260 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,261 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,263 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,265 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,266 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,268 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,270 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,272 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,274 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,276 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-09-28T07:13:48,278 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-09-28T07:13:48,279 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-09-28T07:13:48,281 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,282 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,285 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,287 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,289 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,292 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,294 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-09-28T07:13:48,297 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-09-28T07:13:48,298 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-09-28T07:13:48,300 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-09-28T07:13:48,301 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-09-28T07:13:48,304 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-09-28T07:13:48,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-09-28T07:13:48,306 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-09-28T07:13:48,309 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-09-28T07:13:48,310 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-09-28T07:13:48,313 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:48,314 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:48,316 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:48,319 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:48,321 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-09-28T07:13:48,323 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-09-28T07:13:48,325 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-09-28T07:13:48,326 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-09-28T07:13:48,329 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-09-28T07:13:48,331 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,333 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,335 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,337 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,340 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,341 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,344 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-09-28T07:13:48,345 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-09-28T07:13:48,346 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-09-28T07:13:48,348 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-09-28T07:13:48,350 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,352 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,354 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,356 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,357 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,359 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,361 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,363 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,366 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,368 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,369 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,371 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,372 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,374 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,376 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,377 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-09-28T07:13:48,379 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-09-28T07:13:48,381 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,382 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,385 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:48,385 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:48,387 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:48,390 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:48,391 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-09-28T07:13:48,393 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,396 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,398 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,400 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,402 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,405 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-09-28T07:13:48,408 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-09-28T07:13:48,409 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-09-28T07:13:48,411 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-09-28T07:13:48,412 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-09-28T07:13:48,414 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-09-28T07:13:48,416 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-09-28T07:13:48,417 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-09-28T07:13:48,419 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-09-28T07:13:48,422 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,423 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,425 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,427 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,429 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,431 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,433 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,435 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-09-28T07:13:48,438 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,438 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,441 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,442 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,444 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,446 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,447 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,449 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,451 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-09-28T07:13:48,453 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,455 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,457 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-09-28T07:13:48,458 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-09-28T07:13:48,460 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-09-28T07:13:48,461 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-09-28T07:13:48,463 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-09-28T07:13:48,465 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,468 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,470 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-09-28T07:13:48,473 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,474 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,477 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,479 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,481 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,482 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,485 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,486 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,489 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,491 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-09-28T07:13:48,493 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,494 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,497 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,498 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,500 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,501 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,504 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,506 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,508 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,510 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,512 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,514 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-09-28T07:13:48,516 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,518 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,520 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,522 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,524 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,526 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,528 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,530 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,532 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,534 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,536 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,538 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,540 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,542 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,544 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,546 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-09-28T07:13:48,548 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,550 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,552 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,555 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,557 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,559 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,561 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,563 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,565 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,567 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,569 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-09-28T07:13:48,571 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:48,574 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-09-28T07:13:48,575 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-09-28T07:13:48,577 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-09-28T07:13:48,579 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:48,581 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,582 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,585 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,586 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,588 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,591 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-09-28T07:13:48,593 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-09-28T07:13:48,594 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-09-28T07:13:48,596 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:48,598 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-09-28T07:13:48,599 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-09-28T07:13:48,602 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,603 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,605 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,607 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,609 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,611 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-09-28T07:13:48,613 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-09-28T07:13:48,615 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-09-28T07:13:48,618 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-09-28T07:13:48,618 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-09-28T07:13:48,620 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-09-28T07:13:48,622 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-09-28T07:13:48,624 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:48,627 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,628 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,631 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,633 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,634 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,636 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,638 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,640 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,642 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,644 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-09-28T07:13:48,646 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,647 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,652 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,655 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:48,656 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:48,658 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:48,660 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-09-28T07:13:48,663 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,666 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,668 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:48,669 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:48,671 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:48,673 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:48,674 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-09-28T07:13:48,677 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,678 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,681 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,683 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,686 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,688 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,691 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-09-28T07:13:48,693 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,696 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,699 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,702 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,703 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,706 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,709 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,711 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,713 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,716 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,718 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,720 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,723 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,726 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,729 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,734 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,739 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,742 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,744 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,749 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-09-28T07:13:48,751 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,753 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,756 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-09-28T07:13:48,757 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-09-28T07:13:48,760 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-09-28T07:13:48,762 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,763 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,766 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,768 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,770 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,772 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-09-28T07:13:48,775 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-09-28T07:13:48,778 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,779 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,782 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,785 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,787 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,790 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-09-28T07:13:48,792 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-09-28T07:13:48,795 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-09-28T07:13:48,796 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-09-28T07:13:48,799 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-09-28T07:13:48,801 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-09-28T07:13:48,804 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-09-28T07:13:48,806 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,808 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,811 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-09-28T07:13:48,812 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:48,813 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:48,816 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:48,818 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:48,820 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-09-28T07:13:48,823 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-09-28T07:13:48,825 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-09-28T07:13:48,827 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-09-28T07:13:48,829 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-09-28T07:13:48,831 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,833 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,836 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,837 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,839 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,842 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,843 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,845 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,847 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,849 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,851 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,853 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-09-28T07:13:48,856 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,858 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,861 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-09-28T07:13:48,863 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-09-28T07:13:48,864 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-09-28T07:13:48,866 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-09-28T07:13:48,868 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,869 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,871 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,873 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,875 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,877 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,879 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,881 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,883 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,885 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,887 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,889 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,891 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,893 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,895 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-09-28T07:13:48,897 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-09-28T07:13:48,898 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-09-28T07:13:48,899 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-09-28T07:13:48,902 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-09-28T07:13:48,904 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-09-28T07:13:48,906 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-09-28T07:13:48,906 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-09-28T07:13:48,908 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-09-28T07:13:48,910 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-09-28T07:13:48,912 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,913 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,915 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,917 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,918 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,920 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,922 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,924 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,926 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,928 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-09-28T07:13:48,930 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,931 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,933 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,936 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,938 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,940 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,943 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-09-28T07:13:48,945 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-09-28T07:13:48,948 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,949 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,951 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,954 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,956 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,958 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,961 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-09-28T07:13:48,964 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,965 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,968 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,970 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,972 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,974 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,980 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,983 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-09-28T07:13:48,985 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-09-28T07:13:48,986 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-09-28T07:13:48,989 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-09-28T07:13:48,990 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-09-28T07:13:48,993 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-09-28T07:13:48,996 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-09-28T07:13:48,999 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-09-28T07:13:49,001 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,002 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,005 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,008 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,011 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,013 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,016 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,019 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,021 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-09-28T07:13:49,024 running install_egg_info 2023-09-28T07:13:49,057 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.10.3-py3.11.egg-info 2023-09-28T07:13:49,069 running install_scripts 2023-09-28T07:13:49,070 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data 2023-09-28T07:13:49,071 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,072 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,074 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,075 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,077 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,079 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,080 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,082 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,084 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts 2023-09-28T07:13:49,085 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/ds to 755 2023-09-28T07:13:49,086 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/ds_bench to 755 2023-09-28T07:13:49,086 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/ds_ssh to 755 2023-09-28T07:13:49,087 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/dsr to 755 2023-09-28T07:13:49,087 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/ds_report to 755 2023-09-28T07:13:49,088 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/deepspeed to 755 2023-09-28T07:13:49,088 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/deepspeed.pt to 755 2023-09-28T07:13:49,089 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.data/scripts/ds_elastic to 755 2023-09-28T07:13:49,133 creating build/bdist.linux-armv7l/wheel/deepspeed-0.10.3.dist-info/WHEEL 2023-09-28T07:13:49,135 creating '/tmp/pip-wheel-5o0qm8x3/deepspeed-0.10.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-09-28T07:13:49,138 adding 'deepspeed/__init__.py' 2023-09-28T07:13:49,140 adding 'deepspeed/constants.py' 2023-09-28T07:13:49,141 adding 'deepspeed/env_report.py' 2023-09-28T07:13:49,143 adding 'deepspeed/git_version_info.py' 2023-09-28T07:13:49,144 adding 'deepspeed/git_version_info_installed.py' 2023-09-28T07:13:49,146 adding 'deepspeed/accelerator/__init__.py' 2023-09-28T07:13:49,147 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-09-28T07:13:49,148 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-09-28T07:13:49,150 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-09-28T07:13:49,152 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-09-28T07:13:49,153 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-09-28T07:13:49,155 adding 'deepspeed/accelerator/real_accelerator.py' 2023-09-28T07:13:49,156 adding 'deepspeed/autotuning/__init__.py' 2023-09-28T07:13:49,161 adding 'deepspeed/autotuning/autotuner.py' 2023-09-28T07:13:49,163 adding 'deepspeed/autotuning/config.py' 2023-09-28T07:13:49,165 adding 'deepspeed/autotuning/constants.py' 2023-09-28T07:13:49,167 adding 'deepspeed/autotuning/scheduler.py' 2023-09-28T07:13:49,169 adding 'deepspeed/autotuning/utils.py' 2023-09-28T07:13:49,171 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-09-28T07:13:49,172 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-09-28T07:13:49,173 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-09-28T07:13:49,174 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-09-28T07:13:49,176 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-09-28T07:13:49,177 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-09-28T07:13:49,178 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-09-28T07:13:49,179 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-09-28T07:13:49,181 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-09-28T07:13:49,182 adding 'deepspeed/autotuning/tuner/utils.py' 2023-09-28T07:13:49,184 adding 'deepspeed/checkpoint/__init__.py' 2023-09-28T07:13:49,185 adding 'deepspeed/checkpoint/constants.py' 2023-09-28T07:13:49,187 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-09-28T07:13:49,189 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-09-28T07:13:49,190 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-09-28T07:13:49,192 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-09-28T07:13:49,193 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-09-28T07:13:49,194 adding 'deepspeed/checkpoint/utils.py' 2023-09-28T07:13:49,196 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-09-28T07:13:49,198 adding 'deepspeed/comm/__init__.py' 2023-09-28T07:13:49,199 adding 'deepspeed/comm/backend.py' 2023-09-28T07:13:49,200 adding 'deepspeed/comm/ccl.py' 2023-09-28T07:13:49,203 adding 'deepspeed/comm/comm.py' 2023-09-28T07:13:49,205 adding 'deepspeed/comm/config.py' 2023-09-28T07:13:49,206 adding 'deepspeed/comm/constants.py' 2023-09-28T07:13:49,207 adding 'deepspeed/comm/reduce_op.py' 2023-09-28T07:13:49,210 adding 'deepspeed/comm/torch.py' 2023-09-28T07:13:49,211 adding 'deepspeed/comm/utils.py' 2023-09-28T07:13:49,213 adding 'deepspeed/compression/__init__.py' 2023-09-28T07:13:49,216 adding 'deepspeed/compression/basic_layer.py' 2023-09-28T07:13:49,218 adding 'deepspeed/compression/compress.py' 2023-09-28T07:13:49,220 adding 'deepspeed/compression/config.py' 2023-09-28T07:13:49,222 adding 'deepspeed/compression/constants.py' 2023-09-28T07:13:49,224 adding 'deepspeed/compression/helper.py' 2023-09-28T07:13:49,225 adding 'deepspeed/compression/scheduler.py' 2023-09-28T07:13:49,227 adding 'deepspeed/compression/utils.py' 2023-09-28T07:13:49,229 adding 'deepspeed/elasticity/__init__.py' 2023-09-28T07:13:49,230 adding 'deepspeed/elasticity/config.py' 2023-09-28T07:13:49,232 adding 'deepspeed/elasticity/constants.py' 2023-09-28T07:13:49,233 adding 'deepspeed/elasticity/elastic_agent.py' 2023-09-28T07:13:49,235 adding 'deepspeed/elasticity/elasticity.py' 2023-09-28T07:13:49,237 adding 'deepspeed/elasticity/utils.py' 2023-09-28T07:13:49,239 adding 'deepspeed/inference/__init__.py' 2023-09-28T07:13:49,240 adding 'deepspeed/inference/config.py' 2023-09-28T07:13:49,244 adding 'deepspeed/inference/engine.py' 2023-09-28T07:13:49,246 adding 'deepspeed/inference/quantization/__init__.py' 2023-09-28T07:13:49,247 adding 'deepspeed/inference/quantization/layers.py' 2023-09-28T07:13:49,248 adding 'deepspeed/inference/quantization/quantization.py' 2023-09-28T07:13:49,250 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-09-28T07:13:49,251 adding 'deepspeed/inference/quantization/utils.py' 2023-09-28T07:13:49,253 adding 'deepspeed/launcher/__init__.py' 2023-09-28T07:13:49,254 adding 'deepspeed/launcher/constants.py' 2023-09-28T07:13:49,256 adding 'deepspeed/launcher/launch.py' 2023-09-28T07:13:49,258 adding 'deepspeed/launcher/multinode_runner.py' 2023-09-28T07:13:49,261 adding 'deepspeed/launcher/runner.py' 2023-09-28T07:13:49,263 adding 'deepspeed/model_implementations/__init__.py' 2023-09-28T07:13:49,264 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-09-28T07:13:49,266 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-09-28T07:13:49,267 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-09-28T07:13:49,269 adding 'deepspeed/model_implementations/features/__init__.py' 2023-09-28T07:13:49,270 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-09-28T07:13:49,271 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-09-28T07:13:49,273 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-09-28T07:13:49,274 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-09-28T07:13:49,275 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-09-28T07:13:49,277 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-09-28T07:13:49,278 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-09-28T07:13:49,279 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-09-28T07:13:49,280 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-09-28T07:13:49,282 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-09-28T07:13:49,284 adding 'deepspeed/module_inject/__init__.py' 2023-09-28T07:13:49,286 adding 'deepspeed/module_inject/auto_tp.py' 2023-09-28T07:13:49,288 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-09-28T07:13:49,289 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-09-28T07:13:49,291 adding 'deepspeed/module_inject/inject.py' 2023-09-28T07:13:49,292 adding 'deepspeed/module_inject/layers.py' 2023-09-28T07:13:49,294 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-09-28T07:13:49,296 adding 'deepspeed/module_inject/module_quantize.py' 2023-09-28T07:13:49,298 adding 'deepspeed/module_inject/policy.py' 2023-09-28T07:13:49,301 adding 'deepspeed/module_inject/replace_module.py' 2023-09-28T07:13:49,302 adding 'deepspeed/module_inject/replace_policy.py' 2023-09-28T07:13:49,304 adding 'deepspeed/module_inject/utils.py' 2023-09-28T07:13:49,306 adding 'deepspeed/module_inject/containers/__init__.py' 2023-09-28T07:13:49,308 adding 'deepspeed/module_inject/containers/base.py' 2023-09-28T07:13:49,310 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-09-28T07:13:49,311 adding 'deepspeed/module_inject/containers/bert.py' 2023-09-28T07:13:49,313 adding 'deepspeed/module_inject/containers/bloom.py' 2023-09-28T07:13:49,314 adding 'deepspeed/module_inject/containers/clip.py' 2023-09-28T07:13:49,316 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-09-28T07:13:49,317 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-09-28T07:13:49,319 adding 'deepspeed/module_inject/containers/gptj.py' 2023-09-28T07:13:49,320 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-09-28T07:13:49,321 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-09-28T07:13:49,323 adding 'deepspeed/module_inject/containers/llama.py' 2023-09-28T07:13:49,324 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-09-28T07:13:49,325 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-09-28T07:13:49,327 adding 'deepspeed/module_inject/containers/opt.py' 2023-09-28T07:13:49,328 adding 'deepspeed/module_inject/containers/unet.py' 2023-09-28T07:13:49,329 adding 'deepspeed/module_inject/containers/vae.py' 2023-09-28T07:13:49,331 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-09-28T07:13:49,332 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-09-28T07:13:49,334 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-09-28T07:13:49,335 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-09-28T07:13:49,336 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-09-28T07:13:49,338 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-09-28T07:13:49,339 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-09-28T07:13:49,341 adding 'deepspeed/moe/__init__.py' 2023-09-28T07:13:49,342 adding 'deepspeed/moe/experts.py' 2023-09-28T07:13:49,343 adding 'deepspeed/moe/layer.py' 2023-09-28T07:13:49,345 adding 'deepspeed/moe/mappings.py' 2023-09-28T07:13:49,347 adding 'deepspeed/moe/sharded_moe.py' 2023-09-28T07:13:49,349 adding 'deepspeed/moe/utils.py' 2023-09-28T07:13:49,350 adding 'deepspeed/monitor/__init__.py' 2023-09-28T07:13:49,352 adding 'deepspeed/monitor/config.py' 2023-09-28T07:13:49,353 adding 'deepspeed/monitor/csv_monitor.py' 2023-09-28T07:13:49,354 adding 'deepspeed/monitor/monitor.py' 2023-09-28T07:13:49,356 adding 'deepspeed/monitor/tensorboard.py' 2023-09-28T07:13:49,357 adding 'deepspeed/monitor/utils.py' 2023-09-28T07:13:49,358 adding 'deepspeed/monitor/wandb.py' 2023-09-28T07:13:49,360 adding 'deepspeed/nebula/__init__.py' 2023-09-28T07:13:49,361 adding 'deepspeed/nebula/config.py' 2023-09-28T07:13:49,362 adding 'deepspeed/nebula/constants.py' 2023-09-28T07:13:49,364 adding 'deepspeed/ops/__init__.py' 2023-09-28T07:13:49,366 adding 'deepspeed/ops/adagrad/__init__.py' 2023-09-28T07:13:49,367 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-09-28T07:13:49,369 adding 'deepspeed/ops/adam/__init__.py' 2023-09-28T07:13:49,370 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-09-28T07:13:49,372 adding 'deepspeed/ops/adam/fused_adam.py' 2023-09-28T07:13:49,373 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-09-28T07:13:49,375 adding 'deepspeed/ops/aio/__init__.py' 2023-09-28T07:13:49,378 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-09-28T07:13:49,379 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-09-28T07:13:49,381 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-09-28T07:13:49,382 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-09-28T07:13:49,384 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-09-28T07:13:49,385 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-09-28T07:13:49,388 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-09-28T07:13:49,389 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-09-28T07:13:49,391 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-09-28T07:13:49,392 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-09-28T07:13:49,393 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-09-28T07:13:49,395 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-09-28T07:13:49,397 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-09-28T07:13:49,398 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-09-28T07:13:49,399 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-09-28T07:13:49,400 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-09-28T07:13:49,401 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-09-28T07:13:49,402 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-09-28T07:13:49,404 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-09-28T07:13:49,405 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-09-28T07:13:49,406 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-09-28T07:13:49,408 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-09-28T07:13:49,409 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-09-28T07:13:49,410 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-09-28T07:13:49,412 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-09-28T07:13:49,414 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-09-28T07:13:49,417 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-09-28T07:13:49,419 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-09-28T07:13:49,420 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-09-28T07:13:49,422 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-09-28T07:13:49,423 adding 'deepspeed/ops/csrc/includes/context.h' 2023-09-28T07:13:49,425 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-09-28T07:13:49,426 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-09-28T07:13:49,428 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-09-28T07:13:49,429 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-09-28T07:13:49,431 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-09-28T07:13:49,432 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-09-28T07:13:49,434 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-09-28T07:13:49,435 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-09-28T07:13:49,436 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-09-28T07:13:49,438 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-09-28T07:13:49,439 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-09-28T07:13:49,440 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-09-28T07:13:49,441 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-09-28T07:13:49,444 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-09-28T07:13:49,446 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-09-28T07:13:49,447 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-09-28T07:13:49,449 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-09-28T07:13:49,450 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-09-28T07:13:49,452 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-09-28T07:13:49,454 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-09-28T07:13:49,455 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-09-28T07:13:49,457 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-09-28T07:13:49,458 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-09-28T07:13:49,460 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-09-28T07:13:49,462 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-09-28T07:13:49,464 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-09-28T07:13:49,467 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-09-28T07:13:49,469 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-09-28T07:13:49,471 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-09-28T07:13:49,473 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-09-28T07:13:49,474 adding 'deepspeed/ops/csrc/quantization/quantize_int4.cu' 2023-09-28T07:13:49,476 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-09-28T07:13:49,478 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-09-28T07:13:49,480 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-09-28T07:13:49,481 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-09-28T07:13:49,482 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-09-28T07:13:49,484 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-09-28T07:13:49,486 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-09-28T07:13:49,488 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-09-28T07:13:49,489 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-09-28T07:13:49,491 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-09-28T07:13:49,494 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-09-28T07:13:49,498 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-09-28T07:13:49,500 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-09-28T07:13:49,501 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-09-28T07:13:49,505 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-09-28T07:13:49,508 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-09-28T07:13:49,511 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-09-28T07:13:49,513 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-09-28T07:13:49,515 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-09-28T07:13:49,518 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-09-28T07:13:49,520 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-09-28T07:13:49,521 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-09-28T07:13:49,526 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-09-28T07:13:49,528 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-09-28T07:13:49,530 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-09-28T07:13:49,532 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-09-28T07:13:49,535 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-09-28T07:13:49,538 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-09-28T07:13:49,539 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-09-28T07:13:49,541 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-09-28T07:13:49,543 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-09-28T07:13:49,544 adding 'deepspeed/ops/lamb/__init__.py' 2023-09-28T07:13:49,546 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-09-28T07:13:49,548 adding 'deepspeed/ops/op_builder/__init__.py' 2023-09-28T07:13:49,549 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-09-28T07:13:49,551 adding 'deepspeed/ops/op_builder/async_io.py' 2023-09-28T07:13:49,554 adding 'deepspeed/ops/op_builder/builder.py' 2023-09-28T07:13:49,556 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-09-28T07:13:49,557 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-09-28T07:13:49,559 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-09-28T07:13:49,560 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-09-28T07:13:49,561 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-09-28T07:13:49,563 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-09-28T07:13:49,564 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-09-28T07:13:49,566 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-09-28T07:13:49,567 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-09-28T07:13:49,568 adding 'deepspeed/ops/op_builder/transformer.py' 2023-09-28T07:13:49,570 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-09-28T07:13:49,572 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-09-28T07:13:49,573 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-09-28T07:13:49,574 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-09-28T07:13:49,575 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-09-28T07:13:49,577 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-09-28T07:13:49,578 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-09-28T07:13:49,580 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-09-28T07:13:49,581 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-09-28T07:13:49,582 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-09-28T07:13:49,584 adding 'deepspeed/ops/quantizer/__init__.py' 2023-09-28T07:13:49,585 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-09-28T07:13:49,586 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-09-28T07:13:49,588 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-09-28T07:13:49,589 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-09-28T07:13:49,591 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-09-28T07:13:49,594 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-09-28T07:13:49,596 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-09-28T07:13:49,598 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-09-28T07:13:49,600 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-09-28T07:13:49,603 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-09-28T07:13:49,605 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-09-28T07:13:49,606 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-09-28T07:13:49,608 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-09-28T07:13:49,609 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-09-28T07:13:49,611 adding 'deepspeed/ops/transformer/__init__.py' 2023-09-28T07:13:49,613 adding 'deepspeed/ops/transformer/transformer.py' 2023-09-28T07:13:49,615 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-09-28T07:13:49,616 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-09-28T07:13:49,617 adding 'deepspeed/ops/transformer/inference/config.py' 2023-09-28T07:13:49,619 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-09-28T07:13:49,620 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-09-28T07:13:49,622 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-09-28T07:13:49,624 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-09-28T07:13:49,625 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-09-28T07:13:49,627 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-09-28T07:13:49,629 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-09-28T07:13:49,631 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-09-28T07:13:49,632 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-09-28T07:13:49,633 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-09-28T07:13:49,635 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-09-28T07:13:49,636 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-09-28T07:13:49,637 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-09-28T07:13:49,639 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-09-28T07:13:49,640 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-09-28T07:13:49,641 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-09-28T07:13:49,642 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-09-28T07:13:49,644 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-09-28T07:13:49,646 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-09-28T07:13:49,647 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-09-28T07:13:49,649 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-09-28T07:13:49,651 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-09-28T07:13:49,652 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-09-28T07:13:49,654 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-09-28T07:13:49,655 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-09-28T07:13:49,656 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-09-28T07:13:49,658 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-09-28T07:13:49,660 adding 'deepspeed/pipe/__init__.py' 2023-09-28T07:13:49,661 adding 'deepspeed/profiling/__init__.py' 2023-09-28T07:13:49,662 adding 'deepspeed/profiling/config.py' 2023-09-28T07:13:49,664 adding 'deepspeed/profiling/constants.py' 2023-09-28T07:13:49,665 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-09-28T07:13:49,670 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-09-28T07:13:49,672 adding 'deepspeed/runtime/__init__.py' 2023-09-28T07:13:49,675 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-09-28T07:13:49,679 adding 'deepspeed/runtime/config.py' 2023-09-28T07:13:49,681 adding 'deepspeed/runtime/config_utils.py' 2023-09-28T07:13:49,683 adding 'deepspeed/runtime/constants.py' 2023-09-28T07:13:49,684 adding 'deepspeed/runtime/dataloader.py' 2023-09-28T07:13:49,686 adding 'deepspeed/runtime/eigenvalue.py' 2023-09-28T07:13:49,703 adding 'deepspeed/runtime/engine.py' 2023-09-28T07:13:49,706 adding 'deepspeed/runtime/hybrid_engine.py' 2023-09-28T07:13:49,709 adding 'deepspeed/runtime/lr_schedules.py' 2023-09-28T07:13:49,711 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-09-28T07:13:49,712 adding 'deepspeed/runtime/quantize.py' 2023-09-28T07:13:49,714 adding 'deepspeed/runtime/sparse_tensor.py' 2023-09-28T07:13:49,716 adding 'deepspeed/runtime/state_dict_factory.py' 2023-09-28T07:13:49,720 adding 'deepspeed/runtime/utils.py' 2023-09-28T07:13:49,722 adding 'deepspeed/runtime/weight_quantizer.py' 2023-09-28T07:13:49,724 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-09-28T07:13:49,728 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-09-28T07:13:49,730 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-09-28T07:13:49,732 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-09-28T07:13:49,733 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-09-28T07:13:49,734 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-09-28T07:13:49,736 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-09-28T07:13:49,737 adding 'deepspeed/runtime/comm/__init__.py' 2023-09-28T07:13:49,739 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-09-28T07:13:49,740 adding 'deepspeed/runtime/comm/mpi.py' 2023-09-28T07:13:49,742 adding 'deepspeed/runtime/comm/nccl.py' 2023-09-28T07:13:49,744 adding 'deepspeed/runtime/compression/__init__.py' 2023-09-28T07:13:49,745 adding 'deepspeed/runtime/compression/cupy.py' 2023-09-28T07:13:49,747 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-09-28T07:13:49,748 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-09-28T07:13:49,749 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-09-28T07:13:49,752 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-09-28T07:13:49,753 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-09-28T07:13:49,755 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-09-28T07:13:49,756 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-09-28T07:13:49,758 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-09-28T07:13:49,759 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-09-28T07:13:49,760 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-09-28T07:13:49,763 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-09-28T07:13:49,765 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-09-28T07:13:49,768 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-09-28T07:13:49,769 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-09-28T07:13:49,771 adding 'deepspeed/runtime/fp16/__init__.py' 2023-09-28T07:13:49,773 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-09-28T07:13:49,775 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-09-28T07:13:49,778 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-09-28T07:13:49,779 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-09-28T07:13:49,781 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-09-28T07:13:49,784 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-09-28T07:13:49,786 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-09-28T07:13:49,788 adding 'deepspeed/runtime/pipe/__init__.py' 2023-09-28T07:13:49,794 adding 'deepspeed/runtime/pipe/engine.py' 2023-09-28T07:13:49,798 adding 'deepspeed/runtime/pipe/module.py' 2023-09-28T07:13:49,799 adding 'deepspeed/runtime/pipe/p2p.py' 2023-09-28T07:13:49,801 adding 'deepspeed/runtime/pipe/schedule.py' 2023-09-28T07:13:49,804 adding 'deepspeed/runtime/pipe/topology.py' 2023-09-28T07:13:49,805 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-09-28T07:13:49,807 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-09-28T07:13:49,808 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-09-28T07:13:49,809 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-09-28T07:13:49,811 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-09-28T07:13:49,813 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-09-28T07:13:49,815 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-09-28T07:13:49,817 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-09-28T07:13:49,819 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-09-28T07:13:49,821 adding 'deepspeed/runtime/zero/__init__.py' 2023-09-28T07:13:49,823 adding 'deepspeed/runtime/zero/config.py' 2023-09-28T07:13:49,825 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-09-28T07:13:49,826 adding 'deepspeed/runtime/zero/linear.py' 2023-09-28T07:13:49,829 adding 'deepspeed/runtime/zero/mics.py' 2023-09-28T07:13:49,830 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-09-28T07:13:49,832 adding 'deepspeed/runtime/zero/offload_config.py' 2023-09-28T07:13:49,834 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-09-28T07:13:49,845 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-09-28T07:13:49,849 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-09-28T07:13:49,850 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-09-28T07:13:49,864 adding 'deepspeed/runtime/zero/stage3.py' 2023-09-28T07:13:49,877 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-09-28T07:13:49,879 adding 'deepspeed/runtime/zero/test.py' 2023-09-28T07:13:49,881 adding 'deepspeed/runtime/zero/tiling.py' 2023-09-28T07:13:49,883 adding 'deepspeed/runtime/zero/utils.py' 2023-09-28T07:13:49,885 adding 'deepspeed/sequence/__init__.py' 2023-09-28T07:13:49,886 adding 'deepspeed/sequence/layer.py' 2023-09-28T07:13:49,888 adding 'deepspeed/utils/__init__.py' 2023-09-28T07:13:49,889 adding 'deepspeed/utils/comms_logging.py' 2023-09-28T07:13:49,891 adding 'deepspeed/utils/debug.py' 2023-09-28T07:13:49,892 adding 'deepspeed/utils/exceptions.py' 2023-09-28T07:13:49,895 adding 'deepspeed/utils/groups.py' 2023-09-28T07:13:49,896 adding 'deepspeed/utils/init_on_device.py' 2023-09-28T07:13:49,898 adding 'deepspeed/utils/logging.py' 2023-09-28T07:13:49,899 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-09-28T07:13:49,900 adding 'deepspeed/utils/numa.py' 2023-09-28T07:13:49,902 adding 'deepspeed/utils/nvtx.py' 2023-09-28T07:13:49,903 adding 'deepspeed/utils/tensor_fragment.py' 2023-09-28T07:13:49,905 adding 'deepspeed/utils/timer.py' 2023-09-28T07:13:49,906 adding 'deepspeed/utils/types.py' 2023-09-28T07:13:49,909 adding 'deepspeed/utils/zero_to_fp32.py' 2023-09-28T07:13:49,911 adding 'deepspeed-0.10.3.data/scripts/deepspeed' 2023-09-28T07:13:49,912 adding 'deepspeed-0.10.3.data/scripts/deepspeed.pt' 2023-09-28T07:13:49,913 adding 'deepspeed-0.10.3.data/scripts/ds' 2023-09-28T07:13:49,914 adding 'deepspeed-0.10.3.data/scripts/ds_bench' 2023-09-28T07:13:49,915 adding 'deepspeed-0.10.3.data/scripts/ds_elastic' 2023-09-28T07:13:49,916 adding 'deepspeed-0.10.3.data/scripts/ds_report' 2023-09-28T07:13:49,917 adding 'deepspeed-0.10.3.data/scripts/ds_ssh' 2023-09-28T07:13:49,918 adding 'deepspeed-0.10.3.data/scripts/dsr' 2023-09-28T07:13:49,921 adding 'deepspeed-0.10.3.dist-info/LICENSE' 2023-09-28T07:13:49,925 adding 'deepspeed-0.10.3.dist-info/METADATA' 2023-09-28T07:13:49,926 adding 'deepspeed-0.10.3.dist-info/WHEEL' 2023-09-28T07:13:49,927 adding 'deepspeed-0.10.3.dist-info/entry_points.txt' 2023-09-28T07:13:49,928 adding 'deepspeed-0.10.3.dist-info/top_level.txt' 2023-09-28T07:13:49,935 adding 'deepspeed-0.10.3.dist-info/RECORD' 2023-09-28T07:13:49,949 removing build/bdist.linux-armv7l/wheel 2023-09-28T07:13:50,059 deepspeed build time = 5.6597559452056885 secs 2023-09-28T07:13:50,178 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-09-28T07:13:50,191 Created wheel for deepspeed: filename=deepspeed-0.10.3-py3-none-any.whl size=907805 sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c 2023-09-28T07:13:50,192 Stored in directory: /tmp/pip-ephem-wheel-cache-siu0_dak/wheels/cf/90/66/f899e6b72f7a0872b4bd4538ed35dadf7e1d0a1b4665a794bf 2023-09-28T07:13:50,222 Successfully built deepspeed 2023-09-28T07:13:50,244 Removed build tracker: '/tmp/pip-build-tracker-snphqkq7'