2025-10-08T00:42:02,143 Created temporary directory: /tmp/pip-ephem-wheel-cache-sqkh3be_ 2025-10-08T00:42:02,145 Created temporary directory: /tmp/pip-build-tracker-501dt203 2025-10-08T00:42:02,145 Initialized build tracking at /tmp/pip-build-tracker-501dt203 2025-10-08T00:42:02,146 Created build tracker: /tmp/pip-build-tracker-501dt203 2025-10-08T00:42:02,146 Entered build tracker: /tmp/pip-build-tracker-501dt203 2025-10-08T00:42:02,147 Created temporary directory: /tmp/pip-wheel-kagheuet 2025-10-08T00:42:02,150 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-08T00:42:02,152 Created temporary directory: /tmp/pip-ephem-wheel-cache-3g60mlo1 2025-10-08T00:42:02,176 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-08T00:42:02,180 2 location(s) to search for versions of deepspeed: 2025-10-08T00:42:02,180 * https://pypi.org/simple/deepspeed/ 2025-10-08T00:42:02,180 * https://www.piwheels.org/simple/deepspeed/ 2025-10-08T00:42:02,180 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2025-10-08T00:42:02,181 Getting page https://pypi.org/simple/deepspeed/ 2025-10-08T00:42:02,183 Found index url https://pypi.org/simple 2025-10-08T00:42:02,402 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2025-10-08T00:42:02,425 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,426 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2025-10-08T00:42:02,427 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,428 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2025-10-08T00:42:02,428 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,429 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2025-10-08T00:42:02,430 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,431 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2025-10-08T00:42:02,431 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,432 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2025-10-08T00:42:02,433 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2025-10-08T00:42:02,434 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2025-10-08T00:42:02,434 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2025-10-08T00:42:02,435 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2025-10-08T00:42:02,436 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2025-10-08T00:42:02,436 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2025-10-08T00:42:02,437 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2025-10-08T00:42:02,437 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2025-10-08T00:42:02,438 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2025-10-08T00:42:02,439 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2025-10-08T00:42:02,440 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2025-10-08T00:42:02,440 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2025-10-08T00:42:02,441 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2025-10-08T00:42:02,442 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2025-10-08T00:42:02,443 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2025-10-08T00:42:02,443 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2025-10-08T00:42:02,444 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2025-10-08T00:42:02,445 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2025-10-08T00:42:02,446 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2025-10-08T00:42:02,447 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2025-10-08T00:42:02,447 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2025-10-08T00:42:02,448 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2025-10-08T00:42:02,448 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2025-10-08T00:42:02,449 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2025-10-08T00:42:02,449 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2025-10-08T00:42:02,450 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2025-10-08T00:42:02,451 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2025-10-08T00:42:02,451 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2025-10-08T00:42:02,452 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2025-10-08T00:42:02,453 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2025-10-08T00:42:02,454 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2025-10-08T00:42:02,454 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2025-10-08T00:42:02,455 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2025-10-08T00:42:02,456 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2025-10-08T00:42:02,456 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2025-10-08T00:42:02,457 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2025-10-08T00:42:02,458 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2025-10-08T00:42:02,459 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2025-10-08T00:42:02,460 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2025-10-08T00:42:02,460 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2025-10-08T00:42:02,461 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2025-10-08T00:42:02,461 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2025-10-08T00:42:02,462 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2025-10-08T00:42:02,462 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2025-10-08T00:42:02,463 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2025-10-08T00:42:02,464 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2025-10-08T00:42:02,464 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2025-10-08T00:42:02,465 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2025-10-08T00:42:02,466 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2025-10-08T00:42:02,467 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2025-10-08T00:42:02,467 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2025-10-08T00:42:02,468 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2025-10-08T00:42:02,469 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2025-10-08T00:42:02,469 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2025-10-08T00:42:02,470 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2025-10-08T00:42:02,471 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2025-10-08T00:42:02,472 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2025-10-08T00:42:02,473 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2025-10-08T00:42:02,473 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2025-10-08T00:42:02,474 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2025-10-08T00:42:02,474 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2025-10-08T00:42:02,475 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2025-10-08T00:42:02,475 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2025-10-08T00:42:02,476 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2025-10-08T00:42:02,477 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2025-10-08T00:42:02,478 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2025-10-08T00:42:02,478 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2025-10-08T00:42:02,479 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2025-10-08T00:42:02,480 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2025-10-08T00:42:02,481 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2025-10-08T00:42:02,481 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2025-10-08T00:42:02,482 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2025-10-08T00:42:02,483 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2025-10-08T00:42:02,483 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2025-10-08T00:42:02,484 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2025-10-08T00:42:02,485 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2025-10-08T00:42:02,485 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2025-10-08T00:42:02,486 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2025-10-08T00:42:02,487 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2025-10-08T00:42:02,487 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2025-10-08T00:42:02,488 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2025-10-08T00:42:02,489 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2025-10-08T00:42:02,489 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2025-10-08T00:42:02,490 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2025-10-08T00:42:02,491 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2025-10-08T00:42:02,492 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2025-10-08T00:42:02,492 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,493 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2025-10-08T00:42:02,494 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,494 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2025-10-08T00:42:02,495 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2025-10-08T00:42:02,496 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2025-10-08T00:42:02,497 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2025-10-08T00:42:02,497 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2025-10-08T00:42:02,498 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2025-10-08T00:42:02,498 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2025-10-08T00:42:02,499 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2025-10-08T00:42:02,500 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,500 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,501 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,501 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2025-10-08T00:42:02,502 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,503 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,503 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,504 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2025-10-08T00:42:02,505 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,505 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,506 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-08T00:42:02,507 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2025-10-08T00:42:02,507 Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6 2025-10-08T00:42:02,508 Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7 2025-10-08T00:42:02,509 Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8 2025-10-08T00:42:02,509 Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9 2025-10-08T00:42:02,510 Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0 2025-10-08T00:42:02,510 Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1 2025-10-08T00:42:02,511 Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2 2025-10-08T00:42:02,512 Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3 2025-10-08T00:42:02,512 Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4 2025-10-08T00:42:02,513 Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5 2025-10-08T00:42:02,514 Found link https://files.pythonhosted.org/packages/d4/a9/6130c78d84980ed636092be1a262d6429d539105724e675b6f65ef74a05e/deepspeed-0.17.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.6 2025-10-08T00:42:02,515 Found link https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.0 2025-10-08T00:42:02,515 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2025-10-08T00:42:02,516 Getting page https://www.piwheels.org/simple/deepspeed/ 2025-10-08T00:42:02,517 Found index url https://www.piwheels.org/simple 2025-10-08T00:42:02,683 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2025-10-08T00:42:02,707 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.6-py3-none-any.whl#sha256=6142b8dbad6e01ce0890830a65ca1c102f2bf8216edcca0ba86b7c81febd2754 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.5-py3-none-any.whl#sha256=2fcd7e824802bae8190b39577b346f58a20cba5bd72a63f4fd6a8d9b7ef8e498 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,709 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.4-py3-none-any.whl#sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,709 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,710 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,710 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,711 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,711 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,712 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,713 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,714 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,715 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,716 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,716 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,717 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,718 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,718 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,719 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,719 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,720 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,720 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,721 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,721 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,722 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,723 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,723 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,724 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,724 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,725 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,726 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,726 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,727 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,728 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,728 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,729 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,729 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,730 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,730 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,731 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,731 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,732 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,733 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,733 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,734 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,734 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,735 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,736 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,736 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,737 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,737 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,738 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,738 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,739 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,739 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,740 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,741 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,741 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,742 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,743 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,743 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,744 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,745 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,745 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,746 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,746 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,747 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,747 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,748 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,748 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,749 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,750 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,750 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,751 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,751 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,752 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,753 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,753 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,754 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,754 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,755 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,755 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,756 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,756 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,757 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,758 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,759 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,759 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,760 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-08T00:42:02,760 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2025-10-08T00:42:02,761 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2025-10-08T00:42:02,793 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2025-10-08T00:42:02,812 Collecting deepspeed==0.18.0 2025-10-08T00:42:02,814 Created temporary directory: /tmp/pip-unpack-i_v10grn 2025-10-08T00:42:02,951 Downloading deepspeed-0.18.0.tar.gz (1.6 MB) 2025-10-08T00:42:05,691 Added deepspeed==0.18.0 from https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz to build tracker '/tmp/pip-build-tracker-501dt203' 2025-10-08T00:42:05,692 Running setup.py (path:/tmp/pip-wheel-kagheuet/deepspeed_394d138c5b4c4dadb02f85869f34a567/setup.py) egg_info for package deepspeed 2025-10-08T00:42:05,693 Created temporary directory: /tmp/pip-pip-egg-info-_b_z1qcn 2025-10-08T00:42:05,694 Preparing metadata (setup.py): started 2025-10-08T00:42:05,695 Running command python setup.py egg_info 2025-10-08T00:42:06,729 fatal: not a git repository (or any of the parent directories): .git 2025-10-08T00:42:07,230 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-10-08T00:42:07,230  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-10-08T00:42:07,231 DS_BUILD_OPS=0 2025-10-08T00:42:07,231 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-10-08T00:42:07,232 version=0.18.0, git_hash=unknown, git_branch=unknown 2025-10-08T00:42:07,232 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-10-08T00:42:07,233 ext_modules=[] 2025-10-08T00:42:07,234 running egg_info 2025-10-08T00:42:07,261 creating /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info 2025-10-08T00:42:07,262 writing /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/PKG-INFO 2025-10-08T00:42:07,301 writing dependency_links to /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/dependency_links.txt 2025-10-08T00:42:07,303 writing entry points to /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/entry_points.txt 2025-10-08T00:42:07,325 writing requirements to /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/requires.txt 2025-10-08T00:42:07,326 writing top-level names to /tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/top_level.txt 2025-10-08T00:42:07,328 writing manifest file '/tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/SOURCES.txt' 2025-10-08T00:42:07,589 reading manifest file '/tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/SOURCES.txt' 2025-10-08T00:42:07,591 reading manifest template 'MANIFEST.in' 2025-10-08T00:42:07,593 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-10-08T00:42:07,594 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-10-08T00:42:09,442 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-10-08T00:42:10,537 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-10-08T00:42:11,290 warning: no files found matching '*.tr' under directory 'csrc' 2025-10-08T00:42:11,430 warning: no files found matching '*.cc' under directory 'csrc' 2025-10-08T00:42:11,485 warning: no files found matching '*.py' under directory 'benchmarks' 2025-10-08T00:42:11,493 adding license file 'LICENSE' 2025-10-08T00:42:11,534 writing manifest file '/tmp/pip-pip-egg-info-_b_z1qcn/deepspeed.egg-info/SOURCES.txt' 2025-10-08T00:42:11,538 deepspeed build time = 4.805116653442383 secs 2025-10-08T00:42:11,654 Preparing metadata (setup.py): finished with status 'done' 2025-10-08T00:42:11,660 Source in /tmp/pip-wheel-kagheuet/deepspeed_394d138c5b4c4dadb02f85869f34a567 has version 0.18.0, which satisfies requirement deepspeed==0.18.0 from https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz 2025-10-08T00:42:11,661 Removed deepspeed==0.18.0 from https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz from build tracker '/tmp/pip-build-tracker-501dt203' 2025-10-08T00:42:11,671 Created temporary directory: /tmp/pip-unpack-3m3w_cqe 2025-10-08T00:42:11,672 Building wheels for collected packages: deepspeed 2025-10-08T00:42:11,677 Created temporary directory: /tmp/pip-wheel-1sx2m2lh 2025-10-08T00:42:11,678 Building wheel for deepspeed (setup.py): started 2025-10-08T00:42:11,679 Destination directory: /tmp/pip-wheel-1sx2m2lh 2025-10-08T00:42:11,679 Running command python setup.py bdist_wheel 2025-10-08T00:42:12,201 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-10-08T00:42:12,204  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-10-08T00:42:12,338 DS_BUILD_OPS=0 2025-10-08T00:42:12,453 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-10-08T00:42:12,473 fatal: not a git repository (or any of the parent directories): .git 2025-10-08T00:42:12,474 version=0.18.0, git_hash=unknown, git_branch=unknown 2025-10-08T00:42:12,475 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-10-08T00:42:12,476 ext_modules=[] 2025-10-08T00:42:12,877 running bdist_wheel 2025-10-08T00:42:13,014 running build 2025-10-08T00:42:13,015 running build_py 2025-10-08T00:42:13,046 creating build/lib/deepspeed 2025-10-08T00:42:13,048 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2025-10-08T00:42:13,050 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2025-10-08T00:42:13,052 copying deepspeed/__init__.py -> build/lib/deepspeed 2025-10-08T00:42:13,055 copying deepspeed/constants.py -> build/lib/deepspeed 2025-10-08T00:42:13,057 copying deepspeed/env_report.py -> build/lib/deepspeed 2025-10-08T00:42:13,060 creating build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,061 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,064 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,066 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,069 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,071 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,073 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,075 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,077 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,079 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,082 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2025-10-08T00:42:13,085 creating build/lib/deepspeed/nebula 2025-10-08T00:42:13,086 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2025-10-08T00:42:13,088 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2025-10-08T00:42:13,090 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2025-10-08T00:42:13,093 creating build/lib/deepspeed/nvme 2025-10-08T00:42:13,094 copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,096 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,099 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,101 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,103 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,105 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,107 copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,109 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,111 copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,112 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,114 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,116 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,119 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,121 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,123 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,124 copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme 2025-10-08T00:42:13,127 creating build/lib/deepspeed/module_inject 2025-10-08T00:42:13,128 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,131 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,133 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,135 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,139 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,142 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,144 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,146 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,148 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,151 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,153 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,156 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,158 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2025-10-08T00:42:13,161 creating build/lib/deepspeed/elasticity 2025-10-08T00:42:13,162 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,164 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,166 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,169 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,171 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,173 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2025-10-08T00:42:13,177 creating build/lib/deepspeed/compile 2025-10-08T00:42:13,178 copying deepspeed/compile/config.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,180 copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,183 copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,185 copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,187 copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,189 copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,191 copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,194 copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,197 copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,199 copying deepspeed/compile/util.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,201 copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,203 copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,205 copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,207 copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile 2025-10-08T00:42:13,210 creating build/lib/deepspeed/pipe 2025-10-08T00:42:13,211 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2025-10-08T00:42:13,214 creating build/lib/deepspeed/autotuning 2025-10-08T00:42:13,215 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,218 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,220 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,222 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,225 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,228 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2025-10-08T00:42:13,231 creating build/lib/deepspeed/moe 2025-10-08T00:42:13,232 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,234 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,236 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,239 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,241 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,243 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2025-10-08T00:42:13,247 creating build/lib/deepspeed/ops 2025-10-08T00:42:13,248 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2025-10-08T00:42:13,250 creating build/lib/deepspeed/profiling 2025-10-08T00:42:13,251 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2025-10-08T00:42:13,253 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2025-10-08T00:42:13,255 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2025-10-08T00:42:13,258 creating build/lib/deepspeed/accelerator 2025-10-08T00:42:13,259 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,262 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,264 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,267 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,269 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,271 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,274 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,276 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,279 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,282 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,284 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-08T00:42:13,287 creating build/lib/deepspeed/sequence 2025-10-08T00:42:13,289 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2025-10-08T00:42:13,291 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2025-10-08T00:42:13,294 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2025-10-08T00:42:13,296 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2025-10-08T00:42:13,299 creating build/lib/deepspeed/model_implementations 2025-10-08T00:42:13,300 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2025-10-08T00:42:13,302 creating build/lib/deepspeed/inference 2025-10-08T00:42:13,303 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2025-10-08T00:42:13,306 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2025-10-08T00:42:13,307 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2025-10-08T00:42:13,311 creating build/lib/deepspeed/linear 2025-10-08T00:42:13,312 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2025-10-08T00:42:13,314 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2025-10-08T00:42:13,316 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2025-10-08T00:42:13,319 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2025-10-08T00:42:13,321 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2025-10-08T00:42:13,323 creating build/lib/deepspeed/launcher 2025-10-08T00:42:13,324 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,326 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,329 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,332 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,334 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,336 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2025-10-08T00:42:13,340 creating build/lib/deepspeed/io 2025-10-08T00:42:13,341 copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,343 copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,345 copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,347 copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,349 copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,351 copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,353 copying deepspeed/io/__init__.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,355 copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,357 copying deepspeed/io/utils.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,359 copying deepspeed/io/constants.py -> build/lib/deepspeed/io 2025-10-08T00:42:13,362 creating build/lib/deepspeed/runtime 2025-10-08T00:42:13,363 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,366 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,368 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,371 copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,374 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,377 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,380 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,383 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,385 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,387 copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,389 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,392 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,394 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,397 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,399 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,401 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,407 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,409 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,412 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,414 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2025-10-08T00:42:13,417 creating build/lib/deepspeed/monitor 2025-10-08T00:42:13,418 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,420 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,422 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,424 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,426 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,428 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,430 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,432 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2025-10-08T00:42:13,434 creating build/lib/deepspeed/comm 2025-10-08T00:42:13,435 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,437 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,440 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,442 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,444 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,446 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,448 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,450 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,452 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2025-10-08T00:42:13,456 creating build/lib/deepspeed/compression 2025-10-08T00:42:13,457 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,460 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,462 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,464 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,466 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,469 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,472 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,474 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2025-10-08T00:42:13,478 creating build/lib/deepspeed/utils 2025-10-08T00:42:13,479 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,481 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,483 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,485 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,488 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,490 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,492 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,494 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,496 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,498 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,501 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,504 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,506 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,509 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,511 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,513 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,515 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,518 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2025-10-08T00:42:13,521 creating build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,522 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,525 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,527 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,529 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,531 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,534 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,536 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,539 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,541 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,543 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,546 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,548 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,551 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,553 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,555 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,557 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,560 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,562 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,564 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2025-10-08T00:42:13,568 creating build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,569 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,572 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,575 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,577 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,579 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,581 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,583 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-08T00:42:13,586 creating build/lib/deepspeed/compile/profilers 2025-10-08T00:42:13,587 copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers 2025-10-08T00:42:13,589 copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers 2025-10-08T00:42:13,592 copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers 2025-10-08T00:42:13,595 creating build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,596 copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,598 copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,600 copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,602 copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,605 copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,607 copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,610 copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,613 copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes 2025-10-08T00:42:13,616 creating build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,617 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,620 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,622 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,624 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,626 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,628 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2025-10-08T00:42:13,631 creating build/lib/deepspeed/ops/compile 2025-10-08T00:42:13,632 copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile 2025-10-08T00:42:13,634 creating build/lib/deepspeed/ops/transformer 2025-10-08T00:42:13,635 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2025-10-08T00:42:13,638 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2025-10-08T00:42:13,641 creating build/lib/deepspeed/ops/quantizer 2025-10-08T00:42:13,642 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2025-10-08T00:42:13,644 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2025-10-08T00:42:13,647 creating build/lib/deepspeed/ops/random_ltd 2025-10-08T00:42:13,648 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2025-10-08T00:42:13,650 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2025-10-08T00:42:13,653 creating build/lib/deepspeed/ops/adagrad 2025-10-08T00:42:13,654 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2025-10-08T00:42:13,657 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2025-10-08T00:42:13,660 creating build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,661 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,663 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,665 copying deepspeed/ops/adam/zenflow_cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,668 copying deepspeed/ops/adam/zenflow_torch_adam.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,671 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,673 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-10-08T00:42:13,676 creating build/lib/deepspeed/ops/deepspeed4science 2025-10-08T00:42:13,677 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2025-10-08T00:42:13,680 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2025-10-08T00:42:13,682 creating build/lib/deepspeed/ops/gds 2025-10-08T00:42:13,683 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2025-10-08T00:42:13,686 creating build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,687 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,690 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,692 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,694 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,696 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,698 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,700 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,702 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,706 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,708 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,710 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,712 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,714 copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,716 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,718 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,720 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,723 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,725 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,727 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,729 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,731 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,734 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,736 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,738 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,740 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,743 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-10-08T00:42:13,745 creating build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,747 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,749 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,751 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,754 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,756 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,759 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,762 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-08T00:42:13,765 creating build/lib/deepspeed/ops/aio 2025-10-08T00:42:13,766 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2025-10-08T00:42:13,768 creating build/lib/deepspeed/ops/fp_quantizer 2025-10-08T00:42:13,770 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-08T00:42:13,772 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-08T00:42:13,774 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-08T00:42:13,776 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-08T00:42:13,779 creating build/lib/deepspeed/ops/lamb 2025-10-08T00:42:13,780 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2025-10-08T00:42:13,782 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2025-10-08T00:42:13,785 creating build/lib/deepspeed/ops/lion 2025-10-08T00:42:13,786 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2025-10-08T00:42:13,788 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2025-10-08T00:42:13,790 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2025-10-08T00:42:13,793 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2025-10-08T00:42:13,795 creating build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,796 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,799 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,801 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,804 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,806 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,808 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,811 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,813 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,815 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,817 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-08T00:42:13,820 creating build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,822 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,824 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,826 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,828 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,830 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,832 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,834 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,837 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,839 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,841 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:13,845 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,846 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,848 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,850 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,852 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,854 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,856 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,858 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,861 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,863 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,865 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,867 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,869 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,871 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,874 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,876 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,878 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,881 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,883 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,885 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,887 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,889 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,891 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,893 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:13,895 creating build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,896 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,899 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,901 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,902 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,904 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,906 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:13,909 creating build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,910 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,912 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,914 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,916 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,918 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:13,921 creating build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,922 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,924 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,926 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,928 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,930 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,932 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,934 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:13,937 creating build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,938 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,940 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,943 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,945 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,947 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,949 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,951 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,953 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,955 copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,957 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:13,960 creating build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,961 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,963 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,965 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,967 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,969 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,971 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,973 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:13,975 creating build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,976 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,979 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,981 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,983 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,985 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,987 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,989 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,991 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,994 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-08T00:42:13,996 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:13,997 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:14,000 creating build/lib/deepspeed/profiling/flops_profiler 2025-10-08T00:42:14,001 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2025-10-08T00:42:14,005 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2025-10-08T00:42:14,008 creating build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,009 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,011 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,013 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,015 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,017 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,019 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,021 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,023 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,025 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,028 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-08T00:42:14,030 creating build/lib/deepspeed/model_implementations/features 2025-10-08T00:42:14,031 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2025-10-08T00:42:14,033 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2025-10-08T00:42:14,035 creating build/lib/deepspeed/model_implementations/diffusers 2025-10-08T00:42:14,036 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-08T00:42:14,039 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-08T00:42:14,041 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-08T00:42:14,043 creating build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,045 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,047 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,049 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,051 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,053 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2025-10-08T00:42:14,056 creating build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,057 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,059 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,061 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,063 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,065 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,068 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,070 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,072 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,075 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2025-10-08T00:42:14,077 creating build/lib/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:14,078 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:14,080 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:14,083 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:14,085 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:14,088 creating build/lib/deepspeed/inference/v2/kernels 2025-10-08T00:42:14,089 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2025-10-08T00:42:14,091 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2025-10-08T00:42:14,094 creating build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,095 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,097 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,100 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,102 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,104 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,107 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,110 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:14,113 creating build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,114 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,116 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,119 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,122 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,124 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,126 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,128 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-08T00:42:14,131 creating build/lib/deepspeed/inference/v2/modules 2025-10-08T00:42:14,132 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2025-10-08T00:42:14,135 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2025-10-08T00:42:14,137 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2025-10-08T00:42:14,139 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2025-10-08T00:42:14,143 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:14,144 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:14,147 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:14,149 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:14,152 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:14,153 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:14,156 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:14,158 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:14,161 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:14,164 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:14,165 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:14,168 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:14,171 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:14,172 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:14,174 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:14,178 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:14,179 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:14,181 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:14,184 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:14,186 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:14,188 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:14,191 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:14,193 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:14,195 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:14,199 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:14,200 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:14,203 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:14,205 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:14,208 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:14,211 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:14,212 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:14,215 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:14,218 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,220 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,222 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,225 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,227 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,230 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:14,233 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:14,234 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:14,237 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:14,240 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:14,241 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:14,243 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:14,245 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:14,247 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:14,250 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:14,251 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:14,253 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:14,255 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:14,257 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:14,259 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:14,261 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:14,263 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:14,265 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:14,267 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:14,268 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:14,271 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:14,273 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:14,275 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:14,276 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:14,279 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:14,281 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:14,283 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:14,285 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:14,287 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:14,289 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:14,292 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:14,293 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:14,295 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:14,298 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:14,300 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:14,302 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:14,304 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:14,306 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:14,308 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:14,310 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:14,313 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:14,314 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:14,316 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:14,318 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:14,320 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:14,323 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,324 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,327 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,329 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,332 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,333 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,335 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,338 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,340 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,342 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:14,345 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:14,346 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:14,348 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:14,350 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:14,352 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:14,355 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:14,357 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:14,359 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:14,361 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:14,363 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:14,366 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:14,367 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:14,369 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:14,371 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:14,373 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:14,376 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:14,378 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:14,380 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:14,382 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:14,384 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:14,387 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,388 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,390 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,392 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,394 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,396 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,399 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,401 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,403 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,405 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:14,407 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:14,408 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:14,411 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:14,413 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:14,415 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:14,418 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:14,419 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:14,421 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:14,423 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:14,425 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:14,428 creating build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,429 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,432 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,434 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,436 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,438 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,440 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,442 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:14,444 creating build/lib/deepspeed/inference/v2/modules/implementations 2025-10-08T00:42:14,446 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2025-10-08T00:42:14,449 creating build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,450 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,452 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,454 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,457 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,459 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,461 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,463 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,465 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:14,467 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:14,468 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:14,471 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:14,473 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:14,474 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:14,477 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:14,479 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:14,481 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:14,483 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:14,485 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:14,486 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:14,489 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:14,491 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:14,494 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:14,495 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:14,497 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:14,500 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:14,501 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:14,503 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:14,505 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:14,508 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:14,509 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:14,511 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:14,514 creating build/lib/deepspeed/runtime/sequence_parallel 2025-10-08T00:42:14,516 copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-08T00:42:14,519 copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-08T00:42:14,521 copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-08T00:42:14,524 creating build/lib/deepspeed/runtime/superoffload 2025-10-08T00:42:14,525 copying deepspeed/runtime/superoffload/superoffload_stage3.py -> build/lib/deepspeed/runtime/superoffload 2025-10-08T00:42:14,528 copying deepspeed/runtime/superoffload/__init__.py -> build/lib/deepspeed/runtime/superoffload 2025-10-08T00:42:14,530 copying deepspeed/runtime/superoffload/superoffload_utils.py -> build/lib/deepspeed/runtime/superoffload 2025-10-08T00:42:14,533 creating build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,534 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,537 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,542 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,544 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,546 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,548 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,551 copying deepspeed/runtime/zero/leaf_module_config.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,553 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,555 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,558 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,560 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,563 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,565 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,568 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,572 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,575 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,578 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,582 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2025-10-08T00:42:14,586 creating build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,587 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,590 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,592 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,594 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,597 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,600 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2025-10-08T00:42:14,603 creating build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,604 copying deepspeed/runtime/zenflow/__init__.py -> build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,607 copying deepspeed/runtime/zenflow/zenflow_utils.py -> build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,609 copying deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,612 copying deepspeed/runtime/zenflow/engine.py -> build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,615 copying deepspeed/runtime/zenflow/zenflow_config.py -> build/lib/deepspeed/runtime/zenflow 2025-10-08T00:42:14,618 creating build/lib/deepspeed/runtime/data_pipeline 2025-10-08T00:42:14,619 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-08T00:42:14,621 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-08T00:42:14,623 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-08T00:42:14,626 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-08T00:42:14,629 creating build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,630 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,632 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,634 copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,636 copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,638 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,640 copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,643 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:14,646 creating build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,647 copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,649 copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,651 copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,653 copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,656 copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,658 copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:14,661 creating build/lib/deepspeed/runtime/fp16 2025-10-08T00:42:14,662 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-10-08T00:42:14,665 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-10-08T00:42:14,668 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2025-10-08T00:42:14,670 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2025-10-08T00:42:14,674 creating build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,675 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,678 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,681 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,683 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,685 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,688 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,690 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,692 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,695 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-08T00:42:14,697 creating build/lib/deepspeed/runtime/tensor_parallel 2025-10-08T00:42:14,699 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-08T00:42:14,701 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-08T00:42:14,703 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-08T00:42:14,705 creating build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,706 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,709 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,712 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,714 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,716 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,719 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2025-10-08T00:42:14,722 creating build/lib/deepspeed/runtime/compression 2025-10-08T00:42:14,723 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2025-10-08T00:42:14,725 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2025-10-08T00:42:14,727 creating build/lib/deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:14,728 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:14,731 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:14,734 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:14,737 creating build/lib/deepspeed/runtime/domino 2025-10-08T00:42:14,738 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2025-10-08T00:42:14,741 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2025-10-08T00:42:14,743 copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino 2025-10-08T00:42:14,746 creating build/lib/deepspeed/runtime/zero/muon 2025-10-08T00:42:14,747 copying deepspeed/runtime/zero/muon/muon_optimizer.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-08T00:42:14,749 copying deepspeed/runtime/zero/muon/__init__.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-08T00:42:14,751 copying deepspeed/runtime/zero/muon/original_muon.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-08T00:42:14,754 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,755 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,757 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,760 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,762 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,764 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:14,768 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,769 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,771 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,774 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,777 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,779 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,782 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:14,785 creating build/lib/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:14,787 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:14,789 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:14,791 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:14,794 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:14,798 running egg_info 2025-10-08T00:42:14,827 writing deepspeed.egg-info/PKG-INFO 2025-10-08T00:42:14,865 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2025-10-08T00:42:14,867 writing entry points to deepspeed.egg-info/entry_points.txt 2025-10-08T00:42:14,889 writing requirements to deepspeed.egg-info/requires.txt 2025-10-08T00:42:14,891 writing top-level names to deepspeed.egg-info/top_level.txt 2025-10-08T00:42:15,037 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-10-08T00:42:15,127 reading manifest template 'MANIFEST.in' 2025-10-08T00:42:15,129 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-10-08T00:42:15,129 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-10-08T00:42:16,989 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-10-08T00:42:18,139 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-10-08T00:42:18,904 warning: no files found matching '*.tr' under directory 'csrc' 2025-10-08T00:42:19,047 warning: no files found matching '*.cc' under directory 'csrc' 2025-10-08T00:42:19,099 warning: no files found matching '*.py' under directory 'benchmarks' 2025-10-08T00:42:19,106 adding license file 'LICENSE' 2025-10-08T00:42:19,161 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-10-08T00:42:19,169 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2025-10-08T00:42:19,170 !! 2025-10-08T00:42:19,171 ******************************************************************************** 2025-10-08T00:42:19,172 ############################ 2025-10-08T00:42:19,172 # Package would be ignored # 2025-10-08T00:42:19,173 ############################ 2025-10-08T00:42:19,174 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2025-10-08T00:42:19,174 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,176 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,176 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2025-10-08T00:42:19,177 to the `packages` configuration field. 2025-10-08T00:42:19,178 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,178 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,179 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,179 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,180 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,181 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2025-10-08T00:42:19,182 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2025-10-08T00:42:19,182 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,182 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,183 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,184 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,185 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,186 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,187 even if it does not contain any `.py` files. 2025-10-08T00:42:19,187 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,188 directory, all directories are treated like packages. 2025-10-08T00:42:19,188 ******************************************************************************** 2025-10-08T00:42:19,190 !! 2025-10-08T00:42:19,190 check.warn(importable) 2025-10-08T00:42:19,191 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2025-10-08T00:42:19,192 !! 2025-10-08T00:42:19,193 ******************************************************************************** 2025-10-08T00:42:19,194 ############################ 2025-10-08T00:42:19,194 # Package would be ignored # 2025-10-08T00:42:19,195 ############################ 2025-10-08T00:42:19,195 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2025-10-08T00:42:19,196 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,197 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,197 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2025-10-08T00:42:19,198 to the `packages` configuration field. 2025-10-08T00:42:19,199 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,199 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,200 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,201 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,202 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,203 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2025-10-08T00:42:19,204 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2025-10-08T00:42:19,204 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,205 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,205 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,206 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,207 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,208 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,208 even if it does not contain any `.py` files. 2025-10-08T00:42:19,209 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,209 directory, all directories are treated like packages. 2025-10-08T00:42:19,210 ******************************************************************************** 2025-10-08T00:42:19,210 !! 2025-10-08T00:42:19,211 check.warn(importable) 2025-10-08T00:42:19,211 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2025-10-08T00:42:19,211 !! 2025-10-08T00:42:19,212 ******************************************************************************** 2025-10-08T00:42:19,212 ############################ 2025-10-08T00:42:19,213 # Package would be ignored # 2025-10-08T00:42:19,213 ############################ 2025-10-08T00:42:19,214 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2025-10-08T00:42:19,214 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,215 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,216 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2025-10-08T00:42:19,216 to the `packages` configuration field. 2025-10-08T00:42:19,217 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,218 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,218 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,219 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,220 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,221 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2025-10-08T00:42:19,221 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2025-10-08T00:42:19,222 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,222 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,223 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,224 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,225 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,226 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,227 even if it does not contain any `.py` files. 2025-10-08T00:42:19,227 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,228 directory, all directories are treated like packages. 2025-10-08T00:42:19,228 ******************************************************************************** 2025-10-08T00:42:19,230 !! 2025-10-08T00:42:19,230 check.warn(importable) 2025-10-08T00:42:19,230 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,231 !! 2025-10-08T00:42:19,231 ******************************************************************************** 2025-10-08T00:42:19,232 ############################ 2025-10-08T00:42:19,232 # Package would be ignored # 2025-10-08T00:42:19,232 ############################ 2025-10-08T00:42:19,233 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2025-10-08T00:42:19,233 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,234 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,234 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2025-10-08T00:42:19,235 to the `packages` configuration field. 2025-10-08T00:42:19,235 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,236 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,236 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,237 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,238 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,239 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2025-10-08T00:42:19,239 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2025-10-08T00:42:19,240 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,240 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,241 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,242 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,243 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,245 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,245 even if it does not contain any `.py` files. 2025-10-08T00:42:19,246 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,246 directory, all directories are treated like packages. 2025-10-08T00:42:19,247 ******************************************************************************** 2025-10-08T00:42:19,248 !! 2025-10-08T00:42:19,248 check.warn(importable) 2025-10-08T00:42:19,249 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,250 !! 2025-10-08T00:42:19,251 ******************************************************************************** 2025-10-08T00:42:19,251 ############################ 2025-10-08T00:42:19,252 # Package would be ignored # 2025-10-08T00:42:19,252 ############################ 2025-10-08T00:42:19,253 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2025-10-08T00:42:19,253 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,254 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,255 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2025-10-08T00:42:19,255 to the `packages` configuration field. 2025-10-08T00:42:19,257 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,257 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,257 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,258 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,259 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,259 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2025-10-08T00:42:19,260 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2025-10-08T00:42:19,260 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,261 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,261 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,262 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,263 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,264 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,265 even if it does not contain any `.py` files. 2025-10-08T00:42:19,265 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,265 directory, all directories are treated like packages. 2025-10-08T00:42:19,266 ******************************************************************************** 2025-10-08T00:42:19,267 !! 2025-10-08T00:42:19,268 check.warn(importable) 2025-10-08T00:42:19,268 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2025-10-08T00:42:19,269 !! 2025-10-08T00:42:19,270 ******************************************************************************** 2025-10-08T00:42:19,270 ############################ 2025-10-08T00:42:19,271 # Package would be ignored # 2025-10-08T00:42:19,271 ############################ 2025-10-08T00:42:19,272 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2025-10-08T00:42:19,273 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,274 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,274 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2025-10-08T00:42:19,275 to the `packages` configuration field. 2025-10-08T00:42:19,276 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,276 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,277 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,278 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,279 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,280 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2025-10-08T00:42:19,280 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2025-10-08T00:42:19,281 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,281 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,282 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,283 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,284 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,285 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,285 even if it does not contain any `.py` files. 2025-10-08T00:42:19,286 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,286 directory, all directories are treated like packages. 2025-10-08T00:42:19,286 ******************************************************************************** 2025-10-08T00:42:19,287 !! 2025-10-08T00:42:19,287 check.warn(importable) 2025-10-08T00:42:19,288 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2025-10-08T00:42:19,288 !! 2025-10-08T00:42:19,289 ******************************************************************************** 2025-10-08T00:42:19,289 ############################ 2025-10-08T00:42:19,290 # Package would be ignored # 2025-10-08T00:42:19,290 ############################ 2025-10-08T00:42:19,290 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2025-10-08T00:42:19,291 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,291 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,292 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2025-10-08T00:42:19,292 to the `packages` configuration field. 2025-10-08T00:42:19,293 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,294 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,294 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,295 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,296 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,298 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2025-10-08T00:42:19,298 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2025-10-08T00:42:19,299 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,299 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,300 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,301 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,302 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,303 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,304 even if it does not contain any `.py` files. 2025-10-08T00:42:19,304 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,305 directory, all directories are treated like packages. 2025-10-08T00:42:19,305 ******************************************************************************** 2025-10-08T00:42:19,306 !! 2025-10-08T00:42:19,307 check.warn(importable) 2025-10-08T00:42:19,307 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,308 !! 2025-10-08T00:42:19,309 ******************************************************************************** 2025-10-08T00:42:19,309 ############################ 2025-10-08T00:42:19,310 # Package would be ignored # 2025-10-08T00:42:19,311 ############################ 2025-10-08T00:42:19,311 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2025-10-08T00:42:19,312 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,312 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,313 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2025-10-08T00:42:19,313 to the `packages` configuration field. 2025-10-08T00:42:19,314 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,314 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,314 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,315 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,316 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,317 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2025-10-08T00:42:19,317 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2025-10-08T00:42:19,317 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,318 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,318 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,319 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,320 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,321 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,322 even if it does not contain any `.py` files. 2025-10-08T00:42:19,323 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,323 directory, all directories are treated like packages. 2025-10-08T00:42:19,324 ******************************************************************************** 2025-10-08T00:42:19,325 !! 2025-10-08T00:42:19,325 check.warn(importable) 2025-10-08T00:42:19,326 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2025-10-08T00:42:19,326 !! 2025-10-08T00:42:19,328 ******************************************************************************** 2025-10-08T00:42:19,328 ############################ 2025-10-08T00:42:19,329 # Package would be ignored # 2025-10-08T00:42:19,329 ############################ 2025-10-08T00:42:19,330 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2025-10-08T00:42:19,330 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,331 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,332 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2025-10-08T00:42:19,332 to the `packages` configuration field. 2025-10-08T00:42:19,333 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,334 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,334 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,335 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,338 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,340 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2025-10-08T00:42:19,340 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2025-10-08T00:42:19,341 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,341 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,342 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,342 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,343 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,344 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,345 even if it does not contain any `.py` files. 2025-10-08T00:42:19,345 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,346 directory, all directories are treated like packages. 2025-10-08T00:42:19,346 ******************************************************************************** 2025-10-08T00:42:19,347 !! 2025-10-08T00:42:19,347 check.warn(importable) 2025-10-08T00:42:19,348 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2025-10-08T00:42:19,348 !! 2025-10-08T00:42:19,349 ******************************************************************************** 2025-10-08T00:42:19,349 ############################ 2025-10-08T00:42:19,350 # Package would be ignored # 2025-10-08T00:42:19,350 ############################ 2025-10-08T00:42:19,351 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2025-10-08T00:42:19,351 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,352 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,353 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2025-10-08T00:42:19,353 to the `packages` configuration field. 2025-10-08T00:42:19,354 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,355 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,355 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,356 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,358 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,359 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2025-10-08T00:42:19,359 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2025-10-08T00:42:19,360 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,360 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,361 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,362 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,363 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,364 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,365 even if it does not contain any `.py` files. 2025-10-08T00:42:19,365 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,366 directory, all directories are treated like packages. 2025-10-08T00:42:19,367 ******************************************************************************** 2025-10-08T00:42:19,368 !! 2025-10-08T00:42:19,368 check.warn(importable) 2025-10-08T00:42:19,369 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2025-10-08T00:42:19,369 !! 2025-10-08T00:42:19,370 ******************************************************************************** 2025-10-08T00:42:19,370 ############################ 2025-10-08T00:42:19,371 # Package would be ignored # 2025-10-08T00:42:19,371 ############################ 2025-10-08T00:42:19,371 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2025-10-08T00:42:19,372 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,372 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,373 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2025-10-08T00:42:19,373 to the `packages` configuration field. 2025-10-08T00:42:19,374 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,374 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,375 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,376 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,376 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,378 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2025-10-08T00:42:19,378 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2025-10-08T00:42:19,379 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,380 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,380 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,382 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,383 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,385 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,386 even if it does not contain any `.py` files. 2025-10-08T00:42:19,387 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,387 directory, all directories are treated like packages. 2025-10-08T00:42:19,388 ******************************************************************************** 2025-10-08T00:42:19,389 !! 2025-10-08T00:42:19,390 check.warn(importable) 2025-10-08T00:42:19,391 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2025-10-08T00:42:19,391 !! 2025-10-08T00:42:19,392 ******************************************************************************** 2025-10-08T00:42:19,393 ############################ 2025-10-08T00:42:19,394 # Package would be ignored # 2025-10-08T00:42:19,394 ############################ 2025-10-08T00:42:19,395 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2025-10-08T00:42:19,396 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,397 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,398 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2025-10-08T00:42:19,398 to the `packages` configuration field. 2025-10-08T00:42:19,400 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,401 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,401 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,402 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,403 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,404 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2025-10-08T00:42:19,405 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2025-10-08T00:42:19,405 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,406 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,406 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,407 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,408 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,410 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,410 even if it does not contain any `.py` files. 2025-10-08T00:42:19,411 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,411 directory, all directories are treated like packages. 2025-10-08T00:42:19,412 ******************************************************************************** 2025-10-08T00:42:19,413 !! 2025-10-08T00:42:19,413 check.warn(importable) 2025-10-08T00:42:19,414 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2025-10-08T00:42:19,414 !! 2025-10-08T00:42:19,416 ******************************************************************************** 2025-10-08T00:42:19,417 ############################ 2025-10-08T00:42:19,417 # Package would be ignored # 2025-10-08T00:42:19,418 ############################ 2025-10-08T00:42:19,419 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2025-10-08T00:42:19,420 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,421 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,422 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2025-10-08T00:42:19,422 to the `packages` configuration field. 2025-10-08T00:42:19,424 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,427 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,428 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,429 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,430 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,432 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2025-10-08T00:42:19,432 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2025-10-08T00:42:19,433 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,434 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,434 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,436 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,437 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,439 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,440 even if it does not contain any `.py` files. 2025-10-08T00:42:19,441 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,441 directory, all directories are treated like packages. 2025-10-08T00:42:19,442 ******************************************************************************** 2025-10-08T00:42:19,443 !! 2025-10-08T00:42:19,443 check.warn(importable) 2025-10-08T00:42:19,444 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration. 2025-10-08T00:42:19,444 !! 2025-10-08T00:42:19,445 ******************************************************************************** 2025-10-08T00:42:19,445 ############################ 2025-10-08T00:42:19,446 # Package would be ignored # 2025-10-08T00:42:19,446 ############################ 2025-10-08T00:42:19,447 Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1], 2025-10-08T00:42:19,447 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,448 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,449 package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added 2025-10-08T00:42:19,449 to the `packages` configuration field. 2025-10-08T00:42:19,450 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,451 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,451 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,452 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,453 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,455 If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are 2025-10-08T00:42:19,455 already explicitly excluding 'deepspeed.ops.csrc.compile' via 2025-10-08T00:42:19,456 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,457 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,458 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,459 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,460 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,462 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,463 even if it does not contain any `.py` files. 2025-10-08T00:42:19,463 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,464 directory, all directories are treated like packages. 2025-10-08T00:42:19,464 ******************************************************************************** 2025-10-08T00:42:19,466 !! 2025-10-08T00:42:19,466 check.warn(importable) 2025-10-08T00:42:19,467 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2025-10-08T00:42:19,467 !! 2025-10-08T00:42:19,469 ******************************************************************************** 2025-10-08T00:42:19,469 ############################ 2025-10-08T00:42:19,470 # Package would be ignored # 2025-10-08T00:42:19,471 ############################ 2025-10-08T00:42:19,471 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2025-10-08T00:42:19,472 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,474 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,474 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2025-10-08T00:42:19,475 to the `packages` configuration field. 2025-10-08T00:42:19,476 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,476 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,477 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,478 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,479 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,480 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2025-10-08T00:42:19,480 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2025-10-08T00:42:19,481 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,482 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,482 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,483 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,484 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,486 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,486 even if it does not contain any `.py` files. 2025-10-08T00:42:19,487 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,488 directory, all directories are treated like packages. 2025-10-08T00:42:19,488 ******************************************************************************** 2025-10-08T00:42:19,489 !! 2025-10-08T00:42:19,490 check.warn(importable) 2025-10-08T00:42:19,491 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2025-10-08T00:42:19,491 !! 2025-10-08T00:42:19,493 ******************************************************************************** 2025-10-08T00:42:19,494 ############################ 2025-10-08T00:42:19,494 # Package would be ignored # 2025-10-08T00:42:19,495 ############################ 2025-10-08T00:42:19,496 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2025-10-08T00:42:19,496 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,498 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,498 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2025-10-08T00:42:19,499 to the `packages` configuration field. 2025-10-08T00:42:19,500 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,501 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,502 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,503 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,506 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2025-10-08T00:42:19,506 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2025-10-08T00:42:19,507 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,508 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,508 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,510 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,511 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,513 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,513 even if it does not contain any `.py` files. 2025-10-08T00:42:19,514 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,514 directory, all directories are treated like packages. 2025-10-08T00:42:19,515 ******************************************************************************** 2025-10-08T00:42:19,516 !! 2025-10-08T00:42:19,516 check.warn(importable) 2025-10-08T00:42:19,517 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.riscv64' is absent from the `packages` configuration. 2025-10-08T00:42:19,517 !! 2025-10-08T00:42:19,518 ******************************************************************************** 2025-10-08T00:42:19,519 ############################ 2025-10-08T00:42:19,520 # Package would be ignored # 2025-10-08T00:42:19,520 ############################ 2025-10-08T00:42:19,521 Python recognizes 'deepspeed.ops.csrc.cpu.comm.riscv64' as an importable package[^1], 2025-10-08T00:42:19,521 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,522 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,523 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.riscv64' is explicitly added 2025-10-08T00:42:19,524 to the `packages` configuration field. 2025-10-08T00:42:19,525 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,526 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,526 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,528 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,529 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,531 If you don't want 'deepspeed.ops.csrc.cpu.comm.riscv64' to be distributed and are 2025-10-08T00:42:19,532 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.riscv64' via 2025-10-08T00:42:19,532 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,533 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,534 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,535 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,536 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,538 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,539 even if it does not contain any `.py` files. 2025-10-08T00:42:19,540 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,540 directory, all directories are treated like packages. 2025-10-08T00:42:19,541 ******************************************************************************** 2025-10-08T00:42:19,543 !! 2025-10-08T00:42:19,543 check.warn(importable) 2025-10-08T00:42:19,544 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.x86_64' is absent from the `packages` configuration. 2025-10-08T00:42:19,545 !! 2025-10-08T00:42:19,547 ******************************************************************************** 2025-10-08T00:42:19,547 ############################ 2025-10-08T00:42:19,548 # Package would be ignored # 2025-10-08T00:42:19,548 ############################ 2025-10-08T00:42:19,549 Python recognizes 'deepspeed.ops.csrc.cpu.comm.x86_64' as an importable package[^1], 2025-10-08T00:42:19,549 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,550 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,551 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.x86_64' is explicitly added 2025-10-08T00:42:19,551 to the `packages` configuration field. 2025-10-08T00:42:19,552 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,553 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,554 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,555 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,556 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,557 If you don't want 'deepspeed.ops.csrc.cpu.comm.x86_64' to be distributed and are 2025-10-08T00:42:19,557 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.x86_64' via 2025-10-08T00:42:19,558 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,559 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,559 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,560 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,562 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,564 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,565 even if it does not contain any `.py` files. 2025-10-08T00:42:19,565 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,566 directory, all directories are treated like packages. 2025-10-08T00:42:19,567 ******************************************************************************** 2025-10-08T00:42:19,568 !! 2025-10-08T00:42:19,569 check.warn(importable) 2025-10-08T00:42:19,570 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2025-10-08T00:42:19,570 !! 2025-10-08T00:42:19,572 ******************************************************************************** 2025-10-08T00:42:19,572 ############################ 2025-10-08T00:42:19,573 # Package would be ignored # 2025-10-08T00:42:19,574 ############################ 2025-10-08T00:42:19,574 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2025-10-08T00:42:19,575 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,576 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,577 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2025-10-08T00:42:19,577 to the `packages` configuration field. 2025-10-08T00:42:19,579 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,579 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,580 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,581 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,582 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,583 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2025-10-08T00:42:19,584 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2025-10-08T00:42:19,584 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,584 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,585 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,585 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,586 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,587 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,588 even if it does not contain any `.py` files. 2025-10-08T00:42:19,588 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,589 directory, all directories are treated like packages. 2025-10-08T00:42:19,589 ******************************************************************************** 2025-10-08T00:42:19,590 !! 2025-10-08T00:42:19,590 check.warn(importable) 2025-10-08T00:42:19,591 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2025-10-08T00:42:19,591 !! 2025-10-08T00:42:19,592 ******************************************************************************** 2025-10-08T00:42:19,592 ############################ 2025-10-08T00:42:19,593 # Package would be ignored # 2025-10-08T00:42:19,593 ############################ 2025-10-08T00:42:19,594 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2025-10-08T00:42:19,595 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,596 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,596 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2025-10-08T00:42:19,597 to the `packages` configuration field. 2025-10-08T00:42:19,598 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,599 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,599 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,601 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,602 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,603 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2025-10-08T00:42:19,603 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2025-10-08T00:42:19,604 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,604 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,605 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,606 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,607 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,609 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,609 even if it does not contain any `.py` files. 2025-10-08T00:42:19,610 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,611 directory, all directories are treated like packages. 2025-10-08T00:42:19,612 ******************************************************************************** 2025-10-08T00:42:19,612 !! 2025-10-08T00:42:19,613 check.warn(importable) 2025-10-08T00:42:19,613 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2025-10-08T00:42:19,613 !! 2025-10-08T00:42:19,614 ******************************************************************************** 2025-10-08T00:42:19,615 ############################ 2025-10-08T00:42:19,615 # Package would be ignored # 2025-10-08T00:42:19,616 ############################ 2025-10-08T00:42:19,616 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2025-10-08T00:42:19,617 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,618 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,618 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2025-10-08T00:42:19,618 to the `packages` configuration field. 2025-10-08T00:42:19,619 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,620 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,620 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,621 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,622 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,623 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2025-10-08T00:42:19,624 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2025-10-08T00:42:19,624 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,625 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,626 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,627 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,628 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,630 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,630 even if it does not contain any `.py` files. 2025-10-08T00:42:19,631 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,631 directory, all directories are treated like packages. 2025-10-08T00:42:19,632 ******************************************************************************** 2025-10-08T00:42:19,632 !! 2025-10-08T00:42:19,633 check.warn(importable) 2025-10-08T00:42:19,633 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2025-10-08T00:42:19,634 !! 2025-10-08T00:42:19,635 ******************************************************************************** 2025-10-08T00:42:19,636 ############################ 2025-10-08T00:42:19,636 # Package would be ignored # 2025-10-08T00:42:19,637 ############################ 2025-10-08T00:42:19,637 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2025-10-08T00:42:19,638 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,639 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,640 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2025-10-08T00:42:19,640 to the `packages` configuration field. 2025-10-08T00:42:19,641 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,641 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,642 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,642 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,643 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,644 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2025-10-08T00:42:19,644 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2025-10-08T00:42:19,645 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,645 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,645 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,646 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,647 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,648 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,649 even if it does not contain any `.py` files. 2025-10-08T00:42:19,649 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,650 directory, all directories are treated like packages. 2025-10-08T00:42:19,650 ******************************************************************************** 2025-10-08T00:42:19,651 !! 2025-10-08T00:42:19,652 check.warn(importable) 2025-10-08T00:42:19,652 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2025-10-08T00:42:19,653 !! 2025-10-08T00:42:19,654 ******************************************************************************** 2025-10-08T00:42:19,654 ############################ 2025-10-08T00:42:19,655 # Package would be ignored # 2025-10-08T00:42:19,656 ############################ 2025-10-08T00:42:19,656 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2025-10-08T00:42:19,657 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,658 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,658 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2025-10-08T00:42:19,659 to the `packages` configuration field. 2025-10-08T00:42:19,660 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,660 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,661 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,662 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,663 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,664 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2025-10-08T00:42:19,665 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2025-10-08T00:42:19,665 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,666 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,666 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,667 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,668 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,669 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,669 even if it does not contain any `.py` files. 2025-10-08T00:42:19,670 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,670 directory, all directories are treated like packages. 2025-10-08T00:42:19,670 ******************************************************************************** 2025-10-08T00:42:19,671 !! 2025-10-08T00:42:19,672 check.warn(importable) 2025-10-08T00:42:19,672 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2025-10-08T00:42:19,672 !! 2025-10-08T00:42:19,673 ******************************************************************************** 2025-10-08T00:42:19,673 ############################ 2025-10-08T00:42:19,674 # Package would be ignored # 2025-10-08T00:42:19,674 ############################ 2025-10-08T00:42:19,675 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2025-10-08T00:42:19,675 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,677 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,677 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2025-10-08T00:42:19,678 to the `packages` configuration field. 2025-10-08T00:42:19,679 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,679 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,680 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,681 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,682 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,683 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2025-10-08T00:42:19,683 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2025-10-08T00:42:19,684 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,684 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,685 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,686 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,687 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,689 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,690 even if it does not contain any `.py` files. 2025-10-08T00:42:19,690 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,691 directory, all directories are treated like packages. 2025-10-08T00:42:19,691 ******************************************************************************** 2025-10-08T00:42:19,693 !! 2025-10-08T00:42:19,693 check.warn(importable) 2025-10-08T00:42:19,693 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2025-10-08T00:42:19,694 !! 2025-10-08T00:42:19,694 ******************************************************************************** 2025-10-08T00:42:19,695 ############################ 2025-10-08T00:42:19,695 # Package would be ignored # 2025-10-08T00:42:19,695 ############################ 2025-10-08T00:42:19,696 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2025-10-08T00:42:19,696 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,697 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,697 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2025-10-08T00:42:19,698 to the `packages` configuration field. 2025-10-08T00:42:19,698 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,699 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,699 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,700 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,701 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,702 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2025-10-08T00:42:19,702 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2025-10-08T00:42:19,703 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,703 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,704 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,705 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,706 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,708 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,708 even if it does not contain any `.py` files. 2025-10-08T00:42:19,709 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,710 directory, all directories are treated like packages. 2025-10-08T00:42:19,710 ******************************************************************************** 2025-10-08T00:42:19,711 !! 2025-10-08T00:42:19,712 check.warn(importable) 2025-10-08T00:42:19,712 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,713 !! 2025-10-08T00:42:19,714 ******************************************************************************** 2025-10-08T00:42:19,714 ############################ 2025-10-08T00:42:19,715 # Package would be ignored # 2025-10-08T00:42:19,715 ############################ 2025-10-08T00:42:19,716 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2025-10-08T00:42:19,716 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,717 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,718 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2025-10-08T00:42:19,718 to the `packages` configuration field. 2025-10-08T00:42:19,720 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,720 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,721 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,721 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,722 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,723 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2025-10-08T00:42:19,723 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2025-10-08T00:42:19,724 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,724 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,724 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,725 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,726 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,727 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,728 even if it does not contain any `.py` files. 2025-10-08T00:42:19,728 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,729 directory, all directories are treated like packages. 2025-10-08T00:42:19,729 ******************************************************************************** 2025-10-08T00:42:19,730 !! 2025-10-08T00:42:19,730 check.warn(importable) 2025-10-08T00:42:19,731 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2025-10-08T00:42:19,732 !! 2025-10-08T00:42:19,733 ******************************************************************************** 2025-10-08T00:42:19,733 ############################ 2025-10-08T00:42:19,734 # Package would be ignored # 2025-10-08T00:42:19,734 ############################ 2025-10-08T00:42:19,735 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2025-10-08T00:42:19,735 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,737 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,737 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2025-10-08T00:42:19,738 to the `packages` configuration field. 2025-10-08T00:42:19,739 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,739 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,739 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,740 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,741 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,742 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2025-10-08T00:42:19,743 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2025-10-08T00:42:19,743 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,744 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,744 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,746 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,747 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,748 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,749 even if it does not contain any `.py` files. 2025-10-08T00:42:19,749 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,749 directory, all directories are treated like packages. 2025-10-08T00:42:19,750 ******************************************************************************** 2025-10-08T00:42:19,750 !! 2025-10-08T00:42:19,751 check.warn(importable) 2025-10-08T00:42:19,751 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,751 !! 2025-10-08T00:42:19,752 ******************************************************************************** 2025-10-08T00:42:19,753 ############################ 2025-10-08T00:42:19,753 # Package would be ignored # 2025-10-08T00:42:19,753 ############################ 2025-10-08T00:42:19,754 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2025-10-08T00:42:19,754 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,755 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,755 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2025-10-08T00:42:19,756 to the `packages` configuration field. 2025-10-08T00:42:19,757 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,757 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,758 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,759 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,760 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,761 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2025-10-08T00:42:19,762 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2025-10-08T00:42:19,763 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,763 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,764 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,765 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,766 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,768 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,768 even if it does not contain any `.py` files. 2025-10-08T00:42:19,769 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,769 directory, all directories are treated like packages. 2025-10-08T00:42:19,770 ******************************************************************************** 2025-10-08T00:42:19,771 !! 2025-10-08T00:42:19,772 check.warn(importable) 2025-10-08T00:42:19,772 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2025-10-08T00:42:19,773 !! 2025-10-08T00:42:19,774 ******************************************************************************** 2025-10-08T00:42:19,775 ############################ 2025-10-08T00:42:19,775 # Package would be ignored # 2025-10-08T00:42:19,776 ############################ 2025-10-08T00:42:19,777 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2025-10-08T00:42:19,777 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,778 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,779 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2025-10-08T00:42:19,779 to the `packages` configuration field. 2025-10-08T00:42:19,780 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,780 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,781 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,782 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,783 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,784 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2025-10-08T00:42:19,784 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2025-10-08T00:42:19,784 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,785 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,785 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,786 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,787 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,789 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,790 even if it does not contain any `.py` files. 2025-10-08T00:42:19,790 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,791 directory, all directories are treated like packages. 2025-10-08T00:42:19,791 ******************************************************************************** 2025-10-08T00:42:19,792 !! 2025-10-08T00:42:19,793 check.warn(importable) 2025-10-08T00:42:19,793 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2025-10-08T00:42:19,794 !! 2025-10-08T00:42:19,795 ******************************************************************************** 2025-10-08T00:42:19,795 ############################ 2025-10-08T00:42:19,796 # Package would be ignored # 2025-10-08T00:42:19,797 ############################ 2025-10-08T00:42:19,797 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2025-10-08T00:42:19,798 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,799 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,799 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2025-10-08T00:42:19,800 to the `packages` configuration field. 2025-10-08T00:42:19,801 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,802 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,802 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,803 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,804 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,806 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2025-10-08T00:42:19,806 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2025-10-08T00:42:19,807 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,807 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,808 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,809 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,810 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,811 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,812 even if it does not contain any `.py` files. 2025-10-08T00:42:19,812 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,813 directory, all directories are treated like packages. 2025-10-08T00:42:19,813 ******************************************************************************** 2025-10-08T00:42:19,814 !! 2025-10-08T00:42:19,814 check.warn(importable) 2025-10-08T00:42:19,815 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2025-10-08T00:42:19,815 !! 2025-10-08T00:42:19,816 ******************************************************************************** 2025-10-08T00:42:19,817 ############################ 2025-10-08T00:42:19,817 # Package would be ignored # 2025-10-08T00:42:19,818 ############################ 2025-10-08T00:42:19,818 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2025-10-08T00:42:19,819 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,820 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,820 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2025-10-08T00:42:19,821 to the `packages` configuration field. 2025-10-08T00:42:19,822 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,823 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,823 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,824 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,826 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,827 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2025-10-08T00:42:19,828 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2025-10-08T00:42:19,828 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,829 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,829 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,830 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,831 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,833 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,834 even if it does not contain any `.py` files. 2025-10-08T00:42:19,834 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,835 directory, all directories are treated like packages. 2025-10-08T00:42:19,835 ******************************************************************************** 2025-10-08T00:42:19,836 !! 2025-10-08T00:42:19,837 check.warn(importable) 2025-10-08T00:42:19,838 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2025-10-08T00:42:19,838 !! 2025-10-08T00:42:19,840 ******************************************************************************** 2025-10-08T00:42:19,840 ############################ 2025-10-08T00:42:19,840 # Package would be ignored # 2025-10-08T00:42:19,841 ############################ 2025-10-08T00:42:19,841 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2025-10-08T00:42:19,842 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,843 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,843 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2025-10-08T00:42:19,844 to the `packages` configuration field. 2025-10-08T00:42:19,844 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,845 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,845 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,846 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,847 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,848 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2025-10-08T00:42:19,849 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2025-10-08T00:42:19,849 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,850 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,850 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,851 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,852 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,854 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,854 even if it does not contain any `.py` files. 2025-10-08T00:42:19,855 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,855 directory, all directories are treated like packages. 2025-10-08T00:42:19,856 ******************************************************************************** 2025-10-08T00:42:19,857 !! 2025-10-08T00:42:19,857 check.warn(importable) 2025-10-08T00:42:19,858 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2025-10-08T00:42:19,858 !! 2025-10-08T00:42:19,859 ******************************************************************************** 2025-10-08T00:42:19,860 ############################ 2025-10-08T00:42:19,861 # Package would be ignored # 2025-10-08T00:42:19,861 ############################ 2025-10-08T00:42:19,862 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2025-10-08T00:42:19,862 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,863 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,864 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2025-10-08T00:42:19,864 to the `packages` configuration field. 2025-10-08T00:42:19,865 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,866 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,866 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,867 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,868 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,869 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2025-10-08T00:42:19,870 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2025-10-08T00:42:19,870 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,871 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,871 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,872 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,873 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,874 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,875 even if it does not contain any `.py` files. 2025-10-08T00:42:19,875 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,875 directory, all directories are treated like packages. 2025-10-08T00:42:19,876 ******************************************************************************** 2025-10-08T00:42:19,877 !! 2025-10-08T00:42:19,877 check.warn(importable) 2025-10-08T00:42:19,878 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2025-10-08T00:42:19,878 !! 2025-10-08T00:42:19,879 ******************************************************************************** 2025-10-08T00:42:19,880 ############################ 2025-10-08T00:42:19,880 # Package would be ignored # 2025-10-08T00:42:19,881 ############################ 2025-10-08T00:42:19,881 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2025-10-08T00:42:19,882 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,883 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,883 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2025-10-08T00:42:19,884 to the `packages` configuration field. 2025-10-08T00:42:19,885 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,885 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,886 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,887 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,888 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,889 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2025-10-08T00:42:19,890 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2025-10-08T00:42:19,890 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,891 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,891 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,893 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,894 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,895 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,896 even if it does not contain any `.py` files. 2025-10-08T00:42:19,897 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,897 directory, all directories are treated like packages. 2025-10-08T00:42:19,898 ******************************************************************************** 2025-10-08T00:42:19,899 !! 2025-10-08T00:42:19,899 check.warn(importable) 2025-10-08T00:42:19,900 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,900 !! 2025-10-08T00:42:19,901 ******************************************************************************** 2025-10-08T00:42:19,901 ############################ 2025-10-08T00:42:19,902 # Package would be ignored # 2025-10-08T00:42:19,902 ############################ 2025-10-08T00:42:19,903 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2025-10-08T00:42:19,903 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,904 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,904 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2025-10-08T00:42:19,905 to the `packages` configuration field. 2025-10-08T00:42:19,906 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,906 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,907 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,908 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,908 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,909 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2025-10-08T00:42:19,910 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2025-10-08T00:42:19,910 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,911 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,911 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,912 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,913 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,915 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,915 even if it does not contain any `.py` files. 2025-10-08T00:42:19,916 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,916 directory, all directories are treated like packages. 2025-10-08T00:42:19,917 ******************************************************************************** 2025-10-08T00:42:19,918 !! 2025-10-08T00:42:19,918 check.warn(importable) 2025-10-08T00:42:19,919 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2025-10-08T00:42:19,919 !! 2025-10-08T00:42:19,920 ******************************************************************************** 2025-10-08T00:42:19,921 ############################ 2025-10-08T00:42:19,921 # Package would be ignored # 2025-10-08T00:42:19,922 ############################ 2025-10-08T00:42:19,922 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2025-10-08T00:42:19,923 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,924 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,924 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2025-10-08T00:42:19,925 to the `packages` configuration field. 2025-10-08T00:42:19,926 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,926 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,927 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,928 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,929 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,930 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2025-10-08T00:42:19,930 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2025-10-08T00:42:19,930 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,931 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,931 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,932 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,933 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,934 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,935 even if it does not contain any `.py` files. 2025-10-08T00:42:19,935 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,936 directory, all directories are treated like packages. 2025-10-08T00:42:19,936 ******************************************************************************** 2025-10-08T00:42:19,937 !! 2025-10-08T00:42:19,938 check.warn(importable) 2025-10-08T00:42:19,938 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2025-10-08T00:42:19,939 !! 2025-10-08T00:42:19,939 ******************************************************************************** 2025-10-08T00:42:19,940 ############################ 2025-10-08T00:42:19,940 # Package would be ignored # 2025-10-08T00:42:19,941 ############################ 2025-10-08T00:42:19,941 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2025-10-08T00:42:19,942 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,943 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,943 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2025-10-08T00:42:19,944 to the `packages` configuration field. 2025-10-08T00:42:19,945 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,945 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,946 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,947 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,948 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,949 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2025-10-08T00:42:19,949 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2025-10-08T00:42:19,950 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,950 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,951 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,952 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,953 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,954 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,954 even if it does not contain any `.py` files. 2025-10-08T00:42:19,955 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,955 directory, all directories are treated like packages. 2025-10-08T00:42:19,956 ******************************************************************************** 2025-10-08T00:42:19,957 !! 2025-10-08T00:42:19,957 check.warn(importable) 2025-10-08T00:42:19,957 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2025-10-08T00:42:19,958 !! 2025-10-08T00:42:19,959 ******************************************************************************** 2025-10-08T00:42:19,959 ############################ 2025-10-08T00:42:19,960 # Package would be ignored # 2025-10-08T00:42:19,960 ############################ 2025-10-08T00:42:19,961 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2025-10-08T00:42:19,961 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,962 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,962 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2025-10-08T00:42:19,963 to the `packages` configuration field. 2025-10-08T00:42:19,964 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,964 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,965 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,966 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,967 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,968 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2025-10-08T00:42:19,968 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2025-10-08T00:42:19,969 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,969 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,970 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,971 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,972 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,974 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,974 even if it does not contain any `.py` files. 2025-10-08T00:42:19,975 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,975 directory, all directories are treated like packages. 2025-10-08T00:42:19,976 ******************************************************************************** 2025-10-08T00:42:19,977 !! 2025-10-08T00:42:19,977 check.warn(importable) 2025-10-08T00:42:19,978 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2025-10-08T00:42:19,978 !! 2025-10-08T00:42:19,979 ******************************************************************************** 2025-10-08T00:42:19,980 ############################ 2025-10-08T00:42:19,980 # Package would be ignored # 2025-10-08T00:42:19,981 ############################ 2025-10-08T00:42:19,981 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2025-10-08T00:42:19,982 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:19,983 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:19,983 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2025-10-08T00:42:19,983 to the `packages` configuration field. 2025-10-08T00:42:19,984 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:19,985 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:19,985 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:19,986 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:19,987 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:19,988 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2025-10-08T00:42:19,988 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2025-10-08T00:42:19,989 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:19,989 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:19,990 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:19,991 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:19,992 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:19,993 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:19,994 even if it does not contain any `.py` files. 2025-10-08T00:42:19,994 On the other hand, currently there is no concept of package data 2025-10-08T00:42:19,995 directory, all directories are treated like packages. 2025-10-08T00:42:19,995 ******************************************************************************** 2025-10-08T00:42:19,996 !! 2025-10-08T00:42:19,997 check.warn(importable) 2025-10-08T00:42:19,997 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2025-10-08T00:42:19,998 !! 2025-10-08T00:42:19,999 ******************************************************************************** 2025-10-08T00:42:19,999 ############################ 2025-10-08T00:42:20,000 # Package would be ignored # 2025-10-08T00:42:20,000 ############################ 2025-10-08T00:42:20,001 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2025-10-08T00:42:20,001 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:20,002 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:20,003 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2025-10-08T00:42:20,003 to the `packages` configuration field. 2025-10-08T00:42:20,004 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:20,005 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:20,006 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:20,007 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:20,008 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:20,009 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2025-10-08T00:42:20,009 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2025-10-08T00:42:20,010 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:20,010 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:20,011 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:20,012 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:20,012 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:20,014 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:20,014 even if it does not contain any `.py` files. 2025-10-08T00:42:20,014 On the other hand, currently there is no concept of package data 2025-10-08T00:42:20,015 directory, all directories are treated like packages. 2025-10-08T00:42:20,015 ******************************************************************************** 2025-10-08T00:42:20,016 !! 2025-10-08T00:42:20,017 check.warn(importable) 2025-10-08T00:42:20,017 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2025-10-08T00:42:20,018 !! 2025-10-08T00:42:20,019 ******************************************************************************** 2025-10-08T00:42:20,019 ############################ 2025-10-08T00:42:20,020 # Package would be ignored # 2025-10-08T00:42:20,020 ############################ 2025-10-08T00:42:20,021 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2025-10-08T00:42:20,021 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:20,022 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:20,023 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2025-10-08T00:42:20,023 to the `packages` configuration field. 2025-10-08T00:42:20,024 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:20,025 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:20,026 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:20,027 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:20,028 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:20,029 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2025-10-08T00:42:20,030 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2025-10-08T00:42:20,031 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:20,031 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:20,032 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:20,033 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:20,035 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:20,037 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:20,038 even if it does not contain any `.py` files. 2025-10-08T00:42:20,039 On the other hand, currently there is no concept of package data 2025-10-08T00:42:20,039 directory, all directories are treated like packages. 2025-10-08T00:42:20,040 ******************************************************************************** 2025-10-08T00:42:20,042 !! 2025-10-08T00:42:20,042 check.warn(importable) 2025-10-08T00:42:20,043 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2025-10-08T00:42:20,044 !! 2025-10-08T00:42:20,046 ******************************************************************************** 2025-10-08T00:42:20,047 ############################ 2025-10-08T00:42:20,049 # Package would be ignored # 2025-10-08T00:42:20,050 ############################ 2025-10-08T00:42:20,050 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2025-10-08T00:42:20,051 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:20,053 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:20,053 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2025-10-08T00:42:20,054 to the `packages` configuration field. 2025-10-08T00:42:20,056 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:20,056 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:20,057 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:20,058 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:20,059 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:20,060 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2025-10-08T00:42:20,060 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2025-10-08T00:42:20,061 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:20,061 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:20,062 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:20,063 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:20,064 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:20,066 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:20,066 even if it does not contain any `.py` files. 2025-10-08T00:42:20,067 On the other hand, currently there is no concept of package data 2025-10-08T00:42:20,067 directory, all directories are treated like packages. 2025-10-08T00:42:20,068 ******************************************************************************** 2025-10-08T00:42:20,069 !! 2025-10-08T00:42:20,069 check.warn(importable) 2025-10-08T00:42:20,070 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2025-10-08T00:42:20,070 !! 2025-10-08T00:42:20,071 ******************************************************************************** 2025-10-08T00:42:20,072 ############################ 2025-10-08T00:42:20,072 # Package would be ignored # 2025-10-08T00:42:20,073 ############################ 2025-10-08T00:42:20,073 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2025-10-08T00:42:20,074 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:20,075 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:20,075 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2025-10-08T00:42:20,076 to the `packages` configuration field. 2025-10-08T00:42:20,077 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:20,078 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:20,079 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:20,080 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:20,081 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:20,081 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2025-10-08T00:42:20,082 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2025-10-08T00:42:20,082 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:20,083 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:20,083 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:20,084 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:20,085 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:20,087 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:20,087 even if it does not contain any `.py` files. 2025-10-08T00:42:20,088 On the other hand, currently there is no concept of package data 2025-10-08T00:42:20,088 directory, all directories are treated like packages. 2025-10-08T00:42:20,089 ******************************************************************************** 2025-10-08T00:42:20,090 !! 2025-10-08T00:42:20,091 check.warn(importable) 2025-10-08T00:42:20,092 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2025-10-08T00:42:20,092 !! 2025-10-08T00:42:20,094 ******************************************************************************** 2025-10-08T00:42:20,094 ############################ 2025-10-08T00:42:20,095 # Package would be ignored # 2025-10-08T00:42:20,096 ############################ 2025-10-08T00:42:20,096 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2025-10-08T00:42:20,097 but it is absent from setuptools' `packages` configuration. 2025-10-08T00:42:20,099 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-08T00:42:20,099 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2025-10-08T00:42:20,099 to the `packages` configuration field. 2025-10-08T00:42:20,100 Alternatively, you can also rely on setuptools' discovery methods 2025-10-08T00:42:20,101 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-08T00:42:20,101 instead of `find_packages(...)`/`find:`). 2025-10-08T00:42:20,103 You can read more about "package discovery" on setuptools documentation page: 2025-10-08T00:42:20,104 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-08T00:42:20,105 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2025-10-08T00:42:20,105 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2025-10-08T00:42:20,106 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-08T00:42:20,106 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-08T00:42:20,107 combination with a more fine grained `package-data` configuration. 2025-10-08T00:42:20,108 You can read more about "package data files" on setuptools documentation page: 2025-10-08T00:42:20,109 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-08T00:42:20,110 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-08T00:42:20,111 even if it does not contain any `.py` files. 2025-10-08T00:42:20,111 On the other hand, currently there is no concept of package data 2025-10-08T00:42:20,112 directory, all directories are treated like packages. 2025-10-08T00:42:20,112 ******************************************************************************** 2025-10-08T00:42:20,113 !! 2025-10-08T00:42:20,113 check.warn(importable) 2025-10-08T00:42:20,114 creating build/lib/deepspeed/autotuning/config_templates 2025-10-08T00:42:20,114 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-08T00:42:20,114 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-08T00:42:20,115 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-08T00:42:20,115 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-08T00:42:20,116 creating build/lib/deepspeed/ops/csrc/adagrad 2025-10-08T00:42:20,116 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2025-10-08T00:42:20,117 creating build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,117 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,118 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,118 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,119 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,119 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2025-10-08T00:42:20,120 creating build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,120 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,121 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,121 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,122 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,122 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,123 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:20,123 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,124 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,124 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,125 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,125 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,126 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,126 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,127 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,127 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,128 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,129 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,129 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,130 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,130 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,130 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,131 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,131 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,132 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:20,132 creating build/lib/deepspeed/ops/csrc/aio/py_test 2025-10-08T00:42:20,132 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2025-10-08T00:42:20,133 creating build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,133 copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,134 copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,134 copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,135 copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,135 copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,136 copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,136 copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,137 copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,137 copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-08T00:42:20,138 creating build/lib/deepspeed/ops/csrc/cpu/adam 2025-10-08T00:42:20,138 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2025-10-08T00:42:20,139 creating build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:20,139 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:20,140 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:20,140 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:20,141 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:20,141 creating build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-08T00:42:20,142 copying deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-08T00:42:20,142 creating build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-08T00:42:20,143 copying deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-08T00:42:20,143 creating build/lib/deepspeed/ops/csrc/cpu/lion 2025-10-08T00:42:20,144 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2025-10-08T00:42:20,145 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,145 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,146 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,146 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,147 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,147 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,148 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:20,148 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:20,149 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:20,149 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:20,149 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:20,150 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:20,150 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,151 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,151 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,152 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,152 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,153 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,154 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,154 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:20,155 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,155 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,155 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,156 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,157 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,157 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,158 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,158 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:20,159 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:20,159 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:20,160 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:20,160 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:20,160 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:20,161 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:20,161 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:20,162 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:20,162 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:20,163 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,164 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,164 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,165 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,165 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,166 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,166 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:20,167 creating build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,167 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,168 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,168 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,169 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,169 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,170 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,170 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,171 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,173 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,176 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,179 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,181 copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,185 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,187 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,189 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,192 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,194 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,196 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,199 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,201 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,204 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,207 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,209 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,212 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,215 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,217 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,220 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,223 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,225 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,228 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-08T00:42:20,230 creating build/lib/deepspeed/ops/csrc/lamb 2025-10-08T00:42:20,231 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2025-10-08T00:42:20,233 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2025-10-08T00:42:20,236 creating build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,237 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,239 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,242 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,244 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,247 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2025-10-08T00:42:20,249 creating build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,250 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,252 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,256 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,258 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,262 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,264 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,267 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-08T00:42:20,269 creating build/lib/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:20,271 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:20,274 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:20,277 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:20,279 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:20,282 creating build/lib/deepspeed/ops/csrc/sparse_attention 2025-10-08T00:42:20,283 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2025-10-08T00:42:20,286 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:20,287 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:20,290 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:20,292 creating build/lib/deepspeed/ops/csrc/spatial/includes 2025-10-08T00:42:20,293 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2025-10-08T00:42:20,296 creating build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,297 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,300 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,303 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,306 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,309 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,312 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,317 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,320 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-08T00:42:20,323 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,324 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,327 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,330 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,333 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,337 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,339 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,344 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,346 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,349 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,352 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:20,355 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:20,357 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:20,360 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:20,363 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:20,366 creating build/lib/deepspeed/ops/csrc/utils 2025-10-08T00:42:20,367 copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-10-08T00:42:20,369 copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-10-08T00:42:20,371 copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils 2025-10-08T00:42:20,374 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-10-08T00:42:20,375 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-10-08T00:42:20,378 creating build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:20,379 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:20,381 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:20,384 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:20,387 creating build/lib/deepspeed/ops/csrc/xpu/common 2025-10-08T00:42:20,388 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2025-10-08T00:42:20,390 creating build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,391 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,394 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,396 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,399 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,402 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:20,404 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2025-10-08T00:42:20,405 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2025-10-08T00:42:20,408 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:20,412 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:20,414 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:20,416 creating build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,418 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,420 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,423 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,425 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,429 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:20,431 creating build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:20,432 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:20,435 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:20,437 creating build/lib/deepspeed/inference/v2/ragged/includes 2025-10-08T00:42:20,438 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2025-10-08T00:42:20,440 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:20,442 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-08T00:42:20,443 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-08T00:42:20,446 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:20,447 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:20,449 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:20,452 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:20,454 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:20,456 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:20,458 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-08T00:42:20,459 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-08T00:42:20,462 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:20,464 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:20,467 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:20,469 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:20,472 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:20,474 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:20,477 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:20,479 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:20,482 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:20,484 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:20,487 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:20,489 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:20,491 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:20,494 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:20,496 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:20,499 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:20,501 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:20,503 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:20,505 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:20,508 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:20,510 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:20,512 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:20,515 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:20,517 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:20,519 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:20,522 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:20,525 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:20,528 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:20,530 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:20,532 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:20,535 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:20,538 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:20,540 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:20,543 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:20,546 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:20,548 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:20,551 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:20,554 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,555 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,558 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,561 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,563 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,566 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,569 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,572 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,574 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,576 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:20,580 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:20,582 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:20,585 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:20,588 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:20,590 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:20,592 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:20,595 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:20,597 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:20,600 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:20,602 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:20,605 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:20,608 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:20,611 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:20,613 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:20,616 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:20,619 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:20,621 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:20,683 running build_scripts 2025-10-08T00:42:20,684 creating build/scripts-3.11 2025-10-08T00:42:20,685 copying and adjusting bin/deepspeed -> build/scripts-3.11 2025-10-08T00:42:20,687 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2025-10-08T00:42:20,688 copying and adjusting bin/ds -> build/scripts-3.11 2025-10-08T00:42:20,690 copying bin/ds_ssh -> build/scripts-3.11 2025-10-08T00:42:20,692 copying and adjusting bin/ds_report -> build/scripts-3.11 2025-10-08T00:42:20,694 copying and adjusting bin/ds_bench -> build/scripts-3.11 2025-10-08T00:42:20,695 copying and adjusting bin/dsr -> build/scripts-3.11 2025-10-08T00:42:20,697 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2025-10-08T00:42:20,699 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2025-10-08T00:42:20,700 copying and adjusting bin/ds_io -> build/scripts-3.11 2025-10-08T00:42:20,701 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2025-10-08T00:42:20,702 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2025-10-08T00:42:20,702 changing mode of build/scripts-3.11/ds from 644 to 755 2025-10-08T00:42:20,703 changing mode of build/scripts-3.11/ds_report from 644 to 755 2025-10-08T00:42:20,704 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2025-10-08T00:42:20,704 changing mode of build/scripts-3.11/dsr from 644 to 755 2025-10-08T00:42:20,705 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2025-10-08T00:42:20,706 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2025-10-08T00:42:20,706 changing mode of build/scripts-3.11/ds_io from 644 to 755 2025-10-08T00:42:20,733 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-10-08T00:42:20,734 !! 2025-10-08T00:42:20,735 ******************************************************************************** 2025-10-08T00:42:20,735 Please avoid running ``setup.py`` directly. 2025-10-08T00:42:20,736 Instead, use pypa/build, pypa/installer or other 2025-10-08T00:42:20,737 standards-based tools. 2025-10-08T00:42:20,738 By 2025-Oct-31, you need to update your project and remove deprecated calls 2025-10-08T00:42:20,738 or your builds will no longer be supported. 2025-10-08T00:42:20,740 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-10-08T00:42:20,740 ******************************************************************************** 2025-10-08T00:42:20,741 !! 2025-10-08T00:42:20,742 self.initialize_options() 2025-10-08T00:42:20,763 installing to build/bdist.linux-armv7l/wheel 2025-10-08T00:42:20,764 running install 2025-10-08T00:42:20,788 running install_lib 2025-10-08T00:42:20,815 creating build/bdist.linux-armv7l/wheel 2025-10-08T00:42:20,818 creating build/bdist.linux-armv7l/wheel/deepspeed 2025-10-08T00:42:20,820 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2025-10-08T00:42:20,821 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,824 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,827 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,829 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,831 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,833 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,836 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,838 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,840 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,843 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-08T00:42:20,846 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2025-10-08T00:42:20,847 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-08T00:42:20,849 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-08T00:42:20,851 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-08T00:42:20,854 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2025-10-08T00:42:20,855 copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,857 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,860 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,863 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,864 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,866 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,868 copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,870 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,872 copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,874 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,877 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,878 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,881 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,883 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,885 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,887 copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-08T00:42:20,890 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2025-10-08T00:42:20,892 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2025-10-08T00:42:20,893 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,896 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,898 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,900 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,903 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,905 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2025-10-08T00:42:20,907 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,909 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,911 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,913 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,915 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,917 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,919 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-08T00:42:20,922 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,924 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,926 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,928 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,930 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,932 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,934 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,937 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,939 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,940 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,942 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,944 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,946 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,948 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-08T00:42:20,951 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,953 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,955 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,958 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,960 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,963 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,965 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,966 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,968 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,971 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,973 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,975 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,977 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-08T00:42:20,980 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2025-10-08T00:42:20,981 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,983 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,985 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,987 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,989 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,992 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-08T00:42:20,994 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-08T00:42:20,996 creating build/bdist.linux-armv7l/wheel/deepspeed/compile 2025-10-08T00:42:20,997 copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:20,999 copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,002 copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,004 copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,006 copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,008 copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,010 copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,012 copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,015 copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,017 copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,019 copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,021 copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,023 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers 2025-10-08T00:42:21,024 copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-08T00:42:21,026 copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-08T00:42:21,028 copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-08T00:42:21,031 copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,033 copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-08T00:42:21,036 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes 2025-10-08T00:42:21,037 copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,039 copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,040 copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,042 copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,045 copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,047 copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,049 copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,051 copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-08T00:42:21,054 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2025-10-08T00:42:21,055 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2025-10-08T00:42:21,058 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2025-10-08T00:42:21,059 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,062 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,065 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2025-10-08T00:42:21,066 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-08T00:42:21,068 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-08T00:42:21,070 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-08T00:42:21,072 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-08T00:42:21,074 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,076 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2025-10-08T00:42:21,077 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,079 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,081 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,083 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,085 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,087 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-08T00:42:21,089 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,091 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,093 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-08T00:42:21,096 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2025-10-08T00:42:21,097 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,099 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,101 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,103 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,105 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,107 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-08T00:42:21,111 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2025-10-08T00:42:21,112 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile 2025-10-08T00:42:21,113 copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile 2025-10-08T00:42:21,116 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2025-10-08T00:42:21,117 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-10-08T00:42:21,120 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-10-08T00:42:21,122 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2025-10-08T00:42:21,123 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,126 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,128 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,131 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,133 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,135 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,137 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,139 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,141 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,143 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,145 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,148 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,150 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,152 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-08T00:42:21,154 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,157 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,158 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,160 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,162 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,165 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,166 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,168 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,170 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,173 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,175 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,177 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,179 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,181 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,183 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,185 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,187 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,189 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,191 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,193 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,195 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,197 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,199 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,201 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,203 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-08T00:42:21,205 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,207 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,209 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,211 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,213 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,215 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-08T00:42:21,218 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2025-10-08T00:42:21,219 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-10-08T00:42:21,221 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-10-08T00:42:21,223 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2025-10-08T00:42:21,226 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2025-10-08T00:42:21,227 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-10-08T00:42:21,229 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-10-08T00:42:21,232 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2025-10-08T00:42:21,233 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-10-08T00:42:21,235 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-10-08T00:42:21,237 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2025-10-08T00:42:21,239 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,241 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,243 copying build/lib/deepspeed/ops/adam/zenflow_cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,245 copying build/lib/deepspeed/ops/adam/zenflow_torch_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,248 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,250 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-08T00:42:21,253 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2025-10-08T00:42:21,254 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-10-08T00:42:21,256 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-10-08T00:42:21,258 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2025-10-08T00:42:21,259 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2025-10-08T00:42:21,263 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2025-10-08T00:42:21,264 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,265 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,268 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,269 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,271 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,273 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,275 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-08T00:42:21,277 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,279 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,281 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,283 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,286 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,287 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,289 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,291 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,293 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,295 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-08T00:42:21,298 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,300 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,302 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,304 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,306 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,308 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,310 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,312 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,314 copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,316 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,318 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,320 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,322 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,324 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,326 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,328 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,329 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,331 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,333 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-08T00:42:21,335 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,338 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,339 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,341 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,343 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,345 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,347 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,349 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,351 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,353 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,355 copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,357 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-08T00:42:21,359 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,360 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,362 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,364 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,366 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,368 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,370 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,372 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,374 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,376 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,378 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,379 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-08T00:42:21,382 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,383 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,385 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,387 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,389 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,391 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,393 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,395 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,396 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,399 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-08T00:42:21,401 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,403 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,405 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,407 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,409 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,411 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-08T00:42:21,414 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2025-10-08T00:42:21,415 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,417 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,419 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,422 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,424 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,426 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,430 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-08T00:42:21,432 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:21,434 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:21,436 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:21,438 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:21,440 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-08T00:42:21,442 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2025-10-08T00:42:21,443 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2025-10-08T00:42:21,446 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2025-10-08T00:42:21,447 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-08T00:42:21,450 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-08T00:42:21,452 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-08T00:42:21,453 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-08T00:42:21,457 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2025-10-08T00:42:21,458 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,460 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,462 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,464 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,467 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,470 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,472 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,475 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-08T00:42:21,479 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile 2025-10-08T00:42:21,479 copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,481 copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,483 copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,485 copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,487 copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,489 copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,491 copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,493 copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,496 copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-08T00:42:21,498 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,499 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,502 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,504 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,507 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,510 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2025-10-08T00:42:21,512 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:21,513 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:21,515 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:21,518 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-08T00:42:21,521 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,522 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,525 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,527 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,530 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,532 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,535 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,537 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,539 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,541 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,543 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-08T00:42:21,547 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,549 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,552 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,555 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-08T00:42:21,558 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:21,559 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:21,561 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:21,564 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:21,566 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-08T00:42:21,569 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2025-10-08T00:42:21,570 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2025-10-08T00:42:21,573 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2025-10-08T00:42:21,574 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-08T00:42:21,576 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-08T00:42:21,578 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-08T00:42:21,580 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-08T00:42:21,582 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-08T00:42:21,585 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2025-10-08T00:42:21,587 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,588 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,591 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:21,592 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:21,594 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-08T00:42:21,596 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,598 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,601 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,602 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,606 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,609 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,612 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,614 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,616 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,619 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-08T00:42:21,621 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,626 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,628 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,629 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,632 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,634 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,637 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,640 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,643 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,646 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-08T00:42:21,649 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:21,650 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:21,653 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:21,655 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:21,658 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-08T00:42:21,660 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-08T00:42:21,664 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2025-10-08T00:42:21,665 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,667 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,669 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,671 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,672 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,675 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,677 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-08T00:42:21,680 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2025-10-08T00:42:21,681 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2025-10-08T00:42:21,682 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2025-10-08T00:42:21,685 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2025-10-08T00:42:21,686 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2025-10-08T00:42:21,689 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2025-10-08T00:42:21,690 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2025-10-08T00:42:21,693 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:21,694 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:21,696 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:21,698 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-08T00:42:21,701 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,702 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,704 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,706 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,709 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,711 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-08T00:42:21,713 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2025-10-08T00:42:21,715 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2025-10-08T00:42:21,716 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2025-10-08T00:42:21,719 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:21,720 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:21,722 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-10-08T00:42:21,725 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2025-10-08T00:42:21,727 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,729 copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,731 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,734 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,736 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,738 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,740 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,742 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,744 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,746 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,749 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,752 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,754 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,756 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,757 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,759 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,761 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,763 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,766 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,768 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,770 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,772 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,775 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,778 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,780 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,782 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,785 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,787 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,789 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,790 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-08T00:42:21,793 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2025-10-08T00:42:21,794 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2025-10-08T00:42:21,797 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2025-10-08T00:42:21,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,800 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,802 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,804 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,805 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,808 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,810 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-08T00:42:21,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2025-10-08T00:42:21,814 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2025-10-08T00:42:21,816 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,818 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,820 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,822 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,824 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,826 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,828 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,830 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,832 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,834 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,836 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,839 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,841 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,843 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,845 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,847 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,849 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,852 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-08T00:42:21,854 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:21,856 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:21,858 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:21,861 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-10-08T00:42:21,863 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:21,865 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-10-08T00:42:21,869 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2025-10-08T00:42:21,870 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-08T00:42:21,872 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-08T00:42:21,874 copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-08T00:42:21,876 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2025-10-08T00:42:21,878 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2025-10-08T00:42:21,880 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2025-10-08T00:42:21,882 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:21,884 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:21,886 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:21,890 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-08T00:42:21,891 copying build/lib/deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-08T00:42:21,894 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-08T00:42:21,896 copying build/lib/deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-08T00:42:21,898 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:21,901 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-08T00:42:21,903 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2025-10-08T00:42:21,905 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2025-10-08T00:42:21,907 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2025-10-08T00:42:21,909 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-10-08T00:42:21,911 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-10-08T00:42:21,915 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2025-10-08T00:42:21,916 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-08T00:42:21,919 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-08T00:42:21,921 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-08T00:42:21,923 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-08T00:42:21,925 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-08T00:42:21,928 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2025-10-08T00:42:21,929 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-10-08T00:42:21,931 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-10-08T00:42:21,934 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2025-10-08T00:42:21,935 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-08T00:42:21,938 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-08T00:42:21,940 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-08T00:42:21,942 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-08T00:42:21,945 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2025-10-08T00:42:21,946 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-08T00:42:21,948 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-08T00:42:21,950 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-08T00:42:21,953 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2025-10-08T00:42:21,954 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-10-08T00:42:21,957 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-10-08T00:42:21,960 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2025-10-08T00:42:21,961 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,964 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,966 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,968 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,970 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,973 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,975 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,978 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,980 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,983 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,985 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-08T00:42:21,988 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2025-10-08T00:42:21,990 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-08T00:42:21,992 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-08T00:42:21,995 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-08T00:42:21,998 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-08T00:42:22,000 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-08T00:42:22,003 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2025-10-08T00:42:22,005 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2025-10-08T00:42:22,006 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,008 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,011 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,013 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,015 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,017 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,019 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,021 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,023 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,026 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-08T00:42:22,028 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2025-10-08T00:42:22,030 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-10-08T00:42:22,032 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-10-08T00:42:22,034 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2025-10-08T00:42:22,037 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2025-10-08T00:42:22,038 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-08T00:42:22,040 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-08T00:42:22,042 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-08T00:42:22,044 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-08T00:42:22,047 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2025-10-08T00:42:22,049 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2025-10-08T00:42:22,050 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-08T00:42:22,052 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-08T00:42:22,054 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-08T00:42:22,056 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-08T00:42:22,058 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-08T00:42:22,060 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-08T00:42:22,063 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-08T00:42:22,064 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-08T00:42:22,068 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2025-10-08T00:42:22,069 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2025-10-08T00:42:22,070 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-08T00:42:22,072 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-08T00:42:22,074 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-08T00:42:22,076 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-08T00:42:22,078 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,080 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,082 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,083 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,086 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2025-10-08T00:42:22,087 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-10-08T00:42:22,089 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:22,091 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,092 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,094 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,096 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,098 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,100 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,102 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-08T00:42:22,104 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:22,106 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:22,108 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:22,110 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:22,112 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-08T00:42:22,114 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:22,116 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,117 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,119 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,121 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,123 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,124 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,126 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-08T00:42:22,130 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,131 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,133 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,135 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,137 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,139 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,141 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-08T00:42:22,144 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,145 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,147 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,149 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,151 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,153 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,155 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-08T00:42:22,158 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,159 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,161 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,163 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,165 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,166 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,168 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-08T00:42:22,171 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-08T00:42:22,172 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-08T00:42:22,175 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,176 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,178 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,180 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,182 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,184 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,187 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,189 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,191 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-08T00:42:22,194 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:22,195 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:22,197 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:22,199 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-08T00:42:22,200 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-10-08T00:42:22,203 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,204 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,206 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,208 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,210 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,211 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,214 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-08T00:42:22,215 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-10-08T00:42:22,218 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,219 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,221 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,223 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,225 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,228 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-08T00:42:22,231 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:22,233 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,234 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,236 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,238 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,240 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,242 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,244 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,245 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,248 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-08T00:42:22,250 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,251 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,254 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,256 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,257 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,260 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,262 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-08T00:42:22,265 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,266 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,269 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,271 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,273 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,275 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,277 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,279 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,282 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,284 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-08T00:42:22,287 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:22,288 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-10-08T00:42:22,291 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,292 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,294 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,296 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,298 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,300 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,302 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,304 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-08T00:42:22,306 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,308 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,310 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,312 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,314 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,316 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-08T00:42:22,319 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,320 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,322 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,324 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,326 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,328 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-08T00:42:22,330 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:22,331 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:22,334 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:22,335 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:22,338 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-08T00:42:22,341 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:22,342 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:22,344 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,345 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,348 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,350 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,352 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,354 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,356 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-08T00:42:22,358 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-10-08T00:42:22,361 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,362 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,364 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,366 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,368 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,370 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-08T00:42:22,372 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-08T00:42:22,374 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-08T00:42:22,376 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,378 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:22,379 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:22,381 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:22,383 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:22,385 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-08T00:42:22,387 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:22,388 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:22,390 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:22,392 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:22,394 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-08T00:42:22,397 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:22,398 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:22,401 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:22,403 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:22,405 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-08T00:42:22,408 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,411 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:22,413 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:22,415 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:22,417 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:22,420 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-08T00:42:22,422 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,425 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,428 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,429 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,431 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,434 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,436 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,438 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,440 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,442 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,445 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,447 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-08T00:42:22,450 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:22,451 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:22,453 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:22,456 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:22,458 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-08T00:42:22,461 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:22,462 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:22,465 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:22,467 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:22,469 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-08T00:42:22,472 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,475 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:22,476 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:22,479 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:22,481 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:22,483 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-08T00:42:22,486 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:22,488 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:22,490 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:22,492 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:22,494 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-08T00:42:22,497 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,500 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,501 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,503 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,504 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,506 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,508 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,510 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,512 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,514 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,515 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-08T00:42:22,518 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:22,519 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:22,521 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:22,522 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:22,524 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-08T00:42:22,526 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:22,528 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:22,530 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:22,532 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:22,533 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-08T00:42:22,536 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,538 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-08T00:42:22,541 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,543 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2025-10-08T00:42:22,544 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,546 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,549 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,551 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,554 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,556 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,558 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2025-10-08T00:42:22,560 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2025-10-08T00:42:22,562 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:22,563 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:22,565 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-10-08T00:42:22,567 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-08T00:42:22,569 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,572 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,574 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2025-10-08T00:42:22,576 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,577 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,579 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,581 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,582 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,584 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,586 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,588 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-08T00:42:22,590 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2025-10-08T00:42:22,592 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:22,593 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:22,595 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-10-08T00:42:22,598 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:22,599 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:22,601 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-10-08T00:42:22,603 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2025-10-08T00:42:22,606 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:22,607 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:22,609 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-10-08T00:42:22,611 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:22,612 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:22,614 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:22,616 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-08T00:42:22,619 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:22,620 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:22,622 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-10-08T00:42:22,625 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:22,626 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:22,628 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:22,629 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-08T00:42:22,632 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:22,633 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:22,635 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-10-08T00:42:22,637 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-08T00:42:22,639 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-08T00:42:22,641 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-08T00:42:22,642 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-08T00:42:22,645 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,646 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,648 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,650 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,652 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,654 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,656 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,658 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,660 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-08T00:42:22,662 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,664 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-08T00:42:22,666 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2025-10-08T00:42:22,667 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-08T00:42:22,669 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-08T00:42:22,671 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-08T00:42:22,673 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-08T00:42:22,675 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-08T00:42:22,678 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2025-10-08T00:42:22,679 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,680 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,682 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,685 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,687 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,689 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-08T00:42:22,692 creating build/bdist.linux-armv7l/wheel/deepspeed/io 2025-10-08T00:42:22,693 copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,695 copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,697 copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,699 copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,700 copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,702 copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,704 copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,706 copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,708 copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,710 copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-08T00:42:22,712 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2025-10-08T00:42:22,714 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,716 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,718 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel 2025-10-08T00:42:22,719 copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-08T00:42:22,723 copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-08T00:42:22,725 copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-08T00:42:22,727 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/superoffload 2025-10-08T00:42:22,728 copying build/lib/deepspeed/runtime/superoffload/superoffload_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-08T00:42:22,731 copying build/lib/deepspeed/runtime/superoffload/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-08T00:42:22,732 copying build/lib/deepspeed/runtime/superoffload/superoffload_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-08T00:42:22,735 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,737 copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,740 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,743 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,746 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2025-10-08T00:42:22,747 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,750 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,755 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,757 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,759 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,761 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,763 copying build/lib/deepspeed/runtime/zero/leaf_module_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,765 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,767 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,769 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,771 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,774 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,776 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,778 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,783 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,786 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,788 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,793 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero/muon 2025-10-08T00:42:22,794 copying build/lib/deepspeed/runtime/zero/muon/muon_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-08T00:42:22,796 copying build/lib/deepspeed/runtime/zero/muon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-08T00:42:22,798 copying build/lib/deepspeed/runtime/zero/muon/original_muon.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-08T00:42:22,800 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-08T00:42:22,803 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,806 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2025-10-08T00:42:22,807 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,809 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,812 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,814 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,816 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,819 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-08T00:42:22,822 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,824 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zenflow 2025-10-08T00:42:22,826 copying build/lib/deepspeed/runtime/zenflow/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-08T00:42:22,827 copying build/lib/deepspeed/runtime/zenflow/zenflow_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-08T00:42:22,829 copying build/lib/deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-08T00:42:22,832 copying build/lib/deepspeed/runtime/zenflow/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-08T00:42:22,834 copying build/lib/deepspeed/runtime/zenflow/zenflow_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-08T00:42:22,837 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2025-10-08T00:42:22,838 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,839 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,841 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,843 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,845 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,847 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-08T00:42:22,850 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-08T00:42:22,852 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,853 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,855 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,858 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,861 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,863 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,866 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-08T00:42:22,868 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-08T00:42:22,870 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-08T00:42:22,873 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-08T00:42:22,875 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,877 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,878 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,881 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,882 copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,884 copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,887 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,889 copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,891 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-08T00:42:22,894 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,895 copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,897 copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,899 copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,901 copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,903 copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,905 copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-08T00:42:22,908 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2025-10-08T00:42:22,909 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-08T00:42:22,912 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-08T00:42:22,915 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-08T00:42:22,917 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-08T00:42:22,919 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2025-10-08T00:42:22,921 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-08T00:42:22,923 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-08T00:42:22,925 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-08T00:42:22,928 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-08T00:42:22,930 copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,933 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,934 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,937 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,939 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,941 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,943 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,946 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,948 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,950 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,952 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-08T00:42:22,954 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,958 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,960 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,963 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2025-10-08T00:42:22,964 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-08T00:42:22,966 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-08T00:42:22,968 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-08T00:42:22,970 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,972 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,975 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2025-10-08T00:42:22,976 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,978 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,980 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,983 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,985 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,987 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-08T00:42:22,989 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,995 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:22,998 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2025-10-08T00:42:22,999 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-10-08T00:42:23,001 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-10-08T00:42:23,002 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:23,005 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:23,008 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:23,009 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:23,011 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:23,015 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-08T00:42:23,017 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-08T00:42:23,019 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2025-10-08T00:42:23,020 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-08T00:42:23,023 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-08T00:42:23,025 copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-08T00:42:23,027 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-08T00:42:23,030 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2025-10-08T00:42:23,031 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,033 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,035 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,037 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,039 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,040 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,042 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,044 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-08T00:42:23,046 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2025-10-08T00:42:23,047 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,049 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,052 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,053 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,055 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,057 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,059 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,061 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,063 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-08T00:42:23,066 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2025-10-08T00:42:23,067 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,070 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,073 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,074 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,077 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,080 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,083 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,085 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-08T00:42:23,088 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2025-10-08T00:42:23,089 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,091 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,092 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,094 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,097 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,099 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,101 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,103 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,105 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,106 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,110 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,113 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,114 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,116 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,119 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,121 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,123 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,125 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-08T00:42:23,127 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-08T00:42:23,129 running install_egg_info 2025-10-08T00:42:23,163 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.18.0-py3.11.egg-info 2025-10-08T00:42:23,177 running install_scripts 2025-10-08T00:42:23,178 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,180 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,182 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,183 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,185 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,187 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,189 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,190 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,192 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,194 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,196 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts 2025-10-08T00:42:23,197 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_io to 755 2025-10-08T00:42:23,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_elastic to 755 2025-10-08T00:42:23,198 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_ssh to 755 2025-10-08T00:42:23,199 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/deepspeed.pt to 755 2025-10-08T00:42:23,199 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/dsr to 755 2025-10-08T00:42:23,200 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds to 755 2025-10-08T00:42:23,200 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_nvme_tune to 755 2025-10-08T00:42:23,201 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/deepspeed to 755 2025-10-08T00:42:23,202 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_bench to 755 2025-10-08T00:42:23,202 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.data/scripts/ds_report to 755 2025-10-08T00:42:23,215 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.0.dist-info/WHEEL 2025-10-08T00:42:23,217 creating '/tmp/pip-wheel-1sx2m2lh/deepspeed-0.18.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-10-08T00:42:23,221 adding 'deepspeed/__init__.py' 2025-10-08T00:42:23,223 adding 'deepspeed/constants.py' 2025-10-08T00:42:23,224 adding 'deepspeed/env_report.py' 2025-10-08T00:42:23,225 adding 'deepspeed/git_version_info.py' 2025-10-08T00:42:23,226 adding 'deepspeed/git_version_info_installed.py' 2025-10-08T00:42:23,228 adding 'deepspeed/accelerator/__init__.py' 2025-10-08T00:42:23,230 adding 'deepspeed/accelerator/abstract_accelerator.py' 2025-10-08T00:42:23,231 adding 'deepspeed/accelerator/cpu_accelerator.py' 2025-10-08T00:42:23,233 adding 'deepspeed/accelerator/cuda_accelerator.py' 2025-10-08T00:42:23,235 adding 'deepspeed/accelerator/hpu_accelerator.py' 2025-10-08T00:42:23,237 adding 'deepspeed/accelerator/mlu_accelerator.py' 2025-10-08T00:42:23,239 adding 'deepspeed/accelerator/mps_accelerator.py' 2025-10-08T00:42:23,240 adding 'deepspeed/accelerator/npu_accelerator.py' 2025-10-08T00:42:23,242 adding 'deepspeed/accelerator/real_accelerator.py' 2025-10-08T00:42:23,244 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2025-10-08T00:42:23,245 adding 'deepspeed/accelerator/xpu_accelerator.py' 2025-10-08T00:42:23,247 adding 'deepspeed/autotuning/__init__.py' 2025-10-08T00:42:23,253 adding 'deepspeed/autotuning/autotuner.py' 2025-10-08T00:42:23,254 adding 'deepspeed/autotuning/config.py' 2025-10-08T00:42:23,256 adding 'deepspeed/autotuning/constants.py' 2025-10-08T00:42:23,258 adding 'deepspeed/autotuning/scheduler.py' 2025-10-08T00:42:23,260 adding 'deepspeed/autotuning/utils.py' 2025-10-08T00:42:23,262 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2025-10-08T00:42:23,263 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2025-10-08T00:42:23,264 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2025-10-08T00:42:23,265 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2025-10-08T00:42:23,267 adding 'deepspeed/autotuning/tuner/__init__.py' 2025-10-08T00:42:23,268 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2025-10-08T00:42:23,270 adding 'deepspeed/autotuning/tuner/cost_model.py' 2025-10-08T00:42:23,271 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2025-10-08T00:42:23,273 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2025-10-08T00:42:23,274 adding 'deepspeed/autotuning/tuner/utils.py' 2025-10-08T00:42:23,276 adding 'deepspeed/checkpoint/__init__.py' 2025-10-08T00:42:23,278 adding 'deepspeed/checkpoint/constants.py' 2025-10-08T00:42:23,280 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2025-10-08T00:42:23,282 adding 'deepspeed/checkpoint/ds_to_universal.py' 2025-10-08T00:42:23,284 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2025-10-08T00:42:23,286 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2025-10-08T00:42:23,287 adding 'deepspeed/checkpoint/reshape_utils.py' 2025-10-08T00:42:23,289 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2025-10-08T00:42:23,290 adding 'deepspeed/checkpoint/utils.py' 2025-10-08T00:42:23,291 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2025-10-08T00:42:23,293 adding 'deepspeed/comm/__init__.py' 2025-10-08T00:42:23,294 adding 'deepspeed/comm/backend.py' 2025-10-08T00:42:23,296 adding 'deepspeed/comm/ccl.py' 2025-10-08T00:42:23,300 adding 'deepspeed/comm/comm.py' 2025-10-08T00:42:23,301 adding 'deepspeed/comm/config.py' 2025-10-08T00:42:23,303 adding 'deepspeed/comm/constants.py' 2025-10-08T00:42:23,304 adding 'deepspeed/comm/reduce_op.py' 2025-10-08T00:42:23,306 adding 'deepspeed/comm/torch.py' 2025-10-08T00:42:23,307 adding 'deepspeed/comm/utils.py' 2025-10-08T00:42:23,309 adding 'deepspeed/compile/__init__.py' 2025-10-08T00:42:23,311 adding 'deepspeed/compile/backend.py' 2025-10-08T00:42:23,312 adding 'deepspeed/compile/config.py' 2025-10-08T00:42:23,314 adding 'deepspeed/compile/fx.py' 2025-10-08T00:42:23,315 adding 'deepspeed/compile/graph_param.py' 2025-10-08T00:42:23,316 adding 'deepspeed/compile/inductor.py' 2025-10-08T00:42:23,318 adding 'deepspeed/compile/init_z1.py' 2025-10-08T00:42:23,319 adding 'deepspeed/compile/init_z3.py' 2025-10-08T00:42:23,320 adding 'deepspeed/compile/input_storage.py' 2025-10-08T00:42:23,323 adding 'deepspeed/compile/list_schedule.py' 2025-10-08T00:42:23,324 adding 'deepspeed/compile/partitioner.py' 2025-10-08T00:42:23,325 adding 'deepspeed/compile/patch_compiled_func.py' 2025-10-08T00:42:23,327 adding 'deepspeed/compile/patch_fake_tensor.py' 2025-10-08T00:42:23,329 adding 'deepspeed/compile/util.py' 2025-10-08T00:42:23,331 adding 'deepspeed/compile/passes/__init__.py' 2025-10-08T00:42:23,332 adding 'deepspeed/compile/passes/offload_activation.py' 2025-10-08T00:42:23,335 adding 'deepspeed/compile/passes/offload_adam_states.py' 2025-10-08T00:42:23,336 adding 'deepspeed/compile/passes/offload_parameters.py' 2025-10-08T00:42:23,337 adding 'deepspeed/compile/passes/prefetch.py' 2025-10-08T00:42:23,339 adding 'deepspeed/compile/passes/selective_gather.py' 2025-10-08T00:42:23,340 adding 'deepspeed/compile/passes/zero1_compile.py' 2025-10-08T00:42:23,342 adding 'deepspeed/compile/passes/zero3_compile.py' 2025-10-08T00:42:23,344 adding 'deepspeed/compile/profilers/__init__.py' 2025-10-08T00:42:23,345 adding 'deepspeed/compile/profilers/comm_profile.py' 2025-10-08T00:42:23,347 adding 'deepspeed/compile/profilers/graph_profile.py' 2025-10-08T00:42:23,349 adding 'deepspeed/compression/__init__.py' 2025-10-08T00:42:23,352 adding 'deepspeed/compression/basic_layer.py' 2025-10-08T00:42:23,354 adding 'deepspeed/compression/compress.py' 2025-10-08T00:42:23,356 adding 'deepspeed/compression/config.py' 2025-10-08T00:42:23,357 adding 'deepspeed/compression/constants.py' 2025-10-08T00:42:23,359 adding 'deepspeed/compression/helper.py' 2025-10-08T00:42:23,361 adding 'deepspeed/compression/scheduler.py' 2025-10-08T00:42:23,362 adding 'deepspeed/compression/utils.py' 2025-10-08T00:42:23,364 adding 'deepspeed/elasticity/__init__.py' 2025-10-08T00:42:23,366 adding 'deepspeed/elasticity/config.py' 2025-10-08T00:42:23,367 adding 'deepspeed/elasticity/constants.py' 2025-10-08T00:42:23,369 adding 'deepspeed/elasticity/elastic_agent.py' 2025-10-08T00:42:23,371 adding 'deepspeed/elasticity/elasticity.py' 2025-10-08T00:42:23,372 adding 'deepspeed/elasticity/utils.py' 2025-10-08T00:42:23,374 adding 'deepspeed/inference/__init__.py' 2025-10-08T00:42:23,376 adding 'deepspeed/inference/config.py' 2025-10-08T00:42:23,379 adding 'deepspeed/inference/engine.py' 2025-10-08T00:42:23,381 adding 'deepspeed/inference/quantization/__init__.py' 2025-10-08T00:42:23,382 adding 'deepspeed/inference/quantization/layers.py' 2025-10-08T00:42:23,384 adding 'deepspeed/inference/quantization/quantization.py' 2025-10-08T00:42:23,385 adding 'deepspeed/inference/quantization/quantization_context.py' 2025-10-08T00:42:23,387 adding 'deepspeed/inference/quantization/utils.py' 2025-10-08T00:42:23,389 adding 'deepspeed/inference/v2/__init__.py' 2025-10-08T00:42:23,390 adding 'deepspeed/inference/v2/allocator.py' 2025-10-08T00:42:23,391 adding 'deepspeed/inference/v2/config_v2.py' 2025-10-08T00:42:23,393 adding 'deepspeed/inference/v2/engine_factory.py' 2025-10-08T00:42:23,395 adding 'deepspeed/inference/v2/engine_v2.py' 2025-10-08T00:42:23,396 adding 'deepspeed/inference/v2/inference_parameter.py' 2025-10-08T00:42:23,397 adding 'deepspeed/inference/v2/inference_utils.py' 2025-10-08T00:42:23,399 adding 'deepspeed/inference/v2/logging.py' 2025-10-08T00:42:23,400 adding 'deepspeed/inference/v2/scheduling_utils.py' 2025-10-08T00:42:23,401 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2025-10-08T00:42:23,403 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2025-10-08T00:42:23,404 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2025-10-08T00:42:23,405 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2025-10-08T00:42:23,407 adding 'deepspeed/inference/v2/kernels/__init__.py' 2025-10-08T00:42:23,408 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2025-10-08T00:42:23,409 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2025-10-08T00:42:23,410 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2025-10-08T00:42:23,412 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2025-10-08T00:42:23,413 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2025-10-08T00:42:23,414 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2025-10-08T00:42:23,416 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2025-10-08T00:42:23,417 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2025-10-08T00:42:23,419 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2025-10-08T00:42:23,420 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2025-10-08T00:42:23,421 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2025-10-08T00:42:23,423 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2025-10-08T00:42:23,425 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2025-10-08T00:42:23,426 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2025-10-08T00:42:23,427 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2025-10-08T00:42:23,428 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2025-10-08T00:42:23,429 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2025-10-08T00:42:23,431 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2025-10-08T00:42:23,432 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2025-10-08T00:42:23,434 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2025-10-08T00:42:23,436 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2025-10-08T00:42:23,437 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2025-10-08T00:42:23,439 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2025-10-08T00:42:23,440 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2025-10-08T00:42:23,442 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2025-10-08T00:42:23,443 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2025-10-08T00:42:23,445 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2025-10-08T00:42:23,448 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2025-10-08T00:42:23,449 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2025-10-08T00:42:23,450 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2025-10-08T00:42:23,451 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2025-10-08T00:42:23,453 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2025-10-08T00:42:23,455 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2025-10-08T00:42:23,456 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2025-10-08T00:42:23,458 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2025-10-08T00:42:23,459 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2025-10-08T00:42:23,461 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2025-10-08T00:42:23,462 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2025-10-08T00:42:23,463 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2025-10-08T00:42:23,464 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2025-10-08T00:42:23,465 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2025-10-08T00:42:23,467 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2025-10-08T00:42:23,468 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2025-10-08T00:42:23,470 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2025-10-08T00:42:23,471 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2025-10-08T00:42:23,472 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2025-10-08T00:42:23,473 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2025-10-08T00:42:23,475 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2025-10-08T00:42:23,476 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2025-10-08T00:42:23,478 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2025-10-08T00:42:23,479 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2025-10-08T00:42:23,480 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2025-10-08T00:42:23,482 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2025-10-08T00:42:23,483 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2025-10-08T00:42:23,484 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2025-10-08T00:42:23,486 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2025-10-08T00:42:23,487 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2025-10-08T00:42:23,489 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2025-10-08T00:42:23,490 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2025-10-08T00:42:23,491 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2025-10-08T00:42:23,493 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2025-10-08T00:42:23,494 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2025-10-08T00:42:23,496 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2025-10-08T00:42:23,498 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2025-10-08T00:42:23,500 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2025-10-08T00:42:23,503 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2025-10-08T00:42:23,504 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2025-10-08T00:42:23,506 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2025-10-08T00:42:23,507 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2025-10-08T00:42:23,509 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2025-10-08T00:42:23,510 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2025-10-08T00:42:23,511 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2025-10-08T00:42:23,513 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2025-10-08T00:42:23,514 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2025-10-08T00:42:23,515 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2025-10-08T00:42:23,516 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2025-10-08T00:42:23,518 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2025-10-08T00:42:23,519 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2025-10-08T00:42:23,520 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2025-10-08T00:42:23,522 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2025-10-08T00:42:23,523 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2025-10-08T00:42:23,524 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2025-10-08T00:42:23,525 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2025-10-08T00:42:23,526 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2025-10-08T00:42:23,528 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2025-10-08T00:42:23,530 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2025-10-08T00:42:23,531 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2025-10-08T00:42:23,532 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2025-10-08T00:42:23,534 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2025-10-08T00:42:23,535 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2025-10-08T00:42:23,537 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2025-10-08T00:42:23,538 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2025-10-08T00:42:23,540 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2025-10-08T00:42:23,541 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2025-10-08T00:42:23,543 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2025-10-08T00:42:23,544 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2025-10-08T00:42:23,545 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2025-10-08T00:42:23,546 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2025-10-08T00:42:23,548 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2025-10-08T00:42:23,549 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2025-10-08T00:42:23,551 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2025-10-08T00:42:23,552 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2025-10-08T00:42:23,553 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2025-10-08T00:42:23,554 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2025-10-08T00:42:23,556 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2025-10-08T00:42:23,558 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2025-10-08T00:42:23,559 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2025-10-08T00:42:23,560 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2025-10-08T00:42:23,561 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2025-10-08T00:42:23,563 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2025-10-08T00:42:23,564 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2025-10-08T00:42:23,566 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2025-10-08T00:42:23,567 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2025-10-08T00:42:23,569 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2025-10-08T00:42:23,570 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2025-10-08T00:42:23,571 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2025-10-08T00:42:23,572 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2025-10-08T00:42:23,574 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2025-10-08T00:42:23,575 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2025-10-08T00:42:23,576 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2025-10-08T00:42:23,578 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2025-10-08T00:42:23,580 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2025-10-08T00:42:23,582 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2025-10-08T00:42:23,583 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2025-10-08T00:42:23,586 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2025-10-08T00:42:23,588 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2025-10-08T00:42:23,590 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2025-10-08T00:42:23,592 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2025-10-08T00:42:23,593 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2025-10-08T00:42:23,594 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2025-10-08T00:42:23,596 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2025-10-08T00:42:23,597 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2025-10-08T00:42:23,598 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2025-10-08T00:42:23,600 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2025-10-08T00:42:23,601 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2025-10-08T00:42:23,602 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2025-10-08T00:42:23,604 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2025-10-08T00:42:23,605 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2025-10-08T00:42:23,607 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2025-10-08T00:42:23,608 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2025-10-08T00:42:23,610 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2025-10-08T00:42:23,611 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2025-10-08T00:42:23,613 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2025-10-08T00:42:23,614 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2025-10-08T00:42:23,616 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2025-10-08T00:42:23,617 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2025-10-08T00:42:23,619 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2025-10-08T00:42:23,620 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2025-10-08T00:42:23,622 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2025-10-08T00:42:23,623 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2025-10-08T00:42:23,625 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2025-10-08T00:42:23,626 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2025-10-08T00:42:23,628 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2025-10-08T00:42:23,629 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2025-10-08T00:42:23,631 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2025-10-08T00:42:23,632 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2025-10-08T00:42:23,634 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2025-10-08T00:42:23,635 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2025-10-08T00:42:23,637 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2025-10-08T00:42:23,638 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2025-10-08T00:42:23,639 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2025-10-08T00:42:23,641 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2025-10-08T00:42:23,642 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2025-10-08T00:42:23,644 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2025-10-08T00:42:23,645 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2025-10-08T00:42:23,647 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2025-10-08T00:42:23,648 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2025-10-08T00:42:23,649 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2025-10-08T00:42:23,651 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2025-10-08T00:42:23,652 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2025-10-08T00:42:23,654 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2025-10-08T00:42:23,655 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2025-10-08T00:42:23,657 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2025-10-08T00:42:23,658 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2025-10-08T00:42:23,660 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2025-10-08T00:42:23,662 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2025-10-08T00:42:23,663 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2025-10-08T00:42:23,665 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2025-10-08T00:42:23,666 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2025-10-08T00:42:23,668 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2025-10-08T00:42:23,669 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2025-10-08T00:42:23,671 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2025-10-08T00:42:23,672 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2025-10-08T00:42:23,675 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2025-10-08T00:42:23,676 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2025-10-08T00:42:23,678 adding 'deepspeed/inference/v2/modules/__init__.py' 2025-10-08T00:42:23,680 adding 'deepspeed/inference/v2/modules/ds_module.py' 2025-10-08T00:42:23,681 adding 'deepspeed/inference/v2/modules/heuristics.py' 2025-10-08T00:42:23,682 adding 'deepspeed/inference/v2/modules/module_registry.py' 2025-10-08T00:42:23,684 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2025-10-08T00:42:23,686 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2025-10-08T00:42:23,687 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2025-10-08T00:42:23,688 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2025-10-08T00:42:23,689 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2025-10-08T00:42:23,691 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2025-10-08T00:42:23,692 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2025-10-08T00:42:23,694 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2025-10-08T00:42:23,695 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2025-10-08T00:42:23,697 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2025-10-08T00:42:23,698 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2025-10-08T00:42:23,700 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2025-10-08T00:42:23,701 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2025-10-08T00:42:23,702 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2025-10-08T00:42:23,704 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2025-10-08T00:42:23,706 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2025-10-08T00:42:23,707 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2025-10-08T00:42:23,709 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2025-10-08T00:42:23,710 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2025-10-08T00:42:23,712 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2025-10-08T00:42:23,713 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2025-10-08T00:42:23,714 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2025-10-08T00:42:23,716 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2025-10-08T00:42:23,717 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2025-10-08T00:42:23,719 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2025-10-08T00:42:23,721 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2025-10-08T00:42:23,722 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2025-10-08T00:42:23,723 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2025-10-08T00:42:23,725 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2025-10-08T00:42:23,726 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2025-10-08T00:42:23,727 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2025-10-08T00:42:23,729 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2025-10-08T00:42:23,731 adding 'deepspeed/inference/v2/ragged/__init__.py' 2025-10-08T00:42:23,732 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2025-10-08T00:42:23,734 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2025-10-08T00:42:23,735 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2025-10-08T00:42:23,737 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2025-10-08T00:42:23,739 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2025-10-08T00:42:23,741 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2025-10-08T00:42:23,742 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2025-10-08T00:42:23,744 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2025-10-08T00:42:23,745 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2025-10-08T00:42:23,747 adding 'deepspeed/io/__init__.py' 2025-10-08T00:42:23,749 adding 'deepspeed/io/base_file_writer.py' 2025-10-08T00:42:23,750 adding 'deepspeed/io/base_io_buffer.py' 2025-10-08T00:42:23,751 adding 'deepspeed/io/constants.py' 2025-10-08T00:42:23,752 adding 'deepspeed/io/double_io_buffer.py' 2025-10-08T00:42:23,754 adding 'deepspeed/io/fast_file_writer.py' 2025-10-08T00:42:23,756 adding 'deepspeed/io/mock_file_writer.py' 2025-10-08T00:42:23,757 adding 'deepspeed/io/py_file_writer.py' 2025-10-08T00:42:23,758 adding 'deepspeed/io/single_io_buffer.py' 2025-10-08T00:42:23,759 adding 'deepspeed/io/utils.py' 2025-10-08T00:42:23,761 adding 'deepspeed/launcher/__init__.py' 2025-10-08T00:42:23,762 adding 'deepspeed/launcher/constants.py' 2025-10-08T00:42:23,764 adding 'deepspeed/launcher/launch.py' 2025-10-08T00:42:23,766 adding 'deepspeed/launcher/launcher_helper.py' 2025-10-08T00:42:23,768 adding 'deepspeed/launcher/multinode_runner.py' 2025-10-08T00:42:23,771 adding 'deepspeed/launcher/runner.py' 2025-10-08T00:42:23,773 adding 'deepspeed/linear/__init__.py' 2025-10-08T00:42:23,774 adding 'deepspeed/linear/config.py' 2025-10-08T00:42:23,775 adding 'deepspeed/linear/context_manager.py' 2025-10-08T00:42:23,777 adding 'deepspeed/linear/optimized_linear.py' 2025-10-08T00:42:23,778 adding 'deepspeed/linear/quantization.py' 2025-10-08T00:42:23,780 adding 'deepspeed/model_implementations/__init__.py' 2025-10-08T00:42:23,781 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2025-10-08T00:42:23,783 adding 'deepspeed/model_implementations/diffusers/unet.py' 2025-10-08T00:42:23,784 adding 'deepspeed/model_implementations/diffusers/vae.py' 2025-10-08T00:42:23,786 adding 'deepspeed/model_implementations/features/__init__.py' 2025-10-08T00:42:23,787 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2025-10-08T00:42:23,789 adding 'deepspeed/model_implementations/transformers/__init__.py' 2025-10-08T00:42:23,790 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2025-10-08T00:42:23,791 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2025-10-08T00:42:23,793 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2025-10-08T00:42:23,794 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2025-10-08T00:42:23,795 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2025-10-08T00:42:23,797 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2025-10-08T00:42:23,798 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2025-10-08T00:42:23,799 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2025-10-08T00:42:23,801 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2025-10-08T00:42:23,803 adding 'deepspeed/module_inject/__init__.py' 2025-10-08T00:42:23,806 adding 'deepspeed/module_inject/auto_tp.py' 2025-10-08T00:42:23,807 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2025-10-08T00:42:23,809 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2025-10-08T00:42:23,811 adding 'deepspeed/module_inject/inject.py' 2025-10-08T00:42:23,814 adding 'deepspeed/module_inject/layers.py' 2025-10-08T00:42:23,816 adding 'deepspeed/module_inject/load_checkpoint.py' 2025-10-08T00:42:23,818 adding 'deepspeed/module_inject/module_quantize.py' 2025-10-08T00:42:23,819 adding 'deepspeed/module_inject/policy.py' 2025-10-08T00:42:23,823 adding 'deepspeed/module_inject/replace_module.py' 2025-10-08T00:42:23,824 adding 'deepspeed/module_inject/replace_policy.py' 2025-10-08T00:42:23,826 adding 'deepspeed/module_inject/tp_shard.py' 2025-10-08T00:42:23,827 adding 'deepspeed/module_inject/utils.py' 2025-10-08T00:42:23,829 adding 'deepspeed/module_inject/containers/__init__.py' 2025-10-08T00:42:23,831 adding 'deepspeed/module_inject/containers/base.py' 2025-10-08T00:42:23,832 adding 'deepspeed/module_inject/containers/base_moe.py' 2025-10-08T00:42:23,834 adding 'deepspeed/module_inject/containers/bert.py' 2025-10-08T00:42:23,835 adding 'deepspeed/module_inject/containers/bloom.py' 2025-10-08T00:42:23,837 adding 'deepspeed/module_inject/containers/clip.py' 2025-10-08T00:42:23,838 adding 'deepspeed/module_inject/containers/distil_bert.py' 2025-10-08T00:42:23,839 adding 'deepspeed/module_inject/containers/gpt2.py' 2025-10-08T00:42:23,841 adding 'deepspeed/module_inject/containers/gptj.py' 2025-10-08T00:42:23,842 adding 'deepspeed/module_inject/containers/gptneo.py' 2025-10-08T00:42:23,844 adding 'deepspeed/module_inject/containers/gptneox.py' 2025-10-08T00:42:23,845 adding 'deepspeed/module_inject/containers/internlm.py' 2025-10-08T00:42:23,847 adding 'deepspeed/module_inject/containers/llama.py' 2025-10-08T00:42:23,848 adding 'deepspeed/module_inject/containers/llama2.py' 2025-10-08T00:42:23,850 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2025-10-08T00:42:23,851 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2025-10-08T00:42:23,852 adding 'deepspeed/module_inject/containers/opt.py' 2025-10-08T00:42:23,853 adding 'deepspeed/module_inject/containers/unet.py' 2025-10-08T00:42:23,854 adding 'deepspeed/module_inject/containers/vae.py' 2025-10-08T00:42:23,856 adding 'deepspeed/module_inject/containers/features/__init__.py' 2025-10-08T00:42:23,857 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2025-10-08T00:42:23,859 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2025-10-08T00:42:23,860 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2025-10-08T00:42:23,862 adding 'deepspeed/module_inject/containers/features/megatron.py' 2025-10-08T00:42:23,863 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2025-10-08T00:42:23,865 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2025-10-08T00:42:23,866 adding 'deepspeed/moe/__init__.py' 2025-10-08T00:42:23,867 adding 'deepspeed/moe/experts.py' 2025-10-08T00:42:23,869 adding 'deepspeed/moe/layer.py' 2025-10-08T00:42:23,870 adding 'deepspeed/moe/mappings.py' 2025-10-08T00:42:23,873 adding 'deepspeed/moe/sharded_moe.py' 2025-10-08T00:42:23,875 adding 'deepspeed/moe/utils.py' 2025-10-08T00:42:23,877 adding 'deepspeed/monitor/__init__.py' 2025-10-08T00:42:23,878 adding 'deepspeed/monitor/comet.py' 2025-10-08T00:42:23,879 adding 'deepspeed/monitor/config.py' 2025-10-08T00:42:23,881 adding 'deepspeed/monitor/csv_monitor.py' 2025-10-08T00:42:23,882 adding 'deepspeed/monitor/monitor.py' 2025-10-08T00:42:23,883 adding 'deepspeed/monitor/tensorboard.py' 2025-10-08T00:42:23,884 adding 'deepspeed/monitor/utils.py' 2025-10-08T00:42:23,885 adding 'deepspeed/monitor/wandb.py' 2025-10-08T00:42:23,887 adding 'deepspeed/nebula/__init__.py' 2025-10-08T00:42:23,889 adding 'deepspeed/nebula/config.py' 2025-10-08T00:42:23,890 adding 'deepspeed/nebula/constants.py' 2025-10-08T00:42:23,892 adding 'deepspeed/nvme/__init__.py' 2025-10-08T00:42:23,894 adding 'deepspeed/nvme/ds_aio_args.py' 2025-10-08T00:42:23,895 adding 'deepspeed/nvme/ds_aio_basic.py' 2025-10-08T00:42:23,896 adding 'deepspeed/nvme/ds_aio_constants.py' 2025-10-08T00:42:23,898 adding 'deepspeed/nvme/ds_aio_handle.py' 2025-10-08T00:42:23,899 adding 'deepspeed/nvme/ds_aio_job.py' 2025-10-08T00:42:23,900 adding 'deepspeed/nvme/io_engine.py' 2025-10-08T00:42:23,902 adding 'deepspeed/nvme/parse_nvme_stats.py' 2025-10-08T00:42:23,903 adding 'deepspeed/nvme/perf_generate_param.py' 2025-10-08T00:42:23,905 adding 'deepspeed/nvme/perf_run_sweep.py' 2025-10-08T00:42:23,906 adding 'deepspeed/nvme/perf_sweep_utils.py' 2025-10-08T00:42:23,907 adding 'deepspeed/nvme/test_ds_aio.py' 2025-10-08T00:42:23,909 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2025-10-08T00:42:23,910 adding 'deepspeed/nvme/torch_fastio_engine.py' 2025-10-08T00:42:23,911 adding 'deepspeed/nvme/torch_io.py' 2025-10-08T00:42:23,912 adding 'deepspeed/nvme/validate_async_io.py' 2025-10-08T00:42:23,914 adding 'deepspeed/ops/__init__.py' 2025-10-08T00:42:23,916 adding 'deepspeed/ops/adagrad/__init__.py' 2025-10-08T00:42:23,917 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2025-10-08T00:42:23,919 adding 'deepspeed/ops/adam/__init__.py' 2025-10-08T00:42:23,921 adding 'deepspeed/ops/adam/cpu_adam.py' 2025-10-08T00:42:23,923 adding 'deepspeed/ops/adam/fused_adam.py' 2025-10-08T00:42:23,924 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2025-10-08T00:42:23,925 adding 'deepspeed/ops/adam/zenflow_cpu_adam.py' 2025-10-08T00:42:23,929 adding 'deepspeed/ops/adam/zenflow_torch_adam.py' 2025-10-08T00:42:23,930 adding 'deepspeed/ops/aio/__init__.py' 2025-10-08T00:42:23,932 adding 'deepspeed/ops/compile/__init__.py' 2025-10-08T00:42:23,934 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2025-10-08T00:42:23,936 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2025-10-08T00:42:23,938 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2025-10-08T00:42:23,939 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2025-10-08T00:42:23,940 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2025-10-08T00:42:23,942 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2025-10-08T00:42:23,944 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2025-10-08T00:42:23,946 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2025-10-08T00:42:23,947 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2025-10-08T00:42:23,948 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2025-10-08T00:42:23,950 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2025-10-08T00:42:23,951 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2025-10-08T00:42:23,953 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2025-10-08T00:42:23,954 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2025-10-08T00:42:23,955 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2025-10-08T00:42:23,956 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2025-10-08T00:42:23,957 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2025-10-08T00:42:23,959 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2025-10-08T00:42:23,960 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2025-10-08T00:42:23,961 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2025-10-08T00:42:23,962 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2025-10-08T00:42:23,963 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2025-10-08T00:42:23,965 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2025-10-08T00:42:23,966 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2025-10-08T00:42:23,967 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2025-10-08T00:42:23,968 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2025-10-08T00:42:23,970 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2025-10-08T00:42:23,972 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2025-10-08T00:42:23,973 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2025-10-08T00:42:23,975 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2025-10-08T00:42:23,977 adding 'deepspeed/ops/csrc/compile/deepcompile.cpp' 2025-10-08T00:42:23,978 adding 'deepspeed/ops/csrc/compile/init.cpp' 2025-10-08T00:42:23,980 adding 'deepspeed/ops/csrc/compile/util.cpp' 2025-10-08T00:42:23,981 adding 'deepspeed/ops/csrc/compile/z1.cpp' 2025-10-08T00:42:23,982 adding 'deepspeed/ops/csrc/compile/z1.h' 2025-10-08T00:42:23,984 adding 'deepspeed/ops/csrc/compile/z2.cpp' 2025-10-08T00:42:23,985 adding 'deepspeed/ops/csrc/compile/z2.h' 2025-10-08T00:42:23,987 adding 'deepspeed/ops/csrc/compile/z3.cpp' 2025-10-08T00:42:23,989 adding 'deepspeed/ops/csrc/compile/z3.h' 2025-10-08T00:42:23,991 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2025-10-08T00:42:23,994 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2025-10-08T00:42:23,996 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2025-10-08T00:42:23,998 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2025-10-08T00:42:23,999 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2025-10-08T00:42:24,001 adding 'deepspeed/ops/csrc/cpu/comm/riscv64/shm.h' 2025-10-08T00:42:24,003 adding 'deepspeed/ops/csrc/cpu/comm/x86_64/shm.h' 2025-10-08T00:42:24,005 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2025-10-08T00:42:24,007 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2025-10-08T00:42:24,009 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2025-10-08T00:42:24,011 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2025-10-08T00:42:24,012 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2025-10-08T00:42:24,020 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2025-10-08T00:42:24,025 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2025-10-08T00:42:24,027 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2025-10-08T00:42:24,030 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2025-10-08T00:42:24,031 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2025-10-08T00:42:24,033 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2025-10-08T00:42:24,035 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2025-10-08T00:42:24,036 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2025-10-08T00:42:24,039 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2025-10-08T00:42:24,042 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2025-10-08T00:42:24,043 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2025-10-08T00:42:24,045 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2025-10-08T00:42:24,052 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2025-10-08T00:42:24,056 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2025-10-08T00:42:24,057 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2025-10-08T00:42:24,061 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2025-10-08T00:42:24,064 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2025-10-08T00:42:24,068 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2025-10-08T00:42:24,070 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2025-10-08T00:42:24,072 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2025-10-08T00:42:24,074 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2025-10-08T00:42:24,075 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2025-10-08T00:42:24,077 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2025-10-08T00:42:24,080 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2025-10-08T00:42:24,081 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2025-10-08T00:42:24,083 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2025-10-08T00:42:24,085 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2025-10-08T00:42:24,087 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2025-10-08T00:42:24,088 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2025-10-08T00:42:24,089 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2025-10-08T00:42:24,091 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2025-10-08T00:42:24,092 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2025-10-08T00:42:24,094 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2025-10-08T00:42:24,096 adding 'deepspeed/ops/csrc/includes/Timer.h' 2025-10-08T00:42:24,097 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2025-10-08T00:42:24,098 adding 'deepspeed/ops/csrc/includes/compat.h' 2025-10-08T00:42:24,100 adding 'deepspeed/ops/csrc/includes/context.h' 2025-10-08T00:42:24,101 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2025-10-08T00:42:24,103 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2025-10-08T00:42:24,104 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2025-10-08T00:42:24,105 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2025-10-08T00:42:24,106 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2025-10-08T00:42:24,108 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2025-10-08T00:42:24,111 adding 'deepspeed/ops/csrc/includes/deepcompile.h' 2025-10-08T00:42:24,112 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2025-10-08T00:42:24,113 adding 'deepspeed/ops/csrc/includes/dropout.h' 2025-10-08T00:42:24,114 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2025-10-08T00:42:24,116 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2025-10-08T00:42:24,117 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2025-10-08T00:42:24,118 adding 'deepspeed/ops/csrc/includes/gelu.h' 2025-10-08T00:42:24,120 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2025-10-08T00:42:24,121 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2025-10-08T00:42:24,124 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2025-10-08T00:42:24,125 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2025-10-08T00:42:24,126 adding 'deepspeed/ops/csrc/includes/quantization.h' 2025-10-08T00:42:24,129 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2025-10-08T00:42:24,130 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2025-10-08T00:42:24,132 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2025-10-08T00:42:24,134 adding 'deepspeed/ops/csrc/includes/simd.h' 2025-10-08T00:42:24,136 adding 'deepspeed/ops/csrc/includes/softmax.h' 2025-10-08T00:42:24,137 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2025-10-08T00:42:24,139 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2025-10-08T00:42:24,141 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2025-10-08T00:42:24,143 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2025-10-08T00:42:24,144 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2025-10-08T00:42:24,146 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2025-10-08T00:42:24,147 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2025-10-08T00:42:24,149 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2025-10-08T00:42:24,150 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2025-10-08T00:42:24,152 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2025-10-08T00:42:24,155 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2025-10-08T00:42:24,157 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2025-10-08T00:42:24,159 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2025-10-08T00:42:24,161 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2025-10-08T00:42:24,162 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2025-10-08T00:42:24,164 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2025-10-08T00:42:24,166 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2025-10-08T00:42:24,168 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2025-10-08T00:42:24,169 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2025-10-08T00:42:24,171 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2025-10-08T00:42:24,173 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2025-10-08T00:42:24,175 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2025-10-08T00:42:24,177 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2025-10-08T00:42:24,179 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2025-10-08T00:42:24,181 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2025-10-08T00:42:24,184 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2025-10-08T00:42:24,187 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2025-10-08T00:42:24,189 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2025-10-08T00:42:24,191 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2025-10-08T00:42:24,195 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2025-10-08T00:42:24,198 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2025-10-08T00:42:24,200 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2025-10-08T00:42:24,203 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2025-10-08T00:42:24,204 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2025-10-08T00:42:24,207 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2025-10-08T00:42:24,209 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2025-10-08T00:42:24,211 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2025-10-08T00:42:24,216 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2025-10-08T00:42:24,218 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2025-10-08T00:42:24,220 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2025-10-08T00:42:24,222 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2025-10-08T00:42:24,225 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2025-10-08T00:42:24,228 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2025-10-08T00:42:24,229 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2025-10-08T00:42:24,231 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2025-10-08T00:42:24,233 adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp' 2025-10-08T00:42:24,234 adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp' 2025-10-08T00:42:24,235 adding 'deepspeed/ops/csrc/utils/tensor_cast.h' 2025-10-08T00:42:24,238 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2025-10-08T00:42:24,239 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2025-10-08T00:42:24,241 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2025-10-08T00:42:24,242 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2025-10-08T00:42:24,244 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2025-10-08T00:42:24,246 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2025-10-08T00:42:24,248 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2025-10-08T00:42:24,249 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2025-10-08T00:42:24,251 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2025-10-08T00:42:24,252 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2025-10-08T00:42:24,254 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2025-10-08T00:42:24,256 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2025-10-08T00:42:24,257 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2025-10-08T00:42:24,259 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2025-10-08T00:42:24,260 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2025-10-08T00:42:24,261 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2025-10-08T00:42:24,263 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2025-10-08T00:42:24,265 adding 'deepspeed/ops/gds/__init__.py' 2025-10-08T00:42:24,266 adding 'deepspeed/ops/lamb/__init__.py' 2025-10-08T00:42:24,268 adding 'deepspeed/ops/lamb/fused_lamb.py' 2025-10-08T00:42:24,270 adding 'deepspeed/ops/lion/__init__.py' 2025-10-08T00:42:24,271 adding 'deepspeed/ops/lion/cpu_lion.py' 2025-10-08T00:42:24,273 adding 'deepspeed/ops/lion/fused_lion.py' 2025-10-08T00:42:24,274 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2025-10-08T00:42:24,277 adding 'deepspeed/ops/op_builder/__init__.py' 2025-10-08T00:42:24,278 adding 'deepspeed/ops/op_builder/all_ops.py' 2025-10-08T00:42:24,279 adding 'deepspeed/ops/op_builder/async_io.py' 2025-10-08T00:42:24,283 adding 'deepspeed/ops/op_builder/builder.py' 2025-10-08T00:42:24,285 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2025-10-08T00:42:24,286 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2025-10-08T00:42:24,287 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2025-10-08T00:42:24,288 adding 'deepspeed/ops/op_builder/dc.py' 2025-10-08T00:42:24,289 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2025-10-08T00:42:24,290 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2025-10-08T00:42:24,292 adding 'deepspeed/ops/op_builder/fused_adam.py' 2025-10-08T00:42:24,293 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2025-10-08T00:42:24,294 adding 'deepspeed/ops/op_builder/fused_lion.py' 2025-10-08T00:42:24,295 adding 'deepspeed/ops/op_builder/gds.py' 2025-10-08T00:42:24,296 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2025-10-08T00:42:24,297 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2025-10-08T00:42:24,299 adding 'deepspeed/ops/op_builder/quantizer.py' 2025-10-08T00:42:24,300 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2025-10-08T00:42:24,302 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2025-10-08T00:42:24,304 adding 'deepspeed/ops/op_builder/random_ltd.py' 2025-10-08T00:42:24,305 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2025-10-08T00:42:24,307 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2025-10-08T00:42:24,308 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2025-10-08T00:42:24,309 adding 'deepspeed/ops/op_builder/transformer.py' 2025-10-08T00:42:24,311 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2025-10-08T00:42:24,312 adding 'deepspeed/ops/op_builder/utils.py' 2025-10-08T00:42:24,314 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2025-10-08T00:42:24,316 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2025-10-08T00:42:24,317 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2025-10-08T00:42:24,319 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2025-10-08T00:42:24,320 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2025-10-08T00:42:24,321 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2025-10-08T00:42:24,322 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2025-10-08T00:42:24,324 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2025-10-08T00:42:24,325 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2025-10-08T00:42:24,326 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2025-10-08T00:42:24,328 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2025-10-08T00:42:24,329 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2025-10-08T00:42:24,331 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2025-10-08T00:42:24,332 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2025-10-08T00:42:24,334 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2025-10-08T00:42:24,335 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2025-10-08T00:42:24,336 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2025-10-08T00:42:24,337 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2025-10-08T00:42:24,338 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2025-10-08T00:42:24,340 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2025-10-08T00:42:24,342 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2025-10-08T00:42:24,343 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2025-10-08T00:42:24,344 adding 'deepspeed/ops/op_builder/npu/builder.py' 2025-10-08T00:42:24,346 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2025-10-08T00:42:24,347 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2025-10-08T00:42:24,348 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2025-10-08T00:42:24,349 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2025-10-08T00:42:24,351 adding 'deepspeed/ops/op_builder/npu/inference.py' 2025-10-08T00:42:24,352 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2025-10-08T00:42:24,354 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2025-10-08T00:42:24,356 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2025-10-08T00:42:24,357 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2025-10-08T00:42:24,358 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2025-10-08T00:42:24,360 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2025-10-08T00:42:24,362 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2025-10-08T00:42:24,363 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2025-10-08T00:42:24,364 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2025-10-08T00:42:24,365 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2025-10-08T00:42:24,366 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2025-10-08T00:42:24,368 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2025-10-08T00:42:24,369 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2025-10-08T00:42:24,370 adding 'deepspeed/ops/op_builder/xpu/inference.py' 2025-10-08T00:42:24,371 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2025-10-08T00:42:24,372 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2025-10-08T00:42:24,374 adding 'deepspeed/ops/quantizer/__init__.py' 2025-10-08T00:42:24,375 adding 'deepspeed/ops/quantizer/quantizer.py' 2025-10-08T00:42:24,377 adding 'deepspeed/ops/random_ltd/__init__.py' 2025-10-08T00:42:24,378 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2025-10-08T00:42:24,380 adding 'deepspeed/ops/sparse_attention/__init__.py' 2025-10-08T00:42:24,381 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2025-10-08T00:42:24,385 adding 'deepspeed/ops/sparse_attention/matmul.py' 2025-10-08T00:42:24,387 adding 'deepspeed/ops/sparse_attention/softmax.py' 2025-10-08T00:42:24,389 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2025-10-08T00:42:24,390 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2025-10-08T00:42:24,394 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2025-10-08T00:42:24,395 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2025-10-08T00:42:24,397 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2025-10-08T00:42:24,398 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2025-10-08T00:42:24,400 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2025-10-08T00:42:24,401 adding 'deepspeed/ops/transformer/__init__.py' 2025-10-08T00:42:24,404 adding 'deepspeed/ops/transformer/transformer.py' 2025-10-08T00:42:24,406 adding 'deepspeed/ops/transformer/inference/__init__.py' 2025-10-08T00:42:24,407 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2025-10-08T00:42:24,408 adding 'deepspeed/ops/transformer/inference/config.py' 2025-10-08T00:42:24,410 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2025-10-08T00:42:24,411 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2025-10-08T00:42:24,413 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2025-10-08T00:42:24,415 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2025-10-08T00:42:24,416 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2025-10-08T00:42:24,418 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2025-10-08T00:42:24,420 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2025-10-08T00:42:24,422 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2025-10-08T00:42:24,423 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2025-10-08T00:42:24,424 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2025-10-08T00:42:24,425 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2025-10-08T00:42:24,427 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2025-10-08T00:42:24,428 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2025-10-08T00:42:24,429 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2025-10-08T00:42:24,430 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2025-10-08T00:42:24,432 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2025-10-08T00:42:24,433 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2025-10-08T00:42:24,434 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2025-10-08T00:42:24,436 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2025-10-08T00:42:24,437 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2025-10-08T00:42:24,438 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2025-10-08T00:42:24,439 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2025-10-08T00:42:24,441 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2025-10-08T00:42:24,442 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2025-10-08T00:42:24,443 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2025-10-08T00:42:24,444 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2025-10-08T00:42:24,446 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2025-10-08T00:42:24,447 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2025-10-08T00:42:24,448 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2025-10-08T00:42:24,450 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2025-10-08T00:42:24,452 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2025-10-08T00:42:24,454 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2025-10-08T00:42:24,455 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2025-10-08T00:42:24,456 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2025-10-08T00:42:24,458 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2025-10-08T00:42:24,460 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2025-10-08T00:42:24,461 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2025-10-08T00:42:24,463 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2025-10-08T00:42:24,464 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2025-10-08T00:42:24,466 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2025-10-08T00:42:24,468 adding 'deepspeed/pipe/__init__.py' 2025-10-08T00:42:24,469 adding 'deepspeed/profiling/__init__.py' 2025-10-08T00:42:24,470 adding 'deepspeed/profiling/config.py' 2025-10-08T00:42:24,472 adding 'deepspeed/profiling/constants.py' 2025-10-08T00:42:24,473 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2025-10-08T00:42:24,478 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2025-10-08T00:42:24,481 adding 'deepspeed/runtime/__init__.py' 2025-10-08T00:42:24,482 adding 'deepspeed/runtime/base_optimizer.py' 2025-10-08T00:42:24,485 adding 'deepspeed/runtime/bf16_optimizer.py' 2025-10-08T00:42:24,487 adding 'deepspeed/runtime/compiler.py' 2025-10-08T00:42:24,491 adding 'deepspeed/runtime/config.py' 2025-10-08T00:42:24,493 adding 'deepspeed/runtime/config_utils.py' 2025-10-08T00:42:24,495 adding 'deepspeed/runtime/constants.py' 2025-10-08T00:42:24,496 adding 'deepspeed/runtime/dataloader.py' 2025-10-08T00:42:24,498 adding 'deepspeed/runtime/eigenvalue.py' 2025-10-08T00:42:24,520 adding 'deepspeed/runtime/engine.py' 2025-10-08T00:42:24,523 adding 'deepspeed/runtime/hybrid_engine.py' 2025-10-08T00:42:24,527 adding 'deepspeed/runtime/lr_schedules.py' 2025-10-08T00:42:24,529 adding 'deepspeed/runtime/precision_config.py' 2025-10-08T00:42:24,530 adding 'deepspeed/runtime/progressive_layer_drop.py' 2025-10-08T00:42:24,532 adding 'deepspeed/runtime/quantize.py' 2025-10-08T00:42:24,533 adding 'deepspeed/runtime/sparse_tensor.py' 2025-10-08T00:42:24,535 adding 'deepspeed/runtime/state_dict_factory.py' 2025-10-08T00:42:24,537 adding 'deepspeed/runtime/torch_autocast.py' 2025-10-08T00:42:24,542 adding 'deepspeed/runtime/utils.py' 2025-10-08T00:42:24,544 adding 'deepspeed/runtime/weight_quantizer.py' 2025-10-08T00:42:24,546 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2025-10-08T00:42:24,551 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2025-10-08T00:42:24,552 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2025-10-08T00:42:24,554 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2025-10-08T00:42:24,555 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2025-10-08T00:42:24,556 adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py' 2025-10-08T00:42:24,558 adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py' 2025-10-08T00:42:24,559 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2025-10-08T00:42:24,561 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2025-10-08T00:42:24,562 adding 'deepspeed/runtime/checkpoint_engine/utils.py' 2025-10-08T00:42:24,563 adding 'deepspeed/runtime/comm/__init__.py' 2025-10-08T00:42:24,565 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2025-10-08T00:42:24,567 adding 'deepspeed/runtime/comm/compressed.py' 2025-10-08T00:42:24,568 adding 'deepspeed/runtime/comm/hccl.py' 2025-10-08T00:42:24,570 adding 'deepspeed/runtime/comm/mpi.py' 2025-10-08T00:42:24,572 adding 'deepspeed/runtime/comm/nccl.py' 2025-10-08T00:42:24,573 adding 'deepspeed/runtime/compression/__init__.py' 2025-10-08T00:42:24,574 adding 'deepspeed/runtime/compression/cupy.py' 2025-10-08T00:42:24,576 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2025-10-08T00:42:24,577 adding 'deepspeed/runtime/data_pipeline/config.py' 2025-10-08T00:42:24,579 adding 'deepspeed/runtime/data_pipeline/constants.py' 2025-10-08T00:42:24,580 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2025-10-08T00:42:24,582 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2025-10-08T00:42:24,583 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2025-10-08T00:42:24,584 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2025-10-08T00:42:24,586 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2025-10-08T00:42:24,587 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2025-10-08T00:42:24,589 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2025-10-08T00:42:24,594 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2025-10-08T00:42:24,596 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2025-10-08T00:42:24,599 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2025-10-08T00:42:24,600 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2025-10-08T00:42:24,603 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2025-10-08T00:42:24,605 adding 'deepspeed/runtime/domino/__init__.py' 2025-10-08T00:42:24,607 adding 'deepspeed/runtime/domino/async_linear.py' 2025-10-08T00:42:24,609 adding 'deepspeed/runtime/domino/transformer.py' 2025-10-08T00:42:24,611 adding 'deepspeed/runtime/fp16/__init__.py' 2025-10-08T00:42:24,614 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2025-10-08T00:42:24,616 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2025-10-08T00:42:24,618 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2025-10-08T00:42:24,620 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2025-10-08T00:42:24,622 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2025-10-08T00:42:24,625 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2025-10-08T00:42:24,627 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2025-10-08T00:42:24,629 adding 'deepspeed/runtime/model_checkpointing/__init__.py' 2025-10-08T00:42:24,630 adding 'deepspeed/runtime/model_checkpointing/config.py' 2025-10-08T00:42:24,632 adding 'deepspeed/runtime/model_checkpointing/constants.py' 2025-10-08T00:42:24,633 adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py' 2025-10-08T00:42:24,635 adding 'deepspeed/runtime/model_checkpointing/utils.py' 2025-10-08T00:42:24,636 adding 'deepspeed/runtime/model_checkpointing/writer_factory.py' 2025-10-08T00:42:24,638 adding 'deepspeed/runtime/pipe/__init__.py' 2025-10-08T00:42:24,644 adding 'deepspeed/runtime/pipe/engine.py' 2025-10-08T00:42:24,648 adding 'deepspeed/runtime/pipe/module.py' 2025-10-08T00:42:24,650 adding 'deepspeed/runtime/pipe/p2p.py' 2025-10-08T00:42:24,652 adding 'deepspeed/runtime/pipe/schedule.py' 2025-10-08T00:42:24,654 adding 'deepspeed/runtime/pipe/topology.py' 2025-10-08T00:42:24,656 adding 'deepspeed/runtime/sequence_parallel/__init__.py' 2025-10-08T00:42:24,657 adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py' 2025-10-08T00:42:24,664 adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py' 2025-10-08T00:42:24,666 adding 'deepspeed/runtime/superoffload/__init__.py' 2025-10-08T00:42:24,668 adding 'deepspeed/runtime/superoffload/superoffload_stage3.py' 2025-10-08T00:42:24,670 adding 'deepspeed/runtime/superoffload/superoffload_utils.py' 2025-10-08T00:42:24,671 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2025-10-08T00:42:24,673 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2025-10-08T00:42:24,674 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2025-10-08T00:42:24,675 adding 'deepspeed/runtime/swap_tensor/constants.py' 2025-10-08T00:42:24,678 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2025-10-08T00:42:24,680 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2025-10-08T00:42:24,682 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2025-10-08T00:42:24,684 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2025-10-08T00:42:24,685 adding 'deepspeed/runtime/swap_tensor/utils.py' 2025-10-08T00:42:24,687 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2025-10-08T00:42:24,688 adding 'deepspeed/runtime/tensor_parallel/config.py' 2025-10-08T00:42:24,690 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2025-10-08T00:42:24,691 adding 'deepspeed/runtime/zenflow/__init__.py' 2025-10-08T00:42:24,693 adding 'deepspeed/runtime/zenflow/engine.py' 2025-10-08T00:42:24,694 adding 'deepspeed/runtime/zenflow/zenflow_config.py' 2025-10-08T00:42:24,699 adding 'deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py' 2025-10-08T00:42:24,700 adding 'deepspeed/runtime/zenflow/zenflow_utils.py' 2025-10-08T00:42:24,702 adding 'deepspeed/runtime/zero/__init__.py' 2025-10-08T00:42:24,704 adding 'deepspeed/runtime/zero/config.py' 2025-10-08T00:42:24,706 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2025-10-08T00:42:24,708 adding 'deepspeed/runtime/zero/leaf_module_config.py' 2025-10-08T00:42:24,709 adding 'deepspeed/runtime/zero/linear.py' 2025-10-08T00:42:24,712 adding 'deepspeed/runtime/zero/mics.py' 2025-10-08T00:42:24,714 adding 'deepspeed/runtime/zero/mics_utils.py' 2025-10-08T00:42:24,715 adding 'deepspeed/runtime/zero/offload_config.py' 2025-10-08T00:42:24,716 adding 'deepspeed/runtime/zero/offload_states.py' 2025-10-08T00:42:24,719 adding 'deepspeed/runtime/zero/parameter_offload.py' 2025-10-08T00:42:24,731 adding 'deepspeed/runtime/zero/partition_parameters.py' 2025-10-08T00:42:24,735 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2025-10-08T00:42:24,737 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2025-10-08T00:42:24,753 adding 'deepspeed/runtime/zero/stage3.py' 2025-10-08T00:42:24,769 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2025-10-08T00:42:24,771 adding 'deepspeed/runtime/zero/test.py' 2025-10-08T00:42:24,773 adding 'deepspeed/runtime/zero/tiling.py' 2025-10-08T00:42:24,775 adding 'deepspeed/runtime/zero/utils.py' 2025-10-08T00:42:24,776 adding 'deepspeed/runtime/zero/muon/__init__.py' 2025-10-08T00:42:24,778 adding 'deepspeed/runtime/zero/muon/muon_optimizer.py' 2025-10-08T00:42:24,779 adding 'deepspeed/runtime/zero/muon/original_muon.py' 2025-10-08T00:42:24,781 adding 'deepspeed/sequence/__init__.py' 2025-10-08T00:42:24,782 adding 'deepspeed/sequence/cross_entropy.py' 2025-10-08T00:42:24,787 adding 'deepspeed/sequence/fpdt_layer.py' 2025-10-08T00:42:24,790 adding 'deepspeed/sequence/layer.py' 2025-10-08T00:42:24,791 adding 'deepspeed/utils/__init__.py' 2025-10-08T00:42:24,793 adding 'deepspeed/utils/bwc.py' 2025-10-08T00:42:24,795 adding 'deepspeed/utils/comms_logging.py' 2025-10-08T00:42:24,796 adding 'deepspeed/utils/config.py' 2025-10-08T00:42:24,797 adding 'deepspeed/utils/debug.py' 2025-10-08T00:42:24,798 adding 'deepspeed/utils/exceptions.py' 2025-10-08T00:42:24,801 adding 'deepspeed/utils/groups.py' 2025-10-08T00:42:24,803 adding 'deepspeed/utils/init_on_device.py' 2025-10-08T00:42:24,804 adding 'deepspeed/utils/logging.py' 2025-10-08T00:42:24,806 adding 'deepspeed/utils/mixed_precision_linkage.py' 2025-10-08T00:42:24,807 adding 'deepspeed/utils/numa.py' 2025-10-08T00:42:24,808 adding 'deepspeed/utils/nvtx.py' 2025-10-08T00:42:24,810 adding 'deepspeed/utils/tensor_fragment.py' 2025-10-08T00:42:24,812 adding 'deepspeed/utils/timer.py' 2025-10-08T00:42:24,813 adding 'deepspeed/utils/torch.py' 2025-10-08T00:42:24,814 adding 'deepspeed/utils/types.py' 2025-10-08T00:42:24,816 adding 'deepspeed/utils/z3_leaf_module.py' 2025-10-08T00:42:24,820 adding 'deepspeed/utils/zero_to_fp32.py' 2025-10-08T00:42:24,822 adding 'deepspeed-0.18.0.data/scripts/deepspeed' 2025-10-08T00:42:24,823 adding 'deepspeed-0.18.0.data/scripts/deepspeed.pt' 2025-10-08T00:42:24,824 adding 'deepspeed-0.18.0.data/scripts/ds' 2025-10-08T00:42:24,825 adding 'deepspeed-0.18.0.data/scripts/ds_bench' 2025-10-08T00:42:24,826 adding 'deepspeed-0.18.0.data/scripts/ds_elastic' 2025-10-08T00:42:24,827 adding 'deepspeed-0.18.0.data/scripts/ds_io' 2025-10-08T00:42:24,829 adding 'deepspeed-0.18.0.data/scripts/ds_nvme_tune' 2025-10-08T00:42:24,830 adding 'deepspeed-0.18.0.data/scripts/ds_report' 2025-10-08T00:42:24,831 adding 'deepspeed-0.18.0.data/scripts/ds_ssh' 2025-10-08T00:42:24,832 adding 'deepspeed-0.18.0.data/scripts/dsr' 2025-10-08T00:42:24,835 adding 'deepspeed-0.18.0.dist-info/licenses/LICENSE' 2025-10-08T00:42:24,840 adding 'deepspeed-0.18.0.dist-info/METADATA' 2025-10-08T00:42:24,841 adding 'deepspeed-0.18.0.dist-info/WHEEL' 2025-10-08T00:42:24,842 adding 'deepspeed-0.18.0.dist-info/entry_points.txt' 2025-10-08T00:42:24,843 adding 'deepspeed-0.18.0.dist-info/top_level.txt' 2025-10-08T00:42:24,859 adding 'deepspeed-0.18.0.dist-info/RECORD' 2025-10-08T00:42:24,890 removing build/bdist.linux-armv7l/wheel 2025-10-08T00:42:25,134 deepspeed build time = 12.657825946807861 secs 2025-10-08T00:42:25,259 Building wheel for deepspeed (setup.py): finished with status 'done' 2025-10-08T00:42:25,279 Created wheel for deepspeed: filename=deepspeed-0.18.0-py3-none-any.whl size=1754899 sha256=3806dbea5c2f5799704a24d865cc115c4144608ad04994b8096a3cfd085e52d3 2025-10-08T00:42:25,280 Stored in directory: /tmp/pip-ephem-wheel-cache-3g60mlo1/wheels/86/67/37/80b94cbe666a157d3cc8abc158bc3bb77823fb8ae5b70c8dd1 2025-10-08T00:42:25,326 Successfully built deepspeed 2025-10-08T00:42:25,381 Removed build tracker: '/tmp/pip-build-tracker-501dt203'