2025-10-24T12:43:46,326 Created temporary directory: /tmp/pip-ephem-wheel-cache-vyry0243 2025-10-24T12:43:46,328 Created temporary directory: /tmp/pip-build-tracker-2kgrtazu 2025-10-24T12:43:46,329 Initialized build tracking at /tmp/pip-build-tracker-2kgrtazu 2025-10-24T12:43:46,329 Created build tracker: /tmp/pip-build-tracker-2kgrtazu 2025-10-24T12:43:46,329 Entered build tracker: /tmp/pip-build-tracker-2kgrtazu 2025-10-24T12:43:46,330 Created temporary directory: /tmp/pip-wheel-34uoihus 2025-10-24T12:43:46,333 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2025-10-24T12:43:46,335 Created temporary directory: /tmp/pip-ephem-wheel-cache-g4b8nbj1 2025-10-24T12:43:46,360 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2025-10-24T12:43:46,364 2 location(s) to search for versions of deepspeed: 2025-10-24T12:43:46,364 * https://pypi.org/simple/deepspeed/ 2025-10-24T12:43:46,364 * https://www.piwheels.org/simple/deepspeed/ 2025-10-24T12:43:46,365 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2025-10-24T12:43:46,366 Getting page https://pypi.org/simple/deepspeed/ 2025-10-24T12:43:46,368 Found index url https://pypi.org/simple 2025-10-24T12:43:46,508 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2025-10-24T12:43:46,531 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,532 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2025-10-24T12:43:46,533 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,534 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2025-10-24T12:43:46,535 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,536 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2025-10-24T12:43:46,537 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,537 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2025-10-24T12:43:46,538 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,539 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2025-10-24T12:43:46,539 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2025-10-24T12:43:46,540 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2025-10-24T12:43:46,541 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2025-10-24T12:43:46,542 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2025-10-24T12:43:46,542 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2025-10-24T12:43:46,543 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2025-10-24T12:43:46,544 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2025-10-24T12:43:46,544 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2025-10-24T12:43:46,545 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2025-10-24T12:43:46,546 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2025-10-24T12:43:46,546 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2025-10-24T12:43:46,547 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2025-10-24T12:43:46,548 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2025-10-24T12:43:46,549 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2025-10-24T12:43:46,549 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2025-10-24T12:43:46,550 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2025-10-24T12:43:46,551 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2025-10-24T12:43:46,552 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2025-10-24T12:43:46,552 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2025-10-24T12:43:46,553 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2025-10-24T12:43:46,554 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2025-10-24T12:43:46,554 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2025-10-24T12:43:46,555 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2025-10-24T12:43:46,556 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2025-10-24T12:43:46,556 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2025-10-24T12:43:46,557 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2025-10-24T12:43:46,558 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2025-10-24T12:43:46,558 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2025-10-24T12:43:46,559 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2025-10-24T12:43:46,560 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2025-10-24T12:43:46,561 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2025-10-24T12:43:46,562 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2025-10-24T12:43:46,562 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2025-10-24T12:43:46,563 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2025-10-24T12:43:46,563 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2025-10-24T12:43:46,564 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2025-10-24T12:43:46,565 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2025-10-24T12:43:46,566 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2025-10-24T12:43:46,566 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2025-10-24T12:43:46,567 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2025-10-24T12:43:46,568 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2025-10-24T12:43:46,568 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2025-10-24T12:43:46,569 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2025-10-24T12:43:46,569 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2025-10-24T12:43:46,570 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2025-10-24T12:43:46,571 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2025-10-24T12:43:46,572 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2025-10-24T12:43:46,572 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2025-10-24T12:43:46,573 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2025-10-24T12:43:46,574 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2025-10-24T12:43:46,575 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2025-10-24T12:43:46,576 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2025-10-24T12:43:46,576 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2025-10-24T12:43:46,577 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2025-10-24T12:43:46,578 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2025-10-24T12:43:46,579 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2025-10-24T12:43:46,580 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2025-10-24T12:43:46,580 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2025-10-24T12:43:46,581 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2025-10-24T12:43:46,581 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2025-10-24T12:43:46,582 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2025-10-24T12:43:46,583 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2025-10-24T12:43:46,583 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2025-10-24T12:43:46,584 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2025-10-24T12:43:46,585 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2025-10-24T12:43:46,586 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2025-10-24T12:43:46,587 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2025-10-24T12:43:46,587 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2025-10-24T12:43:46,588 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2025-10-24T12:43:46,589 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2025-10-24T12:43:46,590 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2025-10-24T12:43:46,590 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2025-10-24T12:43:46,591 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2025-10-24T12:43:46,592 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2025-10-24T12:43:46,593 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2025-10-24T12:43:46,594 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2025-10-24T12:43:46,594 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2025-10-24T12:43:46,595 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2025-10-24T12:43:46,595 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2025-10-24T12:43:46,596 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2025-10-24T12:43:46,597 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2025-10-24T12:43:46,597 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2025-10-24T12:43:46,598 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2025-10-24T12:43:46,599 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2025-10-24T12:43:46,600 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2025-10-24T12:43:46,600 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2025-10-24T12:43:46,601 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,602 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2025-10-24T12:43:46,603 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,603 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2025-10-24T12:43:46,604 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2025-10-24T12:43:46,605 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2025-10-24T12:43:46,605 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2025-10-24T12:43:46,606 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2025-10-24T12:43:46,607 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2025-10-24T12:43:46,607 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2025-10-24T12:43:46,608 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2025-10-24T12:43:46,609 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,609 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,610 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,611 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2025-10-24T12:43:46,612 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,612 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,613 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,614 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2025-10-24T12:43:46,614 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,615 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,616 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2025-10-24T12:43:46,617 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2025-10-24T12:43:46,617 Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6 2025-10-24T12:43:46,618 Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7 2025-10-24T12:43:46,619 Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8 2025-10-24T12:43:46,619 Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9 2025-10-24T12:43:46,620 Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0 2025-10-24T12:43:46,621 Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1 2025-10-24T12:43:46,621 Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2 2025-10-24T12:43:46,622 Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3 2025-10-24T12:43:46,623 Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4 2025-10-24T12:43:46,624 Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5 2025-10-24T12:43:46,625 Found link https://files.pythonhosted.org/packages/d4/a9/6130c78d84980ed636092be1a262d6429d539105724e675b6f65ef74a05e/deepspeed-0.17.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.6 2025-10-24T12:43:46,625 Found link https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.0 2025-10-24T12:43:46,626 Found link https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.1 2025-10-24T12:43:46,627 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2025-10-24T12:43:46,628 Getting page https://www.piwheels.org/simple/deepspeed/ 2025-10-24T12:43:46,629 Found index url https://www.piwheels.org/simple 2025-10-24T12:43:46,799 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2025-10-24T12:43:46,822 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.0-py3-none-any.whl#sha256=3806dbea5c2f5799704a24d865cc115c4144608ad04994b8096a3cfd085e52d3 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,823 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.6-py3-none-any.whl#sha256=6142b8dbad6e01ce0890830a65ca1c102f2bf8216edcca0ba86b7c81febd2754 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,824 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.5-py3-none-any.whl#sha256=2fcd7e824802bae8190b39577b346f58a20cba5bd72a63f4fd6a8d9b7ef8e498 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,825 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.4-py3-none-any.whl#sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,825 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,826 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,826 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,827 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,827 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,828 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,828 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,829 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,830 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,831 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,831 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,832 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,832 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,834 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,834 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,835 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,835 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,836 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,836 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,837 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,838 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,839 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,839 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,840 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,840 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,841 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,842 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,843 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,843 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,844 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,844 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,845 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,845 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,846 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,846 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,847 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,848 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,848 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,849 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,850 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,850 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,851 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,853 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,853 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,854 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,854 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,855 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,855 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,856 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,857 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,857 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,858 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,859 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,859 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,860 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,861 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,862 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,862 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,862 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,863 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,864 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,864 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,865 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,866 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,867 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,867 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,868 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,869 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,870 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,871 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,872 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,873 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,873 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,874 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,875 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,875 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,876 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,877 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,877 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,878 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,879 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,880 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,881 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,881 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,882 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,883 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2025-10-24T12:43:46,884 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2025-10-24T12:43:46,884 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2025-10-24T12:43:46,917 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2025-10-24T12:43:46,935 Collecting deepspeed==0.18.1 2025-10-24T12:43:46,937 Created temporary directory: /tmp/pip-unpack-o6fn1_mo 2025-10-24T12:43:47,070 Downloading deepspeed-0.18.1.tar.gz (1.6 MB) 2025-10-24T12:43:50,151 Added deepspeed==0.18.1 from https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz to build tracker '/tmp/pip-build-tracker-2kgrtazu' 2025-10-24T12:43:50,152 Running setup.py (path:/tmp/pip-wheel-34uoihus/deepspeed_3cd13b5caa394ff78addfac95abe66ef/setup.py) egg_info for package deepspeed 2025-10-24T12:43:50,153 Created temporary directory: /tmp/pip-pip-egg-info-7190znnx 2025-10-24T12:43:50,154 Preparing metadata (setup.py): started 2025-10-24T12:43:50,155 Running command python setup.py egg_info 2025-10-24T12:43:51,249 fatal: not a git repository (or any of the parent directories): .git 2025-10-24T12:43:51,735 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-10-24T12:43:51,736  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-10-24T12:43:51,737 DS_BUILD_OPS=0 2025-10-24T12:43:51,737 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-10-24T12:43:51,738 version=0.18.1, git_hash=unknown, git_branch=unknown 2025-10-24T12:43:51,738 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-10-24T12:43:51,739 ext_modules=[] 2025-10-24T12:43:51,739 running egg_info 2025-10-24T12:43:51,763 creating /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info 2025-10-24T12:43:51,764 writing /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/PKG-INFO 2025-10-24T12:43:51,802 writing dependency_links to /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/dependency_links.txt 2025-10-24T12:43:51,804 writing entry points to /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/entry_points.txt 2025-10-24T12:43:51,825 writing requirements to /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/requires.txt 2025-10-24T12:43:51,826 writing top-level names to /tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/top_level.txt 2025-10-24T12:43:51,828 writing manifest file '/tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/SOURCES.txt' 2025-10-24T12:43:52,092 reading manifest file '/tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/SOURCES.txt' 2025-10-24T12:43:52,094 reading manifest template 'MANIFEST.in' 2025-10-24T12:43:52,096 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-10-24T12:43:52,097 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-10-24T12:43:54,501 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-10-24T12:43:55,838 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-10-24T12:43:56,520 warning: no files found matching '*.tr' under directory 'csrc' 2025-10-24T12:43:56,663 warning: no files found matching '*.cc' under directory 'csrc' 2025-10-24T12:43:56,719 warning: no files found matching '*.py' under directory 'benchmarks' 2025-10-24T12:43:56,725 adding license file 'LICENSE' 2025-10-24T12:43:56,767 writing manifest file '/tmp/pip-pip-egg-info-7190znnx/deepspeed.egg-info/SOURCES.txt' 2025-10-24T12:43:56,769 deepspeed build time = 5.516988039016724 secs 2025-10-24T12:43:56,887 Preparing metadata (setup.py): finished with status 'done' 2025-10-24T12:43:56,893 Source in /tmp/pip-wheel-34uoihus/deepspeed_3cd13b5caa394ff78addfac95abe66ef has version 0.18.1, which satisfies requirement deepspeed==0.18.1 from https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz 2025-10-24T12:43:56,894 Removed deepspeed==0.18.1 from https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz from build tracker '/tmp/pip-build-tracker-2kgrtazu' 2025-10-24T12:43:56,904 Created temporary directory: /tmp/pip-unpack-zj04zyuk 2025-10-24T12:43:56,904 Building wheels for collected packages: deepspeed 2025-10-24T12:43:56,908 Created temporary directory: /tmp/pip-wheel-eltb9493 2025-10-24T12:43:56,909 Building wheel for deepspeed (setup.py): started 2025-10-24T12:43:56,910 Destination directory: /tmp/pip-wheel-eltb9493 2025-10-24T12:43:56,911 Running command python setup.py bdist_wheel 2025-10-24T12:43:57,403 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2025-10-24T12:43:57,406  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2025-10-24T12:43:57,532 DS_BUILD_OPS=0 2025-10-24T12:43:57,646 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2025-10-24T12:43:57,665 fatal: not a git repository (or any of the parent directories): .git 2025-10-24T12:43:57,666 version=0.18.1, git_hash=unknown, git_branch=unknown 2025-10-24T12:43:57,667 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2025-10-24T12:43:57,668 ext_modules=[] 2025-10-24T12:43:58,060 running bdist_wheel 2025-10-24T12:43:58,193 running build 2025-10-24T12:43:58,194 running build_py 2025-10-24T12:43:58,224 creating build/lib/deepspeed 2025-10-24T12:43:58,227 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2025-10-24T12:43:58,229 copying deepspeed/env_report.py -> build/lib/deepspeed 2025-10-24T12:43:58,231 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2025-10-24T12:43:58,233 copying deepspeed/constants.py -> build/lib/deepspeed 2025-10-24T12:43:58,235 copying deepspeed/__init__.py -> build/lib/deepspeed 2025-10-24T12:43:58,238 creating build/lib/deepspeed/monitor 2025-10-24T12:43:58,239 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,241 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,243 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,245 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,247 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,249 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,251 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,253 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2025-10-24T12:43:58,255 creating build/lib/deepspeed/sequence 2025-10-24T12:43:58,256 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2025-10-24T12:43:58,258 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2025-10-24T12:43:58,261 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2025-10-24T12:43:58,264 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2025-10-24T12:43:58,266 creating build/lib/deepspeed/datastates 2025-10-24T12:43:58,267 copying deepspeed/datastates/config.py -> build/lib/deepspeed/datastates 2025-10-24T12:43:58,269 copying deepspeed/datastates/__init__.py -> build/lib/deepspeed/datastates 2025-10-24T12:43:58,272 creating build/lib/deepspeed/accelerator 2025-10-24T12:43:58,273 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,275 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,277 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,280 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,282 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,285 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,287 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,289 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,292 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,294 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,296 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2025-10-24T12:43:58,299 creating build/lib/deepspeed/pipe 2025-10-24T12:43:58,300 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2025-10-24T12:43:58,303 creating build/lib/deepspeed/runtime 2025-10-24T12:43:58,304 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,310 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,313 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,315 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,317 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,320 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,323 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,325 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,328 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,330 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,333 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,335 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,338 copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,340 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,343 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,344 copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,347 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,349 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,351 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,354 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2025-10-24T12:43:58,357 creating build/lib/deepspeed/nvme 2025-10-24T12:43:58,358 copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,360 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,362 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,364 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,367 copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,368 copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,370 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,372 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,374 copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,375 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,377 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,379 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,380 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,382 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,384 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,386 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2025-10-24T12:43:58,388 creating build/lib/deepspeed/elasticity 2025-10-24T12:43:58,389 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,391 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,394 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,397 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,399 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,401 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2025-10-24T12:43:58,403 creating build/lib/deepspeed/compression 2025-10-24T12:43:58,404 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,407 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,410 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,413 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,415 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,418 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,420 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,422 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2025-10-24T12:43:58,425 creating build/lib/deepspeed/compile 2025-10-24T12:43:58,426 copying deepspeed/compile/util.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,429 copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,431 copying deepspeed/compile/config.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,433 copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,435 copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,437 copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,439 copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,441 copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,443 copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,446 copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,448 copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,450 copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,452 copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,454 copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile 2025-10-24T12:43:58,457 creating build/lib/deepspeed/io 2025-10-24T12:43:58,458 copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,460 copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,462 copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,464 copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,465 copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,467 copying deepspeed/io/utils.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,469 copying deepspeed/io/constants.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,471 copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,472 copying deepspeed/io/__init__.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,474 copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io 2025-10-24T12:43:58,477 creating build/lib/deepspeed/comm 2025-10-24T12:43:58,477 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,479 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,482 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,485 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,487 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,489 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,491 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,493 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,495 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2025-10-24T12:43:58,498 creating build/lib/deepspeed/utils 2025-10-24T12:43:58,499 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,501 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,504 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,507 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,509 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,512 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,515 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,517 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,519 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,521 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,523 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,524 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,527 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,529 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,531 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,533 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,536 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,539 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2025-10-24T12:43:58,542 creating build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,543 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,545 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,548 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,550 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,553 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,554 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,556 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,559 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,560 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,562 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2025-10-24T12:43:58,565 creating build/lib/deepspeed/inference 2025-10-24T12:43:58,566 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2025-10-24T12:43:58,569 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2025-10-24T12:43:58,572 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2025-10-24T12:43:58,574 creating build/lib/deepspeed/model_implementations 2025-10-24T12:43:58,575 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2025-10-24T12:43:58,577 creating build/lib/deepspeed/ops 2025-10-24T12:43:58,578 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2025-10-24T12:43:58,581 creating build/lib/deepspeed/linear 2025-10-24T12:43:58,582 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2025-10-24T12:43:58,585 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2025-10-24T12:43:58,587 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2025-10-24T12:43:58,589 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2025-10-24T12:43:58,591 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2025-10-24T12:43:58,593 creating build/lib/deepspeed/launcher 2025-10-24T12:43:58,594 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,597 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,599 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,601 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,605 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,607 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2025-10-24T12:43:58,611 creating build/lib/deepspeed/moe 2025-10-24T12:43:58,612 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,614 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,616 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,619 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,620 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,622 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2025-10-24T12:43:58,625 creating build/lib/deepspeed/profiling 2025-10-24T12:43:58,626 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2025-10-24T12:43:58,628 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2025-10-24T12:43:58,631 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2025-10-24T12:43:58,633 creating build/lib/deepspeed/autotuning 2025-10-24T12:43:58,634 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,637 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,640 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,642 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,644 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,648 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2025-10-24T12:43:58,651 creating build/lib/deepspeed/module_inject 2025-10-24T12:43:58,652 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,654 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,656 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,659 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,661 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,663 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,665 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,667 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,669 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,672 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,674 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,676 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,679 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2025-10-24T12:43:58,682 creating build/lib/deepspeed/nebula 2025-10-24T12:43:58,683 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2025-10-24T12:43:58,685 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2025-10-24T12:43:58,687 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2025-10-24T12:43:58,690 creating build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,691 copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,693 copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,695 copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,697 copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,699 copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,701 copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2025-10-24T12:43:58,704 creating build/lib/deepspeed/runtime/tensor_parallel 2025-10-24T12:43:58,705 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-24T12:43:58,707 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-24T12:43:58,709 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2025-10-24T12:43:58,711 creating build/lib/deepspeed/runtime/sequence_parallel 2025-10-24T12:43:58,713 copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-24T12:43:58,715 copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-24T12:43:58,719 copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel 2025-10-24T12:43:58,722 creating build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,723 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,727 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,730 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,732 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,735 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,738 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2025-10-24T12:43:58,740 creating build/lib/deepspeed/runtime/compression 2025-10-24T12:43:58,741 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2025-10-24T12:43:58,743 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2025-10-24T12:43:58,746 creating build/lib/deepspeed/runtime/superoffload 2025-10-24T12:43:58,747 copying deepspeed/runtime/superoffload/superoffload_utils.py -> build/lib/deepspeed/runtime/superoffload 2025-10-24T12:43:58,749 copying deepspeed/runtime/superoffload/__init__.py -> build/lib/deepspeed/runtime/superoffload 2025-10-24T12:43:58,752 copying deepspeed/runtime/superoffload/superoffload_stage3.py -> build/lib/deepspeed/runtime/superoffload 2025-10-24T12:43:58,754 creating build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,755 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,758 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,760 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,762 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,764 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,766 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2025-10-24T12:43:58,769 creating build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,771 copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,773 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,775 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,777 copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,779 copying deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,781 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,783 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,785 copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2025-10-24T12:43:58,788 creating build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,789 copying deepspeed/runtime/zenflow/engine.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,791 copying deepspeed/runtime/zenflow/engine_stage3.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,794 copying deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,797 copying deepspeed/runtime/zenflow/zenflow_config.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,799 copying deepspeed/runtime/zenflow/__init__.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,801 copying deepspeed/runtime/zenflow/zenflow_utils.py -> build/lib/deepspeed/runtime/zenflow 2025-10-24T12:43:58,803 creating build/lib/deepspeed/runtime/data_pipeline 2025-10-24T12:43:58,804 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-24T12:43:58,807 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-24T12:43:58,810 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-24T12:43:58,812 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2025-10-24T12:43:58,814 creating build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,816 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,820 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,823 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,826 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,829 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,832 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,835 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,838 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,841 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,843 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,850 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,853 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,856 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,862 copying deepspeed/runtime/zero/leaf_module_config.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,864 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,867 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,869 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,871 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2025-10-24T12:43:58,875 creating build/lib/deepspeed/runtime/activation_checkpointing 2025-10-24T12:43:58,876 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-24T12:43:58,880 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-24T12:43:58,882 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2025-10-24T12:43:58,886 creating build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,887 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,889 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,892 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,896 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,898 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,902 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,904 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,907 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,911 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2025-10-24T12:43:58,914 creating build/lib/deepspeed/runtime/domino 2025-10-24T12:43:58,916 copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino 2025-10-24T12:43:58,919 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2025-10-24T12:43:58,921 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2025-10-24T12:43:58,925 creating build/lib/deepspeed/runtime/fp16 2025-10-24T12:43:58,926 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-10-24T12:43:58,930 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2025-10-24T12:43:58,933 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2025-10-24T12:43:58,935 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2025-10-24T12:43:58,939 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,940 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,944 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,948 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,951 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,954 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,958 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:43:58,962 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,964 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,967 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,969 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,972 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,975 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:43:58,979 creating build/lib/deepspeed/runtime/zero/muon 2025-10-24T12:43:58,981 copying deepspeed/runtime/zero/muon/muon_optimizer.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-24T12:43:58,984 copying deepspeed/runtime/zero/muon/original_muon.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-24T12:43:58,987 copying deepspeed/runtime/zero/muon/__init__.py -> build/lib/deepspeed/runtime/zero/muon 2025-10-24T12:43:58,991 creating build/lib/deepspeed/runtime/fp16/onebit 2025-10-24T12:43:58,993 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-24T12:43:58,998 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-24T12:43:59,001 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-24T12:43:59,005 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2025-10-24T12:43:59,008 creating build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,010 copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,013 copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,017 copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,020 copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,023 copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,026 copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,028 copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,031 copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes 2025-10-24T12:43:59,034 creating build/lib/deepspeed/compile/profilers 2025-10-24T12:43:59,035 copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers 2025-10-24T12:43:59,038 copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers 2025-10-24T12:43:59,040 copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers 2025-10-24T12:43:59,044 creating build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,045 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,047 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,050 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,053 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,055 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,058 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,060 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,063 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,065 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2025-10-24T12:43:59,068 creating build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,069 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,072 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,074 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,078 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,080 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2025-10-24T12:43:59,083 creating build/lib/deepspeed/inference/v2/modules 2025-10-24T12:43:59,085 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2025-10-24T12:43:59,088 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2025-10-24T12:43:59,091 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2025-10-24T12:43:59,093 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2025-10-24T12:43:59,096 creating build/lib/deepspeed/inference/v2/kernels 2025-10-24T12:43:59,098 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2025-10-24T12:43:59,101 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2025-10-24T12:43:59,104 creating build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,106 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,111 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,113 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,117 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,119 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,122 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,125 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2025-10-24T12:43:59,128 creating build/lib/deepspeed/inference/v2/checkpoint 2025-10-24T12:43:59,130 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-24T12:43:59,132 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-24T12:43:59,135 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-24T12:43:59,137 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2025-10-24T12:43:59,140 creating build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,142 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,145 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,148 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,151 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,154 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,157 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,160 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2025-10-24T12:43:59,163 creating build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,165 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,167 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,169 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,172 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,174 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,177 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,179 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2025-10-24T12:43:59,182 creating build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,184 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,187 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,189 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,192 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,194 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,196 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,199 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,201 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:43:59,204 creating build/lib/deepspeed/inference/v2/modules/implementations 2025-10-24T12:43:59,205 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2025-10-24T12:43:59,208 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:43:59,210 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:43:59,212 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:43:59,214 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:43:59,217 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:43:59,218 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:43:59,221 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:43:59,224 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:43:59,225 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:43:59,228 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:43:59,231 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:43:59,233 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:43:59,235 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:43:59,238 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:43:59,240 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:43:59,242 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:43:59,245 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:43:59,248 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:43:59,249 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:43:59,252 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:43:59,255 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:43:59,256 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:43:59,259 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:43:59,262 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:43:59,263 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:43:59,266 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:43:59,267 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:43:59,270 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:43:59,272 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:43:59,275 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:43:59,276 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:43:59,279 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:43:59,281 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:43:59,284 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:43:59,285 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:43:59,288 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:43:59,291 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:43:59,292 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:43:59,295 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:43:59,297 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:43:59,300 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:43:59,302 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:43:59,304 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:43:59,306 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:43:59,309 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:43:59,310 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:43:59,312 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:43:59,315 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:43:59,316 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:43:59,319 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:43:59,322 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:43:59,323 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:43:59,325 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:43:59,328 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:43:59,330 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:43:59,332 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:43:59,335 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:43:59,337 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:43:59,339 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:43:59,341 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:43:59,342 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:43:59,344 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:43:59,347 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:43:59,348 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:43:59,351 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:43:59,353 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:43:59,354 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:43:59,357 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:43:59,359 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:43:59,361 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:43:59,364 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:43:59,365 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:43:59,367 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:43:59,370 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:43:59,371 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:43:59,373 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:43:59,377 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,378 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,381 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,383 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,385 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,386 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:43:59,389 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:43:59,390 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:43:59,392 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:43:59,395 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:43:59,396 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:43:59,399 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:43:59,401 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:43:59,403 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:43:59,405 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:43:59,407 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:43:59,409 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:43:59,411 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:43:59,413 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:43:59,416 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:43:59,417 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:43:59,420 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:43:59,423 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:43:59,425 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:43:59,428 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:43:59,429 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:43:59,432 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:43:59,434 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:43:59,437 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:43:59,439 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:43:59,440 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:43:59,443 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:43:59,445 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:43:59,447 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:43:59,450 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,451 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,453 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,455 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,458 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,460 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,462 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,464 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,469 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,473 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:43:59,476 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,478 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,480 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,483 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,485 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,488 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,490 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,492 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,495 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,498 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:43:59,502 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:43:59,503 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:43:59,505 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:43:59,509 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:43:59,511 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:43:59,514 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:43:59,515 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:43:59,518 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:43:59,522 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:43:59,525 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:43:59,527 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:43:59,529 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:43:59,532 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:43:59,535 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:43:59,537 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:43:59,540 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:43:59,541 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:43:59,544 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:43:59,547 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:43:59,549 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:43:59,552 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:43:59,553 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:43:59,555 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:43:59,558 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:43:59,560 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:43:59,563 creating build/lib/deepspeed/model_implementations/features 2025-10-24T12:43:59,564 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2025-10-24T12:43:59,567 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2025-10-24T12:43:59,569 creating build/lib/deepspeed/model_implementations/diffusers 2025-10-24T12:43:59,571 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-24T12:43:59,573 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-24T12:43:59,575 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2025-10-24T12:43:59,578 creating build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,580 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,582 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,585 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,587 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,589 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,591 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,594 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,596 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,598 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,600 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2025-10-24T12:43:59,603 creating build/lib/deepspeed/ops/fp_quantizer 2025-10-24T12:43:59,604 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-24T12:43:59,607 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-24T12:43:59,610 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-24T12:43:59,612 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2025-10-24T12:43:59,615 creating build/lib/deepspeed/ops/quantizer 2025-10-24T12:43:59,616 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2025-10-24T12:43:59,619 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2025-10-24T12:43:59,621 creating build/lib/deepspeed/ops/gds 2025-10-24T12:43:59,622 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2025-10-24T12:43:59,625 creating build/lib/deepspeed/ops/compile 2025-10-24T12:43:59,626 copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile 2025-10-24T12:43:59,629 creating build/lib/deepspeed/ops/transformer 2025-10-24T12:43:59,630 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2025-10-24T12:43:59,632 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2025-10-24T12:43:59,636 creating build/lib/deepspeed/ops/aio 2025-10-24T12:43:59,637 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2025-10-24T12:43:59,639 creating build/lib/deepspeed/ops/deepspeed4science 2025-10-24T12:43:59,641 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2025-10-24T12:43:59,643 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2025-10-24T12:43:59,645 creating build/lib/deepspeed/ops/adagrad 2025-10-24T12:43:59,647 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2025-10-24T12:43:59,649 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2025-10-24T12:43:59,652 creating build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,653 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,655 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,657 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,660 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,663 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,665 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,668 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2025-10-24T12:43:59,671 creating build/lib/deepspeed/ops/random_ltd 2025-10-24T12:43:59,673 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2025-10-24T12:43:59,676 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2025-10-24T12:43:59,679 creating build/lib/deepspeed/ops/lion 2025-10-24T12:43:59,680 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2025-10-24T12:43:59,683 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2025-10-24T12:43:59,685 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2025-10-24T12:43:59,687 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2025-10-24T12:43:59,690 creating build/lib/deepspeed/ops/lamb 2025-10-24T12:43:59,691 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2025-10-24T12:43:59,694 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2025-10-24T12:43:59,697 creating build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,698 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,700 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,702 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,705 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,707 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,709 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,711 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,713 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,716 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,718 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,720 copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,722 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,725 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,728 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,731 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,734 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,736 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,739 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,741 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,744 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,746 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,749 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,752 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,754 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,758 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,760 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2025-10-24T12:43:59,764 creating build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,765 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,768 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,771 copying deepspeed/ops/adam/zenflow_torch_adam.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,777 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,781 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,783 copying deepspeed/ops/adam/zenflow_cpu_adam.py -> build/lib/deepspeed/ops/adam 2025-10-24T12:43:59,787 creating build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,789 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,793 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,796 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,799 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,802 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,805 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,808 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,811 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,813 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,816 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2025-10-24T12:43:59,821 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,822 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,825 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,827 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,829 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,831 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,833 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,835 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,838 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,839 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,842 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,844 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,847 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,849 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,851 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,853 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,856 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,858 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,860 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,862 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,864 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,866 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,868 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,870 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:43:59,874 creating build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,875 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,878 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,881 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,883 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,886 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,888 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,891 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,893 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,895 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,898 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2025-10-24T12:43:59,900 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:43:59,901 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:43:59,904 creating build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,905 copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,908 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,910 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,912 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,914 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,916 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,918 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,920 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,922 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,924 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2025-10-24T12:43:59,927 creating build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,928 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,930 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,933 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,935 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,937 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,939 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,941 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2025-10-24T12:43:59,944 creating build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,945 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,947 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,949 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,951 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,953 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2025-10-24T12:43:59,956 creating build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,957 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,959 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,961 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,964 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,966 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,968 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,970 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,972 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,974 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2025-10-24T12:43:59,977 creating build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,978 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,980 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,983 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,985 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,987 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,989 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,991 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2025-10-24T12:43:59,993 creating build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:43:59,995 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:43:59,997 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:43:59,999 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:44:00,001 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:44:00,003 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:44:00,005 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2025-10-24T12:44:00,007 creating build/lib/deepspeed/profiling/flops_profiler 2025-10-24T12:44:00,008 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2025-10-24T12:44:00,012 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2025-10-24T12:44:00,014 creating build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,015 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,018 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,020 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,022 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,024 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,027 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2025-10-24T12:44:00,029 creating build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,031 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,033 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,036 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,039 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,041 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,043 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,047 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,050 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,052 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,055 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,057 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,059 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,061 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,064 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,067 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,068 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,071 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,073 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,075 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2025-10-24T12:44:00,078 creating build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,079 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,082 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,084 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,087 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,090 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,092 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,094 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2025-10-24T12:44:00,097 running egg_info 2025-10-24T12:44:00,125 writing deepspeed.egg-info/PKG-INFO 2025-10-24T12:44:00,162 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2025-10-24T12:44:00,164 writing entry points to deepspeed.egg-info/entry_points.txt 2025-10-24T12:44:00,187 writing requirements to deepspeed.egg-info/requires.txt 2025-10-24T12:44:00,188 writing top-level names to deepspeed.egg-info/top_level.txt 2025-10-24T12:44:00,332 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-10-24T12:44:00,411 reading manifest template 'MANIFEST.in' 2025-10-24T12:44:00,412 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2025-10-24T12:44:00,413 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2025-10-24T12:44:02,275 warning: no files found matching '*.hip' under directory 'deepspeed' 2025-10-24T12:44:03,448 warning: no files found matching '*.cc' under directory 'deepspeed' 2025-10-24T12:44:04,222 warning: no files found matching '*.tr' under directory 'csrc' 2025-10-24T12:44:04,352 warning: no files found matching '*.cc' under directory 'csrc' 2025-10-24T12:44:04,399 warning: no files found matching '*.py' under directory 'benchmarks' 2025-10-24T12:44:04,405 adding license file 'LICENSE' 2025-10-24T12:44:04,461 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2025-10-24T12:44:04,470 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2025-10-24T12:44:04,470 !! 2025-10-24T12:44:04,471 ******************************************************************************** 2025-10-24T12:44:04,471 ############################ 2025-10-24T12:44:04,472 # Package would be ignored # 2025-10-24T12:44:04,472 ############################ 2025-10-24T12:44:04,472 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2025-10-24T12:44:04,473 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,474 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,474 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2025-10-24T12:44:04,474 to the `packages` configuration field. 2025-10-24T12:44:04,475 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,476 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,476 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,478 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,479 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,480 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2025-10-24T12:44:04,481 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2025-10-24T12:44:04,481 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,482 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,483 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,484 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,485 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,487 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,487 even if it does not contain any `.py` files. 2025-10-24T12:44:04,488 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,489 directory, all directories are treated like packages. 2025-10-24T12:44:04,489 ******************************************************************************** 2025-10-24T12:44:04,490 !! 2025-10-24T12:44:04,491 check.warn(importable) 2025-10-24T12:44:04,491 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2025-10-24T12:44:04,492 !! 2025-10-24T12:44:04,493 ******************************************************************************** 2025-10-24T12:44:04,493 ############################ 2025-10-24T12:44:04,494 # Package would be ignored # 2025-10-24T12:44:04,494 ############################ 2025-10-24T12:44:04,495 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2025-10-24T12:44:04,496 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,497 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,498 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2025-10-24T12:44:04,498 to the `packages` configuration field. 2025-10-24T12:44:04,499 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,500 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,500 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,501 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,502 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,502 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2025-10-24T12:44:04,503 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2025-10-24T12:44:04,503 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,504 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,504 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,505 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,506 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,507 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,507 even if it does not contain any `.py` files. 2025-10-24T12:44:04,508 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,508 directory, all directories are treated like packages. 2025-10-24T12:44:04,509 ******************************************************************************** 2025-10-24T12:44:04,510 !! 2025-10-24T12:44:04,510 check.warn(importable) 2025-10-24T12:44:04,511 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2025-10-24T12:44:04,511 !! 2025-10-24T12:44:04,512 ******************************************************************************** 2025-10-24T12:44:04,513 ############################ 2025-10-24T12:44:04,513 # Package would be ignored # 2025-10-24T12:44:04,514 ############################ 2025-10-24T12:44:04,515 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2025-10-24T12:44:04,515 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,516 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,516 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2025-10-24T12:44:04,517 to the `packages` configuration field. 2025-10-24T12:44:04,518 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,518 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,519 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,519 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,520 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,521 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2025-10-24T12:44:04,522 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2025-10-24T12:44:04,522 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,523 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,524 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,524 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,525 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,526 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,526 even if it does not contain any `.py` files. 2025-10-24T12:44:04,527 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,527 directory, all directories are treated like packages. 2025-10-24T12:44:04,527 ******************************************************************************** 2025-10-24T12:44:04,528 !! 2025-10-24T12:44:04,528 check.warn(importable) 2025-10-24T12:44:04,529 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2025-10-24T12:44:04,529 !! 2025-10-24T12:44:04,530 ******************************************************************************** 2025-10-24T12:44:04,530 ############################ 2025-10-24T12:44:04,530 # Package would be ignored # 2025-10-24T12:44:04,531 ############################ 2025-10-24T12:44:04,531 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2025-10-24T12:44:04,532 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,533 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,533 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2025-10-24T12:44:04,534 to the `packages` configuration field. 2025-10-24T12:44:04,535 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,535 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,536 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,537 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,538 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,539 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2025-10-24T12:44:04,540 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2025-10-24T12:44:04,540 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,541 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,541 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,542 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,543 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,544 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,545 even if it does not contain any `.py` files. 2025-10-24T12:44:04,545 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,546 directory, all directories are treated like packages. 2025-10-24T12:44:04,546 ******************************************************************************** 2025-10-24T12:44:04,547 !! 2025-10-24T12:44:04,548 check.warn(importable) 2025-10-24T12:44:04,548 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2025-10-24T12:44:04,549 !! 2025-10-24T12:44:04,550 ******************************************************************************** 2025-10-24T12:44:04,550 ############################ 2025-10-24T12:44:04,551 # Package would be ignored # 2025-10-24T12:44:04,551 ############################ 2025-10-24T12:44:04,551 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2025-10-24T12:44:04,552 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,552 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,553 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2025-10-24T12:44:04,553 to the `packages` configuration field. 2025-10-24T12:44:04,554 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,554 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,554 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,555 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,556 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,557 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2025-10-24T12:44:04,557 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2025-10-24T12:44:04,557 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,560 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,561 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,562 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,563 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,565 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,565 even if it does not contain any `.py` files. 2025-10-24T12:44:04,566 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,566 directory, all directories are treated like packages. 2025-10-24T12:44:04,567 ******************************************************************************** 2025-10-24T12:44:04,568 !! 2025-10-24T12:44:04,568 check.warn(importable) 2025-10-24T12:44:04,569 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2025-10-24T12:44:04,569 !! 2025-10-24T12:44:04,570 ******************************************************************************** 2025-10-24T12:44:04,570 ############################ 2025-10-24T12:44:04,571 # Package would be ignored # 2025-10-24T12:44:04,571 ############################ 2025-10-24T12:44:04,572 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2025-10-24T12:44:04,572 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,573 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,574 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2025-10-24T12:44:04,574 to the `packages` configuration field. 2025-10-24T12:44:04,575 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,575 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,576 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,577 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,577 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,578 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2025-10-24T12:44:04,578 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2025-10-24T12:44:04,579 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,579 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,579 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,580 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,581 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,582 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,582 even if it does not contain any `.py` files. 2025-10-24T12:44:04,583 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,583 directory, all directories are treated like packages. 2025-10-24T12:44:04,583 ******************************************************************************** 2025-10-24T12:44:04,584 !! 2025-10-24T12:44:04,585 check.warn(importable) 2025-10-24T12:44:04,585 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2025-10-24T12:44:04,586 !! 2025-10-24T12:44:04,587 ******************************************************************************** 2025-10-24T12:44:04,587 ############################ 2025-10-24T12:44:04,588 # Package would be ignored # 2025-10-24T12:44:04,588 ############################ 2025-10-24T12:44:04,589 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2025-10-24T12:44:04,589 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,591 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,591 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2025-10-24T12:44:04,592 to the `packages` configuration field. 2025-10-24T12:44:04,593 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,593 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,593 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,594 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,595 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,596 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2025-10-24T12:44:04,597 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2025-10-24T12:44:04,597 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,598 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,598 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,599 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,600 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,602 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,602 even if it does not contain any `.py` files. 2025-10-24T12:44:04,603 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,603 directory, all directories are treated like packages. 2025-10-24T12:44:04,603 ******************************************************************************** 2025-10-24T12:44:04,604 !! 2025-10-24T12:44:04,604 check.warn(importable) 2025-10-24T12:44:04,605 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2025-10-24T12:44:04,605 !! 2025-10-24T12:44:04,606 ******************************************************************************** 2025-10-24T12:44:04,606 ############################ 2025-10-24T12:44:04,606 # Package would be ignored # 2025-10-24T12:44:04,607 ############################ 2025-10-24T12:44:04,607 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2025-10-24T12:44:04,607 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,608 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,608 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2025-10-24T12:44:04,609 to the `packages` configuration field. 2025-10-24T12:44:04,610 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,610 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,611 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,611 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,612 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,613 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2025-10-24T12:44:04,614 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2025-10-24T12:44:04,614 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,615 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,615 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,616 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,617 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,618 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,619 even if it does not contain any `.py` files. 2025-10-24T12:44:04,619 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,620 directory, all directories are treated like packages. 2025-10-24T12:44:04,620 ******************************************************************************** 2025-10-24T12:44:04,621 !! 2025-10-24T12:44:04,621 check.warn(importable) 2025-10-24T12:44:04,622 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2025-10-24T12:44:04,622 !! 2025-10-24T12:44:04,623 ******************************************************************************** 2025-10-24T12:44:04,624 ############################ 2025-10-24T12:44:04,624 # Package would be ignored # 2025-10-24T12:44:04,625 ############################ 2025-10-24T12:44:04,625 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2025-10-24T12:44:04,626 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,626 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,627 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2025-10-24T12:44:04,627 to the `packages` configuration field. 2025-10-24T12:44:04,628 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,628 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,628 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,633 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,633 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,634 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2025-10-24T12:44:04,634 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2025-10-24T12:44:04,635 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,635 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,635 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,636 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,637 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,639 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,639 even if it does not contain any `.py` files. 2025-10-24T12:44:04,640 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,640 directory, all directories are treated like packages. 2025-10-24T12:44:04,641 ******************************************************************************** 2025-10-24T12:44:04,642 !! 2025-10-24T12:44:04,642 check.warn(importable) 2025-10-24T12:44:04,643 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2025-10-24T12:44:04,643 !! 2025-10-24T12:44:04,644 ******************************************************************************** 2025-10-24T12:44:04,645 ############################ 2025-10-24T12:44:04,645 # Package would be ignored # 2025-10-24T12:44:04,646 ############################ 2025-10-24T12:44:04,646 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2025-10-24T12:44:04,647 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,647 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,648 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2025-10-24T12:44:04,648 to the `packages` configuration field. 2025-10-24T12:44:04,649 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,650 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,650 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,651 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,652 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,653 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2025-10-24T12:44:04,653 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2025-10-24T12:44:04,654 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,654 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,655 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,655 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,656 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,657 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,657 even if it does not contain any `.py` files. 2025-10-24T12:44:04,658 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,658 directory, all directories are treated like packages. 2025-10-24T12:44:04,658 ******************************************************************************** 2025-10-24T12:44:04,659 !! 2025-10-24T12:44:04,659 check.warn(importable) 2025-10-24T12:44:04,660 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2025-10-24T12:44:04,660 !! 2025-10-24T12:44:04,661 ******************************************************************************** 2025-10-24T12:44:04,661 ############################ 2025-10-24T12:44:04,661 # Package would be ignored # 2025-10-24T12:44:04,662 ############################ 2025-10-24T12:44:04,662 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2025-10-24T12:44:04,662 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,663 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,664 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2025-10-24T12:44:04,664 to the `packages` configuration field. 2025-10-24T12:44:04,665 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,666 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,666 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,667 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,668 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,669 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2025-10-24T12:44:04,670 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2025-10-24T12:44:04,670 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,671 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,671 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,672 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,673 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,674 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,675 even if it does not contain any `.py` files. 2025-10-24T12:44:04,675 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,676 directory, all directories are treated like packages. 2025-10-24T12:44:04,676 ******************************************************************************** 2025-10-24T12:44:04,677 !! 2025-10-24T12:44:04,678 check.warn(importable) 2025-10-24T12:44:04,678 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2025-10-24T12:44:04,679 !! 2025-10-24T12:44:04,680 ******************************************************************************** 2025-10-24T12:44:04,680 ############################ 2025-10-24T12:44:04,680 # Package would be ignored # 2025-10-24T12:44:04,681 ############################ 2025-10-24T12:44:04,681 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2025-10-24T12:44:04,681 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,682 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,682 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2025-10-24T12:44:04,683 to the `packages` configuration field. 2025-10-24T12:44:04,683 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,684 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,684 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,685 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,685 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,686 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2025-10-24T12:44:04,686 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2025-10-24T12:44:04,687 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,687 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,688 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,689 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,690 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,691 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,692 even if it does not contain any `.py` files. 2025-10-24T12:44:04,692 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,693 directory, all directories are treated like packages. 2025-10-24T12:44:04,693 ******************************************************************************** 2025-10-24T12:44:04,694 !! 2025-10-24T12:44:04,695 check.warn(importable) 2025-10-24T12:44:04,695 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2025-10-24T12:44:04,696 !! 2025-10-24T12:44:04,697 ******************************************************************************** 2025-10-24T12:44:04,697 ############################ 2025-10-24T12:44:04,698 # Package would be ignored # 2025-10-24T12:44:04,698 ############################ 2025-10-24T12:44:04,699 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2025-10-24T12:44:04,699 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,700 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,700 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2025-10-24T12:44:04,701 to the `packages` configuration field. 2025-10-24T12:44:04,702 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,704 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,705 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,706 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,707 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,708 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2025-10-24T12:44:04,708 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2025-10-24T12:44:04,709 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,709 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,709 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,710 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,711 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,712 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,712 even if it does not contain any `.py` files. 2025-10-24T12:44:04,712 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,713 directory, all directories are treated like packages. 2025-10-24T12:44:04,713 ******************************************************************************** 2025-10-24T12:44:04,714 !! 2025-10-24T12:44:04,714 check.warn(importable) 2025-10-24T12:44:04,714 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration. 2025-10-24T12:44:04,715 !! 2025-10-24T12:44:04,716 ******************************************************************************** 2025-10-24T12:44:04,716 ############################ 2025-10-24T12:44:04,717 # Package would be ignored # 2025-10-24T12:44:04,717 ############################ 2025-10-24T12:44:04,718 Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1], 2025-10-24T12:44:04,718 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,720 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,720 package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added 2025-10-24T12:44:04,721 to the `packages` configuration field. 2025-10-24T12:44:04,722 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,722 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,723 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,724 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,724 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,725 If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are 2025-10-24T12:44:04,726 already explicitly excluding 'deepspeed.ops.csrc.compile' via 2025-10-24T12:44:04,726 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,727 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,727 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,728 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,729 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,731 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,731 even if it does not contain any `.py` files. 2025-10-24T12:44:04,732 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,732 directory, all directories are treated like packages. 2025-10-24T12:44:04,733 ******************************************************************************** 2025-10-24T12:44:04,733 !! 2025-10-24T12:44:04,734 check.warn(importable) 2025-10-24T12:44:04,734 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2025-10-24T12:44:04,734 !! 2025-10-24T12:44:04,735 ******************************************************************************** 2025-10-24T12:44:04,735 ############################ 2025-10-24T12:44:04,736 # Package would be ignored # 2025-10-24T12:44:04,736 ############################ 2025-10-24T12:44:04,736 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2025-10-24T12:44:04,737 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,737 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,738 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2025-10-24T12:44:04,738 to the `packages` configuration field. 2025-10-24T12:44:04,739 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,739 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,739 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,740 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,741 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,742 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2025-10-24T12:44:04,743 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2025-10-24T12:44:04,743 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,744 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,744 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,745 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,746 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,748 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,748 even if it does not contain any `.py` files. 2025-10-24T12:44:04,749 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,749 directory, all directories are treated like packages. 2025-10-24T12:44:04,750 ******************************************************************************** 2025-10-24T12:44:04,750 !! 2025-10-24T12:44:04,751 check.warn(importable) 2025-10-24T12:44:04,751 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2025-10-24T12:44:04,752 !! 2025-10-24T12:44:04,753 ******************************************************************************** 2025-10-24T12:44:04,753 ############################ 2025-10-24T12:44:04,753 # Package would be ignored # 2025-10-24T12:44:04,754 ############################ 2025-10-24T12:44:04,754 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2025-10-24T12:44:04,755 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,756 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,757 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2025-10-24T12:44:04,757 to the `packages` configuration field. 2025-10-24T12:44:04,758 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,759 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,759 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,759 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,760 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,761 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2025-10-24T12:44:04,761 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2025-10-24T12:44:04,761 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,762 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,762 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,763 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,763 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,764 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,765 even if it does not contain any `.py` files. 2025-10-24T12:44:04,765 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,765 directory, all directories are treated like packages. 2025-10-24T12:44:04,766 ******************************************************************************** 2025-10-24T12:44:04,767 !! 2025-10-24T12:44:04,768 check.warn(importable) 2025-10-24T12:44:04,768 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.riscv64' is absent from the `packages` configuration. 2025-10-24T12:44:04,769 !! 2025-10-24T12:44:04,770 ******************************************************************************** 2025-10-24T12:44:04,770 ############################ 2025-10-24T12:44:04,771 # Package would be ignored # 2025-10-24T12:44:04,771 ############################ 2025-10-24T12:44:04,772 Python recognizes 'deepspeed.ops.csrc.cpu.comm.riscv64' as an importable package[^1], 2025-10-24T12:44:04,772 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,773 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,776 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.riscv64' is explicitly added 2025-10-24T12:44:04,777 to the `packages` configuration field. 2025-10-24T12:44:04,778 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,778 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,779 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,779 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,780 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,781 If you don't want 'deepspeed.ops.csrc.cpu.comm.riscv64' to be distributed and are 2025-10-24T12:44:04,782 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.riscv64' via 2025-10-24T12:44:04,782 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,783 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,783 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,785 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,785 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,786 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,787 even if it does not contain any `.py` files. 2025-10-24T12:44:04,787 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,787 directory, all directories are treated like packages. 2025-10-24T12:44:04,788 ******************************************************************************** 2025-10-24T12:44:04,788 !! 2025-10-24T12:44:04,789 check.warn(importable) 2025-10-24T12:44:04,789 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.x86_64' is absent from the `packages` configuration. 2025-10-24T12:44:04,789 !! 2025-10-24T12:44:04,790 ******************************************************************************** 2025-10-24T12:44:04,790 ############################ 2025-10-24T12:44:04,790 # Package would be ignored # 2025-10-24T12:44:04,791 ############################ 2025-10-24T12:44:04,791 Python recognizes 'deepspeed.ops.csrc.cpu.comm.x86_64' as an importable package[^1], 2025-10-24T12:44:04,791 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,792 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,792 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.x86_64' is explicitly added 2025-10-24T12:44:04,793 to the `packages` configuration field. 2025-10-24T12:44:04,794 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,794 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,795 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,796 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,797 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,798 If you don't want 'deepspeed.ops.csrc.cpu.comm.x86_64' to be distributed and are 2025-10-24T12:44:04,799 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.x86_64' via 2025-10-24T12:44:04,799 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,800 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,800 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,801 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,802 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,803 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,804 even if it does not contain any `.py` files. 2025-10-24T12:44:04,804 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,805 directory, all directories are treated like packages. 2025-10-24T12:44:04,805 ******************************************************************************** 2025-10-24T12:44:04,806 !! 2025-10-24T12:44:04,806 check.warn(importable) 2025-10-24T12:44:04,807 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2025-10-24T12:44:04,808 !! 2025-10-24T12:44:04,809 ******************************************************************************** 2025-10-24T12:44:04,809 ############################ 2025-10-24T12:44:04,809 # Package would be ignored # 2025-10-24T12:44:04,810 ############################ 2025-10-24T12:44:04,810 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2025-10-24T12:44:04,811 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,811 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,812 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2025-10-24T12:44:04,812 to the `packages` configuration field. 2025-10-24T12:44:04,813 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,813 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,813 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,814 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,815 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,815 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2025-10-24T12:44:04,816 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2025-10-24T12:44:04,816 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,816 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,817 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,818 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,819 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,820 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,821 even if it does not contain any `.py` files. 2025-10-24T12:44:04,821 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,822 directory, all directories are treated like packages. 2025-10-24T12:44:04,822 ******************************************************************************** 2025-10-24T12:44:04,823 !! 2025-10-24T12:44:04,824 check.warn(importable) 2025-10-24T12:44:04,824 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2025-10-24T12:44:04,825 !! 2025-10-24T12:44:04,826 ******************************************************************************** 2025-10-24T12:44:04,826 ############################ 2025-10-24T12:44:04,827 # Package would be ignored # 2025-10-24T12:44:04,827 ############################ 2025-10-24T12:44:04,828 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2025-10-24T12:44:04,828 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,829 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,829 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2025-10-24T12:44:04,830 to the `packages` configuration field. 2025-10-24T12:44:04,831 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,831 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,832 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,833 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,834 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,835 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2025-10-24T12:44:04,835 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2025-10-24T12:44:04,836 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,836 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,836 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,837 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,838 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,839 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,839 even if it does not contain any `.py` files. 2025-10-24T12:44:04,839 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,840 directory, all directories are treated like packages. 2025-10-24T12:44:04,840 ******************************************************************************** 2025-10-24T12:44:04,841 !! 2025-10-24T12:44:04,841 check.warn(importable) 2025-10-24T12:44:04,841 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2025-10-24T12:44:04,842 !! 2025-10-24T12:44:04,843 ******************************************************************************** 2025-10-24T12:44:04,843 ############################ 2025-10-24T12:44:04,844 # Package would be ignored # 2025-10-24T12:44:04,844 ############################ 2025-10-24T12:44:04,845 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2025-10-24T12:44:04,846 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,847 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,847 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2025-10-24T12:44:04,847 to the `packages` configuration field. 2025-10-24T12:44:04,848 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,849 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,850 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,851 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,851 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,852 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2025-10-24T12:44:04,853 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2025-10-24T12:44:04,853 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,854 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,854 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,855 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,856 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,858 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,858 even if it does not contain any `.py` files. 2025-10-24T12:44:04,859 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,859 directory, all directories are treated like packages. 2025-10-24T12:44:04,860 ******************************************************************************** 2025-10-24T12:44:04,860 !! 2025-10-24T12:44:04,861 check.warn(importable) 2025-10-24T12:44:04,861 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2025-10-24T12:44:04,861 !! 2025-10-24T12:44:04,862 ******************************************************************************** 2025-10-24T12:44:04,862 ############################ 2025-10-24T12:44:04,863 # Package would be ignored # 2025-10-24T12:44:04,863 ############################ 2025-10-24T12:44:04,863 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2025-10-24T12:44:04,864 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,864 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,865 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2025-10-24T12:44:04,865 to the `packages` configuration field. 2025-10-24T12:44:04,866 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,866 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,866 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,867 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,868 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,869 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2025-10-24T12:44:04,870 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2025-10-24T12:44:04,870 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,871 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,871 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,872 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,873 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,875 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,875 even if it does not contain any `.py` files. 2025-10-24T12:44:04,875 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,876 directory, all directories are treated like packages. 2025-10-24T12:44:04,876 ******************************************************************************** 2025-10-24T12:44:04,877 !! 2025-10-24T12:44:04,878 check.warn(importable) 2025-10-24T12:44:04,878 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2025-10-24T12:44:04,879 !! 2025-10-24T12:44:04,880 ******************************************************************************** 2025-10-24T12:44:04,880 ############################ 2025-10-24T12:44:04,880 # Package would be ignored # 2025-10-24T12:44:04,881 ############################ 2025-10-24T12:44:04,882 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2025-10-24T12:44:04,882 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,883 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,884 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2025-10-24T12:44:04,884 to the `packages` configuration field. 2025-10-24T12:44:04,885 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,885 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,885 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,886 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,886 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,887 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2025-10-24T12:44:04,888 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2025-10-24T12:44:04,888 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,888 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,889 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,889 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,890 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,892 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,892 even if it does not contain any `.py` files. 2025-10-24T12:44:04,893 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,893 directory, all directories are treated like packages. 2025-10-24T12:44:04,894 ******************************************************************************** 2025-10-24T12:44:04,895 !! 2025-10-24T12:44:04,895 check.warn(importable) 2025-10-24T12:44:04,896 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2025-10-24T12:44:04,896 !! 2025-10-24T12:44:04,897 ******************************************************************************** 2025-10-24T12:44:04,898 ############################ 2025-10-24T12:44:04,899 # Package would be ignored # 2025-10-24T12:44:04,899 ############################ 2025-10-24T12:44:04,899 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2025-10-24T12:44:04,900 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,901 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,901 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2025-10-24T12:44:04,901 to the `packages` configuration field. 2025-10-24T12:44:04,902 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,903 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,903 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,904 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,905 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,906 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2025-10-24T12:44:04,907 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2025-10-24T12:44:04,907 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,908 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,908 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,909 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,910 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,911 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,911 even if it does not contain any `.py` files. 2025-10-24T12:44:04,912 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,912 directory, all directories are treated like packages. 2025-10-24T12:44:04,912 ******************************************************************************** 2025-10-24T12:44:04,913 !! 2025-10-24T12:44:04,913 check.warn(importable) 2025-10-24T12:44:04,914 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2025-10-24T12:44:04,914 !! 2025-10-24T12:44:04,915 ******************************************************************************** 2025-10-24T12:44:04,915 ############################ 2025-10-24T12:44:04,915 # Package would be ignored # 2025-10-24T12:44:04,916 ############################ 2025-10-24T12:44:04,916 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2025-10-24T12:44:04,917 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,918 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,918 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2025-10-24T12:44:04,919 to the `packages` configuration field. 2025-10-24T12:44:04,920 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,921 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,921 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,922 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,923 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,924 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2025-10-24T12:44:04,925 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2025-10-24T12:44:04,925 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,925 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,926 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,927 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,928 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,929 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,929 even if it does not contain any `.py` files. 2025-10-24T12:44:04,930 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,930 directory, all directories are treated like packages. 2025-10-24T12:44:04,931 ******************************************************************************** 2025-10-24T12:44:04,932 !! 2025-10-24T12:44:04,932 check.warn(importable) 2025-10-24T12:44:04,933 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2025-10-24T12:44:04,934 !! 2025-10-24T12:44:04,935 ******************************************************************************** 2025-10-24T12:44:04,935 ############################ 2025-10-24T12:44:04,935 # Package would be ignored # 2025-10-24T12:44:04,936 ############################ 2025-10-24T12:44:04,936 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2025-10-24T12:44:04,936 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,937 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,938 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2025-10-24T12:44:04,938 to the `packages` configuration field. 2025-10-24T12:44:04,939 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,939 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,939 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,940 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,941 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,942 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2025-10-24T12:44:04,942 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2025-10-24T12:44:04,942 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,943 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,943 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,945 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,946 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,947 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,948 even if it does not contain any `.py` files. 2025-10-24T12:44:04,948 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,949 directory, all directories are treated like packages. 2025-10-24T12:44:04,949 ******************************************************************************** 2025-10-24T12:44:04,951 !! 2025-10-24T12:44:04,951 check.warn(importable) 2025-10-24T12:44:04,951 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2025-10-24T12:44:04,952 !! 2025-10-24T12:44:04,953 ******************************************************************************** 2025-10-24T12:44:04,953 ############################ 2025-10-24T12:44:04,954 # Package would be ignored # 2025-10-24T12:44:04,954 ############################ 2025-10-24T12:44:04,955 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2025-10-24T12:44:04,955 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,956 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,957 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2025-10-24T12:44:04,957 to the `packages` configuration field. 2025-10-24T12:44:04,958 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,959 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,959 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,960 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,961 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,961 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2025-10-24T12:44:04,962 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2025-10-24T12:44:04,962 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,962 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,963 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,963 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,964 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,965 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,965 even if it does not contain any `.py` files. 2025-10-24T12:44:04,966 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,966 directory, all directories are treated like packages. 2025-10-24T12:44:04,966 ******************************************************************************** 2025-10-24T12:44:04,967 !! 2025-10-24T12:44:04,968 check.warn(importable) 2025-10-24T12:44:04,968 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2025-10-24T12:44:04,969 !! 2025-10-24T12:44:04,970 ******************************************************************************** 2025-10-24T12:44:04,970 ############################ 2025-10-24T12:44:04,970 # Package would be ignored # 2025-10-24T12:44:04,971 ############################ 2025-10-24T12:44:04,971 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2025-10-24T12:44:04,972 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,973 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,974 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2025-10-24T12:44:04,974 to the `packages` configuration field. 2025-10-24T12:44:04,975 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,976 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,976 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,977 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,978 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,979 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2025-10-24T12:44:04,979 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2025-10-24T12:44:04,979 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:04,980 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:04,980 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:04,982 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:04,983 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:04,984 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:04,985 even if it does not contain any `.py` files. 2025-10-24T12:44:04,986 On the other hand, currently there is no concept of package data 2025-10-24T12:44:04,986 directory, all directories are treated like packages. 2025-10-24T12:44:04,987 ******************************************************************************** 2025-10-24T12:44:04,987 !! 2025-10-24T12:44:04,988 check.warn(importable) 2025-10-24T12:44:04,988 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2025-10-24T12:44:04,989 !! 2025-10-24T12:44:04,990 ******************************************************************************** 2025-10-24T12:44:04,990 ############################ 2025-10-24T12:44:04,990 # Package would be ignored # 2025-10-24T12:44:04,991 ############################ 2025-10-24T12:44:04,991 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2025-10-24T12:44:04,992 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:04,992 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:04,993 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2025-10-24T12:44:04,993 to the `packages` configuration field. 2025-10-24T12:44:04,994 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:04,995 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:04,995 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:04,996 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:04,998 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:04,999 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2025-10-24T12:44:04,999 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2025-10-24T12:44:05,000 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,001 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,001 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,002 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,004 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,005 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,006 even if it does not contain any `.py` files. 2025-10-24T12:44:05,006 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,007 directory, all directories are treated like packages. 2025-10-24T12:44:05,007 ******************************************************************************** 2025-10-24T12:44:05,009 !! 2025-10-24T12:44:05,009 check.warn(importable) 2025-10-24T12:44:05,010 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2025-10-24T12:44:05,010 !! 2025-10-24T12:44:05,011 ******************************************************************************** 2025-10-24T12:44:05,012 ############################ 2025-10-24T12:44:05,013 # Package would be ignored # 2025-10-24T12:44:05,013 ############################ 2025-10-24T12:44:05,014 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2025-10-24T12:44:05,014 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,016 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,016 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2025-10-24T12:44:05,016 to the `packages` configuration field. 2025-10-24T12:44:05,017 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,018 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,018 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,019 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,020 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,020 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2025-10-24T12:44:05,021 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2025-10-24T12:44:05,021 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,022 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,022 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,023 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,024 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,026 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,026 even if it does not contain any `.py` files. 2025-10-24T12:44:05,027 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,027 directory, all directories are treated like packages. 2025-10-24T12:44:05,028 ******************************************************************************** 2025-10-24T12:44:05,029 !! 2025-10-24T12:44:05,029 check.warn(importable) 2025-10-24T12:44:05,030 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2025-10-24T12:44:05,030 !! 2025-10-24T12:44:05,031 ******************************************************************************** 2025-10-24T12:44:05,032 ############################ 2025-10-24T12:44:05,033 # Package would be ignored # 2025-10-24T12:44:05,033 ############################ 2025-10-24T12:44:05,034 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2025-10-24T12:44:05,034 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,036 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,036 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2025-10-24T12:44:05,037 to the `packages` configuration field. 2025-10-24T12:44:05,038 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,038 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,039 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,040 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,041 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,042 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2025-10-24T12:44:05,043 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2025-10-24T12:44:05,043 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,044 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,044 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,045 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,046 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,048 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,048 even if it does not contain any `.py` files. 2025-10-24T12:44:05,048 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,049 directory, all directories are treated like packages. 2025-10-24T12:44:05,049 ******************************************************************************** 2025-10-24T12:44:05,050 !! 2025-10-24T12:44:05,050 check.warn(importable) 2025-10-24T12:44:05,051 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2025-10-24T12:44:05,051 !! 2025-10-24T12:44:05,052 ******************************************************************************** 2025-10-24T12:44:05,053 ############################ 2025-10-24T12:44:05,053 # Package would be ignored # 2025-10-24T12:44:05,053 ############################ 2025-10-24T12:44:05,054 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2025-10-24T12:44:05,054 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,055 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,056 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2025-10-24T12:44:05,056 to the `packages` configuration field. 2025-10-24T12:44:05,057 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,058 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,058 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,059 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,060 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,061 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2025-10-24T12:44:05,062 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2025-10-24T12:44:05,062 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,063 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,063 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,064 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,065 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,067 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,068 even if it does not contain any `.py` files. 2025-10-24T12:44:05,068 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,069 directory, all directories are treated like packages. 2025-10-24T12:44:05,069 ******************************************************************************** 2025-10-24T12:44:05,070 !! 2025-10-24T12:44:05,071 check.warn(importable) 2025-10-24T12:44:05,071 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2025-10-24T12:44:05,072 !! 2025-10-24T12:44:05,073 ******************************************************************************** 2025-10-24T12:44:05,074 ############################ 2025-10-24T12:44:05,074 # Package would be ignored # 2025-10-24T12:44:05,075 ############################ 2025-10-24T12:44:05,075 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2025-10-24T12:44:05,075 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,076 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,077 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2025-10-24T12:44:05,077 to the `packages` configuration field. 2025-10-24T12:44:05,078 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,079 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,079 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,080 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,081 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,082 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2025-10-24T12:44:05,083 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2025-10-24T12:44:05,083 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,084 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,084 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,085 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,086 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,088 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,088 even if it does not contain any `.py` files. 2025-10-24T12:44:05,089 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,089 directory, all directories are treated like packages. 2025-10-24T12:44:05,090 ******************************************************************************** 2025-10-24T12:44:05,091 !! 2025-10-24T12:44:05,091 check.warn(importable) 2025-10-24T12:44:05,091 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2025-10-24T12:44:05,092 !! 2025-10-24T12:44:05,093 ******************************************************************************** 2025-10-24T12:44:05,093 ############################ 2025-10-24T12:44:05,094 # Package would be ignored # 2025-10-24T12:44:05,094 ############################ 2025-10-24T12:44:05,095 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2025-10-24T12:44:05,096 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,096 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,097 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2025-10-24T12:44:05,097 to the `packages` configuration field. 2025-10-24T12:44:05,098 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,099 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,099 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,100 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,101 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,103 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2025-10-24T12:44:05,103 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2025-10-24T12:44:05,103 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,104 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,104 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,105 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,106 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,107 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,107 even if it does not contain any `.py` files. 2025-10-24T12:44:05,108 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,108 directory, all directories are treated like packages. 2025-10-24T12:44:05,108 ******************************************************************************** 2025-10-24T12:44:05,109 !! 2025-10-24T12:44:05,110 check.warn(importable) 2025-10-24T12:44:05,110 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2025-10-24T12:44:05,111 !! 2025-10-24T12:44:05,111 ******************************************************************************** 2025-10-24T12:44:05,112 ############################ 2025-10-24T12:44:05,112 # Package would be ignored # 2025-10-24T12:44:05,113 ############################ 2025-10-24T12:44:05,113 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2025-10-24T12:44:05,114 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,115 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,115 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2025-10-24T12:44:05,115 to the `packages` configuration field. 2025-10-24T12:44:05,116 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,117 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,117 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,118 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,119 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,120 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2025-10-24T12:44:05,121 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2025-10-24T12:44:05,121 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,122 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,123 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,124 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,126 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,128 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,129 even if it does not contain any `.py` files. 2025-10-24T12:44:05,131 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,131 directory, all directories are treated like packages. 2025-10-24T12:44:05,132 ******************************************************************************** 2025-10-24T12:44:05,133 !! 2025-10-24T12:44:05,133 check.warn(importable) 2025-10-24T12:44:05,134 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2025-10-24T12:44:05,134 !! 2025-10-24T12:44:05,135 ******************************************************************************** 2025-10-24T12:44:05,135 ############################ 2025-10-24T12:44:05,136 # Package would be ignored # 2025-10-24T12:44:05,136 ############################ 2025-10-24T12:44:05,137 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2025-10-24T12:44:05,137 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,138 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,138 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2025-10-24T12:44:05,138 to the `packages` configuration field. 2025-10-24T12:44:05,139 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,140 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,140 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,141 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,142 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,143 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2025-10-24T12:44:05,144 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2025-10-24T12:44:05,144 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,144 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,145 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,146 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,147 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,149 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,149 even if it does not contain any `.py` files. 2025-10-24T12:44:05,149 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,150 directory, all directories are treated like packages. 2025-10-24T12:44:05,150 ******************************************************************************** 2025-10-24T12:44:05,151 !! 2025-10-24T12:44:05,152 check.warn(importable) 2025-10-24T12:44:05,152 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2025-10-24T12:44:05,153 !! 2025-10-24T12:44:05,154 ******************************************************************************** 2025-10-24T12:44:05,154 ############################ 2025-10-24T12:44:05,155 # Package would be ignored # 2025-10-24T12:44:05,155 ############################ 2025-10-24T12:44:05,156 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2025-10-24T12:44:05,156 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,157 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,158 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2025-10-24T12:44:05,158 to the `packages` configuration field. 2025-10-24T12:44:05,159 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,160 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,160 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,161 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,161 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,162 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2025-10-24T12:44:05,163 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2025-10-24T12:44:05,163 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,163 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,164 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,165 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,165 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,167 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,167 even if it does not contain any `.py` files. 2025-10-24T12:44:05,168 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,168 directory, all directories are treated like packages. 2025-10-24T12:44:05,169 ******************************************************************************** 2025-10-24T12:44:05,169 !! 2025-10-24T12:44:05,170 check.warn(importable) 2025-10-24T12:44:05,170 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2025-10-24T12:44:05,171 !! 2025-10-24T12:44:05,172 ******************************************************************************** 2025-10-24T12:44:05,172 ############################ 2025-10-24T12:44:05,173 # Package would be ignored # 2025-10-24T12:44:05,173 ############################ 2025-10-24T12:44:05,174 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2025-10-24T12:44:05,174 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,175 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,176 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2025-10-24T12:44:05,177 to the `packages` configuration field. 2025-10-24T12:44:05,178 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,178 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,179 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,180 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,181 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,182 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2025-10-24T12:44:05,182 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2025-10-24T12:44:05,183 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,183 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,184 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,185 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,186 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,187 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,188 even if it does not contain any `.py` files. 2025-10-24T12:44:05,188 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,189 directory, all directories are treated like packages. 2025-10-24T12:44:05,189 ******************************************************************************** 2025-10-24T12:44:05,190 !! 2025-10-24T12:44:05,190 check.warn(importable) 2025-10-24T12:44:05,191 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2025-10-24T12:44:05,191 !! 2025-10-24T12:44:05,192 ******************************************************************************** 2025-10-24T12:44:05,192 ############################ 2025-10-24T12:44:05,193 # Package would be ignored # 2025-10-24T12:44:05,193 ############################ 2025-10-24T12:44:05,193 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2025-10-24T12:44:05,194 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,195 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,195 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2025-10-24T12:44:05,196 to the `packages` configuration field. 2025-10-24T12:44:05,197 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,197 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,198 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,199 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,200 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,201 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2025-10-24T12:44:05,201 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2025-10-24T12:44:05,202 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,202 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,203 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,204 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,205 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,206 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,207 even if it does not contain any `.py` files. 2025-10-24T12:44:05,207 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,208 directory, all directories are treated like packages. 2025-10-24T12:44:05,208 ******************************************************************************** 2025-10-24T12:44:05,209 !! 2025-10-24T12:44:05,210 check.warn(importable) 2025-10-24T12:44:05,210 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2025-10-24T12:44:05,211 !! 2025-10-24T12:44:05,212 ******************************************************************************** 2025-10-24T12:44:05,212 ############################ 2025-10-24T12:44:05,213 # Package would be ignored # 2025-10-24T12:44:05,213 ############################ 2025-10-24T12:44:05,214 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2025-10-24T12:44:05,214 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,215 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,216 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2025-10-24T12:44:05,216 to the `packages` configuration field. 2025-10-24T12:44:05,217 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,218 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,218 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,219 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,220 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,221 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2025-10-24T12:44:05,221 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2025-10-24T12:44:05,222 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,223 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,224 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,224 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,225 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,227 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,228 even if it does not contain any `.py` files. 2025-10-24T12:44:05,228 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,229 directory, all directories are treated like packages. 2025-10-24T12:44:05,229 ******************************************************************************** 2025-10-24T12:44:05,230 !! 2025-10-24T12:44:05,231 check.warn(importable) 2025-10-24T12:44:05,231 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2025-10-24T12:44:05,232 !! 2025-10-24T12:44:05,233 ******************************************************************************** 2025-10-24T12:44:05,233 ############################ 2025-10-24T12:44:05,234 # Package would be ignored # 2025-10-24T12:44:05,234 ############################ 2025-10-24T12:44:05,235 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2025-10-24T12:44:05,236 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,237 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,237 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2025-10-24T12:44:05,238 to the `packages` configuration field. 2025-10-24T12:44:05,239 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,239 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,240 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,241 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,242 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,243 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2025-10-24T12:44:05,244 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2025-10-24T12:44:05,244 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,245 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,245 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,246 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,247 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,248 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,249 even if it does not contain any `.py` files. 2025-10-24T12:44:05,250 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,250 directory, all directories are treated like packages. 2025-10-24T12:44:05,251 ******************************************************************************** 2025-10-24T12:44:05,252 !! 2025-10-24T12:44:05,252 check.warn(importable) 2025-10-24T12:44:05,252 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2025-10-24T12:44:05,253 !! 2025-10-24T12:44:05,254 ******************************************************************************** 2025-10-24T12:44:05,254 ############################ 2025-10-24T12:44:05,255 # Package would be ignored # 2025-10-24T12:44:05,255 ############################ 2025-10-24T12:44:05,256 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2025-10-24T12:44:05,256 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,257 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,258 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2025-10-24T12:44:05,259 to the `packages` configuration field. 2025-10-24T12:44:05,260 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,260 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,261 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,264 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,265 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,266 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2025-10-24T12:44:05,266 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2025-10-24T12:44:05,267 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,267 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,268 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,269 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,271 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,272 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,273 even if it does not contain any `.py` files. 2025-10-24T12:44:05,274 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,275 directory, all directories are treated like packages. 2025-10-24T12:44:05,275 ******************************************************************************** 2025-10-24T12:44:05,277 !! 2025-10-24T12:44:05,278 check.warn(importable) 2025-10-24T12:44:05,280 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2025-10-24T12:44:05,281 !! 2025-10-24T12:44:05,283 ******************************************************************************** 2025-10-24T12:44:05,284 ############################ 2025-10-24T12:44:05,285 # Package would be ignored # 2025-10-24T12:44:05,285 ############################ 2025-10-24T12:44:05,286 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2025-10-24T12:44:05,287 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,288 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,289 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2025-10-24T12:44:05,290 to the `packages` configuration field. 2025-10-24T12:44:05,291 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,291 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,292 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,294 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,295 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,297 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2025-10-24T12:44:05,298 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2025-10-24T12:44:05,299 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,299 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,301 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,303 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,305 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,308 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,308 even if it does not contain any `.py` files. 2025-10-24T12:44:05,309 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,310 directory, all directories are treated like packages. 2025-10-24T12:44:05,311 ******************************************************************************** 2025-10-24T12:44:05,312 !! 2025-10-24T12:44:05,313 check.warn(importable) 2025-10-24T12:44:05,314 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2025-10-24T12:44:05,314 !! 2025-10-24T12:44:05,317 ******************************************************************************** 2025-10-24T12:44:05,317 ############################ 2025-10-24T12:44:05,318 # Package would be ignored # 2025-10-24T12:44:05,319 ############################ 2025-10-24T12:44:05,319 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2025-10-24T12:44:05,320 but it is absent from setuptools' `packages` configuration. 2025-10-24T12:44:05,321 This leads to an ambiguous overall configuration. If you want to distribute this 2025-10-24T12:44:05,322 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2025-10-24T12:44:05,323 to the `packages` configuration field. 2025-10-24T12:44:05,324 Alternatively, you can also rely on setuptools' discovery methods 2025-10-24T12:44:05,325 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2025-10-24T12:44:05,326 instead of `find_packages(...)`/`find:`). 2025-10-24T12:44:05,327 You can read more about "package discovery" on setuptools documentation page: 2025-10-24T12:44:05,328 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2025-10-24T12:44:05,329 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2025-10-24T12:44:05,329 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2025-10-24T12:44:05,330 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2025-10-24T12:44:05,330 you can try to use `exclude_package_data`, or `include-package-data=False` in 2025-10-24T12:44:05,331 combination with a more fine grained `package-data` configuration. 2025-10-24T12:44:05,332 You can read more about "package data files" on setuptools documentation page: 2025-10-24T12:44:05,333 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2025-10-24T12:44:05,334 [^1]: For Python, any directory (with suitable naming) can be imported, 2025-10-24T12:44:05,335 even if it does not contain any `.py` files. 2025-10-24T12:44:05,336 On the other hand, currently there is no concept of package data 2025-10-24T12:44:05,336 directory, all directories are treated like packages. 2025-10-24T12:44:05,337 ******************************************************************************** 2025-10-24T12:44:05,338 !! 2025-10-24T12:44:05,338 check.warn(importable) 2025-10-24T12:44:05,339 creating build/lib/deepspeed/ops/csrc/adagrad 2025-10-24T12:44:05,339 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2025-10-24T12:44:05,340 creating build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,341 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,341 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,342 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,342 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,343 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2025-10-24T12:44:05,343 creating build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,344 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,345 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,345 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,346 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,346 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,347 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:05,347 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,348 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,348 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,349 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,350 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,350 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,351 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,352 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,352 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,353 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,353 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,354 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,354 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,355 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,355 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,356 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,357 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,357 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:05,358 creating build/lib/deepspeed/ops/csrc/aio/py_test 2025-10-24T12:44:05,358 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2025-10-24T12:44:05,359 creating build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,359 copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,360 copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,360 copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,361 copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,361 copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,362 copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,363 copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,363 copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,364 copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile 2025-10-24T12:44:05,364 creating build/lib/deepspeed/ops/csrc/cpu/adam 2025-10-24T12:44:05,365 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2025-10-24T12:44:05,366 creating build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:05,366 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:05,367 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:05,367 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:05,368 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:05,368 creating build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-24T12:44:05,369 copying deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-24T12:44:05,369 creating build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-24T12:44:05,370 copying deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-24T12:44:05,371 creating build/lib/deepspeed/ops/csrc/cpu/lion 2025-10-24T12:44:05,371 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2025-10-24T12:44:05,372 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,372 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,373 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,373 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,374 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,374 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,375 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:05,375 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:05,376 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:05,376 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:05,377 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:05,377 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:05,378 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,378 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,379 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,379 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,380 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,380 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,381 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,382 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:05,382 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,383 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,383 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,384 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,384 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,385 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,386 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,386 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:05,387 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:05,387 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:05,388 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:05,388 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:05,389 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:05,389 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:05,390 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:05,391 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:05,391 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:05,392 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,392 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,393 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,393 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,394 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,394 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,395 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:05,395 creating build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,396 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,396 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,397 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,397 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,398 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,398 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,399 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,400 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,400 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,401 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,401 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,402 copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,402 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,403 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,403 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,404 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,405 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,408 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,410 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,413 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,415 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,419 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,421 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,424 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,427 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,429 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,433 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,436 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,438 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,440 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2025-10-24T12:44:05,443 creating build/lib/deepspeed/ops/csrc/lamb 2025-10-24T12:44:05,444 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2025-10-24T12:44:05,447 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2025-10-24T12:44:05,450 creating build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,452 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,454 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,457 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,459 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,462 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2025-10-24T12:44:05,465 creating build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,466 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,468 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,471 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,475 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,478 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,481 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,484 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2025-10-24T12:44:05,487 creating build/lib/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:05,488 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:05,491 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:05,494 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:05,496 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:05,499 creating build/lib/deepspeed/ops/csrc/sparse_attention 2025-10-24T12:44:05,500 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2025-10-24T12:44:05,503 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:05,505 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:05,507 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:05,510 creating build/lib/deepspeed/ops/csrc/spatial/includes 2025-10-24T12:44:05,511 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2025-10-24T12:44:05,513 creating build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,514 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,517 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,520 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,524 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,526 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,529 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,533 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,536 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2025-10-24T12:44:05,539 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,541 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,544 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,546 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,550 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,553 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,556 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,560 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,563 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,567 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,569 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:05,573 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:05,574 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:05,578 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:05,581 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:05,584 creating build/lib/deepspeed/ops/csrc/utils 2025-10-24T12:44:05,585 copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-10-24T12:44:05,587 copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils 2025-10-24T12:44:05,589 copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils 2025-10-24T12:44:05,591 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-10-24T12:44:05,593 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2025-10-24T12:44:05,595 creating build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:05,597 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:05,599 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:05,602 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:05,605 creating build/lib/deepspeed/ops/csrc/xpu/common 2025-10-24T12:44:05,606 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2025-10-24T12:44:05,608 creating build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,609 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,611 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,613 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,617 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,620 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:05,623 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2025-10-24T12:44:05,624 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2025-10-24T12:44:05,627 creating build/lib/deepspeed/autotuning/config_templates 2025-10-24T12:44:05,628 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-24T12:44:05,630 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-24T12:44:05,632 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-24T12:44:05,635 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2025-10-24T12:44:05,637 creating build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,638 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,640 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,643 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,645 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,648 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:05,651 creating build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:05,651 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:05,654 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:05,656 creating build/lib/deepspeed/inference/v2/ragged/includes 2025-10-24T12:44:05,657 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2025-10-24T12:44:05,659 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:44:05,661 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-24T12:44:05,662 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-24T12:44:05,664 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:44:05,666 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-24T12:44:05,667 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-24T12:44:05,670 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:05,671 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:05,673 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:05,675 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:05,678 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:44:05,680 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:05,683 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:05,685 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:05,687 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:05,690 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:05,692 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:05,694 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:05,697 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:05,699 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:05,702 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:05,705 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:05,708 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:05,710 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:05,713 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:05,716 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:05,719 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:05,721 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:05,724 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:05,726 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:05,729 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:05,731 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:05,734 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:05,737 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:05,740 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:05,743 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:05,746 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:05,749 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:05,752 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:05,755 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:05,757 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:05,760 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:05,762 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:05,765 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:05,767 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:05,770 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:05,772 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:05,776 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:05,779 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:05,782 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:05,786 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:05,788 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:05,791 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:05,793 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:05,796 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:05,798 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:05,802 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:05,804 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:05,808 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:05,810 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,812 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,815 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,819 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,821 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,824 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,827 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,831 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,834 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,836 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:05,840 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:05,843 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:05,846 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:05,850 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:05,852 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:05,855 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:05,858 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:05,861 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:05,864 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:05,926 running build_scripts 2025-10-24T12:44:05,927 creating build/scripts-3.11 2025-10-24T12:44:05,929 copying and adjusting bin/deepspeed -> build/scripts-3.11 2025-10-24T12:44:05,931 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2025-10-24T12:44:05,933 copying and adjusting bin/ds -> build/scripts-3.11 2025-10-24T12:44:05,935 copying bin/ds_ssh -> build/scripts-3.11 2025-10-24T12:44:05,937 copying and adjusting bin/ds_report -> build/scripts-3.11 2025-10-24T12:44:05,939 copying and adjusting bin/ds_bench -> build/scripts-3.11 2025-10-24T12:44:05,941 copying and adjusting bin/dsr -> build/scripts-3.11 2025-10-24T12:44:05,943 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2025-10-24T12:44:05,945 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2025-10-24T12:44:05,947 copying and adjusting bin/ds_io -> build/scripts-3.11 2025-10-24T12:44:05,948 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2025-10-24T12:44:05,949 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2025-10-24T12:44:05,949 changing mode of build/scripts-3.11/ds from 644 to 755 2025-10-24T12:44:05,950 changing mode of build/scripts-3.11/ds_report from 644 to 755 2025-10-24T12:44:05,951 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2025-10-24T12:44:05,952 changing mode of build/scripts-3.11/dsr from 644 to 755 2025-10-24T12:44:05,953 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2025-10-24T12:44:05,953 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2025-10-24T12:44:05,954 changing mode of build/scripts-3.11/ds_io from 644 to 755 2025-10-24T12:44:05,982 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-10-24T12:44:05,983 !! 2025-10-24T12:44:05,984 ******************************************************************************** 2025-10-24T12:44:05,984 Please avoid running ``setup.py`` directly. 2025-10-24T12:44:05,985 Instead, use pypa/build, pypa/installer or other 2025-10-24T12:44:05,986 standards-based tools. 2025-10-24T12:44:05,987 By 2025-Oct-31, you need to update your project and remove deprecated calls 2025-10-24T12:44:05,988 or your builds will no longer be supported. 2025-10-24T12:44:05,989 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-10-24T12:44:05,990 ******************************************************************************** 2025-10-24T12:44:05,991 !! 2025-10-24T12:44:05,991 self.initialize_options() 2025-10-24T12:44:06,015 installing to build/bdist.linux-armv7l/wheel 2025-10-24T12:44:06,015 running install 2025-10-24T12:44:06,040 running install_lib 2025-10-24T12:44:06,067 creating build/bdist.linux-armv7l/wheel 2025-10-24T12:44:06,070 creating build/bdist.linux-armv7l/wheel/deepspeed 2025-10-24T12:44:06,072 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2025-10-24T12:44:06,074 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,077 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,080 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,082 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,086 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,089 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,092 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,094 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2025-10-24T12:44:06,098 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2025-10-24T12:44:06,100 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-24T12:44:06,102 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-24T12:44:06,107 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-24T12:44:06,111 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2025-10-24T12:44:06,114 creating build/bdist.linux-armv7l/wheel/deepspeed/datastates 2025-10-24T12:44:06,116 copying build/lib/deepspeed/datastates/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2025-10-24T12:44:06,118 copying build/lib/deepspeed/datastates/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2025-10-24T12:44:06,122 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2025-10-24T12:44:06,124 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,127 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,131 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,135 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,138 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,141 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,145 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,147 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,151 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,154 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,157 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2025-10-24T12:44:06,162 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2025-10-24T12:44:06,163 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2025-10-24T12:44:06,166 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-24T12:44:06,170 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2025-10-24T12:44:06,172 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,174 copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,177 copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,179 copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,181 copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,184 copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,186 copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2025-10-24T12:44:06,189 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2025-10-24T12:44:06,191 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-24T12:44:06,193 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-24T12:44:06,195 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2025-10-24T12:44:06,198 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel 2025-10-24T12:44:06,199 copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-24T12:44:06,201 copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-24T12:44:06,206 copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2025-10-24T12:44:06,208 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,217 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,220 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,223 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2025-10-24T12:44:06,224 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,230 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,232 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,235 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,239 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,242 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2025-10-24T12:44:06,244 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,246 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,249 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,252 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2025-10-24T12:44:06,253 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-10-24T12:44:06,255 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2025-10-24T12:44:06,258 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/superoffload 2025-10-24T12:44:06,260 copying build/lib/deepspeed/runtime/superoffload/superoffload_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-24T12:44:06,262 copying build/lib/deepspeed/runtime/superoffload/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-24T12:44:06,264 copying build/lib/deepspeed/runtime/superoffload/superoffload_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2025-10-24T12:44:06,267 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,271 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2025-10-24T12:44:06,272 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,275 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,278 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,281 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,283 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,285 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2025-10-24T12:44:06,288 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,291 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,294 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,295 copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,298 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,300 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,302 copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,304 copying build/lib/deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,306 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,309 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,311 copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2025-10-24T12:44:06,315 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zenflow 2025-10-24T12:44:06,316 copying build/lib/deepspeed/runtime/zenflow/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,319 copying build/lib/deepspeed/runtime/zenflow/engine_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,322 copying build/lib/deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,326 copying build/lib/deepspeed/runtime/zenflow/zenflow_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,328 copying build/lib/deepspeed/runtime/zenflow/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,330 copying build/lib/deepspeed/runtime/zenflow/zenflow_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2025-10-24T12:44:06,333 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,336 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,339 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2025-10-24T12:44:06,341 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,343 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,346 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,350 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,352 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,354 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,357 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2025-10-24T12:44:06,360 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-24T12:44:06,362 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-24T12:44:06,366 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,367 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,369 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,371 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,374 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,377 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2025-10-24T12:44:06,379 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-24T12:44:06,381 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2025-10-24T12:44:06,383 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,386 copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,389 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2025-10-24T12:44:06,391 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero/muon 2025-10-24T12:44:06,393 copying build/lib/deepspeed/runtime/zero/muon/muon_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-24T12:44:06,395 copying build/lib/deepspeed/runtime/zero/muon/original_muon.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-24T12:44:06,398 copying build/lib/deepspeed/runtime/zero/muon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2025-10-24T12:44:06,400 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,404 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,407 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,409 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,412 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,415 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,418 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,420 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,423 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,425 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,431 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,434 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,437 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,443 copying build/lib/deepspeed/runtime/zero/leaf_module_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,446 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,448 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,450 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,453 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2025-10-24T12:44:06,456 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,459 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,461 copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,464 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,466 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,469 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,472 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2025-10-24T12:44:06,474 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-24T12:44:06,478 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-24T12:44:06,480 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2025-10-24T12:44:06,482 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,483 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,485 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,488 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,490 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,493 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,495 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,497 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,500 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,502 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2025-10-24T12:44:06,505 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2025-10-24T12:44:06,508 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2025-10-24T12:44:06,509 copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-24T12:44:06,511 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-24T12:44:06,514 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2025-10-24T12:44:06,517 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2025-10-24T12:44:06,518 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-24T12:44:06,522 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2025-10-24T12:44:06,523 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-24T12:44:06,526 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-24T12:44:06,528 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-24T12:44:06,531 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2025-10-24T12:44:06,533 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-24T12:44:06,535 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-24T12:44:06,537 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2025-10-24T12:44:06,540 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2025-10-24T12:44:06,541 copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,543 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,545 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,547 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,549 copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,551 copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,553 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,555 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,558 copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,560 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,561 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,563 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,565 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,567 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,569 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,572 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2025-10-24T12:44:06,575 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2025-10-24T12:44:06,576 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,578 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,581 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,583 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,585 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,587 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2025-10-24T12:44:06,590 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2025-10-24T12:44:06,591 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,593 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,597 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,599 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,602 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,604 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,607 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,609 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2025-10-24T12:44:06,612 creating build/bdist.linux-armv7l/wheel/deepspeed/compile 2025-10-24T12:44:06,613 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes 2025-10-24T12:44:06,615 copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,617 copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,619 copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,621 copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,623 copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,626 copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,628 copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,630 copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2025-10-24T12:44:06,632 copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,635 copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,637 copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,640 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers 2025-10-24T12:44:06,641 copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-24T12:44:06,643 copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-24T12:44:06,646 copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2025-10-24T12:44:06,648 copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,650 copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,652 copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,654 copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,656 copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,659 copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,661 copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,663 copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,665 copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,667 copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,669 copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2025-10-24T12:44:06,672 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-24T12:44:06,675 creating build/bdist.linux-armv7l/wheel/deepspeed/io 2025-10-24T12:44:06,676 copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,678 copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,680 copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,682 copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,684 copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,686 copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,687 copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,689 copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,691 copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,693 copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2025-10-24T12:44:06,695 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2025-10-24T12:44:06,697 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,699 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,702 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,704 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,706 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,709 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,710 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,712 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,715 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2025-10-24T12:44:06,718 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2025-10-24T12:44:06,719 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,721 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,724 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,727 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,729 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,733 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,736 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,738 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,740 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,742 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,744 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,746 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,749 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,751 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,753 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,756 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,758 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,761 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2025-10-24T12:44:06,764 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-24T12:44:06,767 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2025-10-24T12:44:06,768 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,771 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,774 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,776 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,779 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,781 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,784 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,787 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,789 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,791 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2025-10-24T12:44:06,794 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2025-10-24T12:44:06,796 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-24T12:44:06,800 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-24T12:44:06,803 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2025-10-24T12:44:06,806 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2025-10-24T12:44:06,808 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-24T12:44:06,811 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,812 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,815 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,817 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,820 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,822 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,824 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,826 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2025-10-24T12:44:06,829 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,831 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,833 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,836 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,838 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,840 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,843 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,845 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,847 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2025-10-24T12:44:06,850 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-24T12:44:06,854 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2025-10-24T12:44:06,861 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:44:06,862 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:44:06,866 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:44:06,869 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2025-10-24T12:44:06,877 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:44:06,879 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:44:06,881 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2025-10-24T12:44:06,885 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:44:06,886 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:44:06,889 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2025-10-24T12:44:06,892 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:44:06,894 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:44:06,897 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2025-10-24T12:44:06,900 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:44:06,902 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:44:06,904 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:44:06,908 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2025-10-24T12:44:06,910 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2025-10-24T12:44:06,913 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:44:06,914 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:44:06,918 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2025-10-24T12:44:06,921 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:44:06,923 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:44:06,926 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2025-10-24T12:44:06,929 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-24T12:44:06,931 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2025-10-24T12:44:06,935 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2025-10-24T12:44:06,937 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:44:06,940 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,942 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,946 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,949 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,952 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,955 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,957 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2025-10-24T12:44:06,960 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:44:06,963 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-24T12:44:06,965 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2025-10-24T12:44:06,968 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:06,969 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:06,972 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:06,975 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:06,978 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:07,196 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2025-10-24T12:44:07,198 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2025-10-24T12:44:07,201 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:44:07,202 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:07,203 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:07,206 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:07,207 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2025-10-24T12:44:07,209 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:44:07,212 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,213 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,215 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,217 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,220 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,223 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,225 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,227 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,229 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2025-10-24T12:44:07,232 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,233 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,235 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,237 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,240 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,242 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,244 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2025-10-24T12:44:07,246 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:07,247 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:07,249 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:07,252 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:07,254 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2025-10-24T12:44:07,256 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,258 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,260 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,262 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,264 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,266 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,268 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2025-10-24T12:44:07,270 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,271 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,273 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,275 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,277 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,279 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,281 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2025-10-24T12:44:07,284 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-24T12:44:07,285 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2025-10-24T12:44:07,287 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,289 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,291 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,294 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,296 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,298 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,300 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2025-10-24T12:44:07,302 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2025-10-24T12:44:07,304 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,305 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,308 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,309 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,311 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,313 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,315 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2025-10-24T12:44:07,317 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,318 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,321 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,324 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,325 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,327 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,329 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2025-10-24T12:44:07,332 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:44:07,333 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:07,335 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:07,337 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:07,339 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:07,341 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2025-10-24T12:44:07,344 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,345 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,348 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,351 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,353 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,355 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,357 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,359 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2025-10-24T12:44:07,361 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,363 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,368 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,370 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,372 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,374 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2025-10-24T12:44:07,377 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,379 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,382 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,384 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,388 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,390 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,392 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,395 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,398 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,401 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,403 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,406 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,408 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,411 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2025-10-24T12:44:07,414 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,416 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,419 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2025-10-24T12:44:07,422 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,424 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,427 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,429 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,433 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,435 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,438 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,441 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,444 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2025-10-24T12:44:07,446 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:44:07,449 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,451 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,453 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,456 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,459 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,461 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2025-10-24T12:44:07,463 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2025-10-24T12:44:07,465 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-10-24T12:44:07,468 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,470 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,473 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,475 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,478 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,481 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2025-10-24T12:44:07,484 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2025-10-24T12:44:07,488 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2025-10-24T12:44:07,490 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,494 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,497 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,499 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,503 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:07,504 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:07,506 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2025-10-24T12:44:07,509 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,511 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,515 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2025-10-24T12:44:07,517 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2025-10-24T12:44:07,519 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2025-10-24T12:44:07,522 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,524 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,527 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2025-10-24T12:44:07,528 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-24T12:44:07,531 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-24T12:44:07,533 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-24T12:44:07,536 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2025-10-24T12:44:07,538 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,540 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,543 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,545 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:44:07,547 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:44:07,549 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:44:07,552 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:44:07,554 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2025-10-24T12:44:07,556 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,560 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:44:07,561 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:44:07,564 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:44:07,566 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:44:07,569 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2025-10-24T12:44:07,571 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,574 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:44:07,576 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:44:07,578 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:44:07,581 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:44:07,583 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2025-10-24T12:44:07,586 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:44:07,588 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:44:07,591 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:44:07,593 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:44:07,595 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2025-10-24T12:44:07,598 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:44:07,599 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:44:07,602 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:44:07,604 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:44:07,606 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2025-10-24T12:44:07,608 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,611 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,615 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,616 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,618 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,621 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,623 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,625 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,628 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,630 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,633 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,635 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2025-10-24T12:44:07,639 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,641 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,643 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,645 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,647 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,649 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,651 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,654 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,656 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,658 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2025-10-24T12:44:07,661 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:44:07,662 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:44:07,665 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:44:07,667 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:44:07,669 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2025-10-24T12:44:07,672 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:44:07,673 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:44:07,676 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:44:07,678 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:44:07,680 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2025-10-24T12:44:07,683 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:44:07,685 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:44:07,688 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:44:07,692 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:44:07,695 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2025-10-24T12:44:07,699 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:44:07,701 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:44:07,705 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:44:07,708 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:44:07,711 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2025-10-24T12:44:07,714 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,717 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,722 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:44:07,724 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:44:07,728 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:44:07,731 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:44:07,735 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2025-10-24T12:44:07,738 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2025-10-24T12:44:07,742 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,746 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,749 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,752 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,755 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2025-10-24T12:44:07,759 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2025-10-24T12:44:07,761 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-24T12:44:07,765 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-24T12:44:07,769 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-24T12:44:07,772 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-24T12:44:07,775 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2025-10-24T12:44:07,779 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2025-10-24T12:44:07,782 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-24T12:44:07,786 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2025-10-24T12:44:07,787 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2025-10-24T12:44:07,789 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-10-24T12:44:07,791 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2025-10-24T12:44:07,794 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2025-10-24T12:44:07,795 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-24T12:44:07,797 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-24T12:44:07,799 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2025-10-24T12:44:07,802 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2025-10-24T12:44:07,805 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2025-10-24T12:44:07,806 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,808 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,811 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,813 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,815 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,817 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,819 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,822 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,824 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,826 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2025-10-24T12:44:07,829 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2025-10-24T12:44:07,831 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2025-10-24T12:44:07,832 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-24T12:44:07,834 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-24T12:44:07,837 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-24T12:44:07,839 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2025-10-24T12:44:07,842 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2025-10-24T12:44:07,843 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-10-24T12:44:07,846 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2025-10-24T12:44:07,848 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2025-10-24T12:44:07,850 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2025-10-24T12:44:07,853 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile 2025-10-24T12:44:07,854 copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile 2025-10-24T12:44:07,857 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2025-10-24T12:44:07,859 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2025-10-24T12:44:07,861 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,863 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,865 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,867 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,869 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,872 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,874 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,876 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,878 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,881 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,883 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,885 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,888 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,890 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,893 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,895 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,898 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,901 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,903 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,906 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,908 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,910 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,912 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,914 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2025-10-24T12:44:07,917 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,920 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,923 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,925 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,928 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,929 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,933 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,935 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,937 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,940 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,942 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,945 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,948 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,951 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,954 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2025-10-24T12:44:07,956 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,960 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,962 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,964 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,966 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,969 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2025-10-24T12:44:07,971 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-10-24T12:44:07,973 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2025-10-24T12:44:07,977 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2025-10-24T12:44:07,978 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:07,980 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:07,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:07,984 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:07,986 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2025-10-24T12:44:07,989 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2025-10-24T12:44:07,992 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2025-10-24T12:44:07,994 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2025-10-24T12:44:07,995 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2025-10-24T12:44:07,998 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:07,999 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:08,002 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:08,004 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:08,006 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:08,009 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2025-10-24T12:44:08,012 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2025-10-24T12:44:08,013 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2025-10-24T12:44:08,016 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2025-10-24T12:44:08,017 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2025-10-24T12:44:08,020 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:08,021 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:08,023 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:08,026 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2025-10-24T12:44:08,029 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2025-10-24T12:44:08,031 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,033 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,035 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,037 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,039 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,041 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,044 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2025-10-24T12:44:08,047 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2025-10-24T12:44:08,049 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:08,050 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:08,053 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2025-10-24T12:44:08,055 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2025-10-24T12:44:08,057 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2025-10-24T12:44:08,060 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile 2025-10-24T12:44:08,061 copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,063 copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,065 copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,067 copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,070 copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,072 copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,074 copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,076 copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,079 copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2025-10-24T12:44:08,082 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,083 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,086 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,089 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,092 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,095 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,098 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,102 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,105 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2025-10-24T12:44:08,107 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,109 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,112 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,115 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,117 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,120 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,123 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,125 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,129 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,132 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,134 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2025-10-24T12:44:08,137 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:08,139 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:08,141 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:08,144 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2025-10-24T12:44:08,146 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2025-10-24T12:44:08,149 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2025-10-24T12:44:08,150 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-24T12:44:08,152 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-24T12:44:08,155 copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2025-10-24T12:44:08,157 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,158 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,162 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,164 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,166 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,169 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,171 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,173 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2025-10-24T12:44:08,177 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2025-10-24T12:44:08,179 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,180 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,182 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,184 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,186 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,188 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,190 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,192 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,194 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,196 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,198 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,200 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,202 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,204 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,205 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,207 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,210 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,212 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2025-10-24T12:44:08,214 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2025-10-24T12:44:08,215 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2025-10-24T12:44:08,218 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,220 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,222 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,224 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,226 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,229 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,232 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2025-10-24T12:44:08,234 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2025-10-24T12:44:08,236 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,237 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,240 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,241 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,245 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,247 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,250 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,253 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,256 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,258 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2025-10-24T12:44:08,261 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,264 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,268 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,271 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,272 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,275 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,277 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,280 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,283 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,286 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,290 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2025-10-24T12:44:08,293 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:08,294 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:08,297 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2025-10-24T12:44:08,299 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,301 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2025-10-24T12:44:08,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:08,307 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:08,309 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:08,311 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:08,314 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2025-10-24T12:44:08,317 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2025-10-24T12:44:08,318 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,320 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,322 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,325 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,326 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,329 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,331 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,334 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,336 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,338 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,340 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,342 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,345 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,347 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,350 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,352 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,354 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,357 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,359 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,361 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,364 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,366 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,368 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,370 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,372 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,375 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,377 copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,380 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,382 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,384 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2025-10-24T12:44:08,388 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2025-10-24T12:44:08,389 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2025-10-24T12:44:08,392 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2025-10-24T12:44:08,394 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2025-10-24T12:44:08,397 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2025-10-24T12:44:08,399 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:08,400 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:08,403 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-24T12:44:08,404 copying build/lib/deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/riscv64 2025-10-24T12:44:08,406 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:08,409 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:08,412 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-24T12:44:08,413 copying build/lib/deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/x86_64 2025-10-24T12:44:08,415 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2025-10-24T12:44:08,418 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2025-10-24T12:44:08,419 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2025-10-24T12:44:08,422 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2025-10-24T12:44:08,423 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2025-10-24T12:44:08,426 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:08,427 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:08,430 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:08,433 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:08,435 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2025-10-24T12:44:08,438 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2025-10-24T12:44:08,440 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-24T12:44:08,442 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-24T12:44:08,444 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-24T12:44:08,447 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-24T12:44:08,449 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2025-10-24T12:44:08,451 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2025-10-24T12:44:08,452 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-10-24T12:44:08,454 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2025-10-24T12:44:08,457 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2025-10-24T12:44:08,459 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-24T12:44:08,461 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-24T12:44:08,464 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-24T12:44:08,466 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-24T12:44:08,468 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2025-10-24T12:44:08,471 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2025-10-24T12:44:08,472 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2025-10-24T12:44:08,475 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2025-10-24T12:44:08,476 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-10-24T12:44:08,479 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2025-10-24T12:44:08,482 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2025-10-24T12:44:08,483 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-10-24T12:44:08,485 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2025-10-24T12:44:08,488 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2025-10-24T12:44:08,489 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:08,491 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:08,494 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:08,496 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:08,499 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2025-10-24T12:44:08,502 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,504 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,507 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,511 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,513 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,516 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,520 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2025-10-24T12:44:08,523 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2025-10-24T12:44:08,526 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2025-10-24T12:44:08,527 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-10-24T12:44:08,530 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2025-10-24T12:44:08,533 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2025-10-24T12:44:08,535 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-24T12:44:08,538 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-24T12:44:08,541 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-24T12:44:08,543 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2025-10-24T12:44:08,547 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2025-10-24T12:44:08,548 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-10-24T12:44:08,551 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2025-10-24T12:44:08,556 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2025-10-24T12:44:08,557 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,561 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,562 copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,565 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,568 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,570 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,573 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,575 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,578 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,582 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,585 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,587 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2025-10-24T12:44:08,590 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,592 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,594 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,597 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,599 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,601 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,603 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,605 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,608 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,610 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,613 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2025-10-24T12:44:08,615 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,618 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,620 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,622 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,625 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,627 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,629 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,631 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,633 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,635 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,638 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2025-10-24T12:44:08,640 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,642 copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,644 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,646 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,648 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,651 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,653 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,655 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,658 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,662 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,664 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,667 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,669 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,671 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,674 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2025-10-24T12:44:08,676 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,678 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,681 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,683 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,685 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,687 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,691 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,692 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,695 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,697 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,700 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,702 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,704 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,707 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2025-10-24T12:44:08,709 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,711 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,714 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,716 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,720 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,723 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,725 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,727 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,730 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,732 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,734 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,737 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2025-10-24T12:44:08,739 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2025-10-24T12:44:08,742 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2025-10-24T12:44:08,744 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,747 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,751 copying build/lib/deepspeed/ops/adam/zenflow_torch_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,757 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,760 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,762 copying build/lib/deepspeed/ops/adam/zenflow_cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2025-10-24T12:44:08,765 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2025-10-24T12:44:08,767 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-24T12:44:08,770 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-24T12:44:08,772 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-24T12:44:08,774 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-24T12:44:08,776 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2025-10-24T12:44:08,780 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2025-10-24T12:44:08,781 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,784 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,787 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,789 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,793 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,795 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2025-10-24T12:44:08,798 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2025-10-24T12:44:08,801 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2025-10-24T12:44:08,803 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,806 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,808 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,811 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,813 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,815 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2025-10-24T12:44:08,819 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2025-10-24T12:44:08,820 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-24T12:44:08,823 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2025-10-24T12:44:08,824 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-10-24T12:44:08,827 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2025-10-24T12:44:08,829 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-24T12:44:08,832 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2025-10-24T12:44:08,835 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2025-10-24T12:44:08,836 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,839 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,842 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,845 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2025-10-24T12:44:08,847 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,849 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,851 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,854 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,856 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,858 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2025-10-24T12:44:08,860 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,863 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2025-10-24T12:44:08,864 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-24T12:44:08,867 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-24T12:44:08,869 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-24T12:44:08,871 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2025-10-24T12:44:08,873 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,876 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2025-10-24T12:44:08,880 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2025-10-24T12:44:08,882 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,884 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,888 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2025-10-24T12:44:08,889 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,892 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,895 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2025-10-24T12:44:08,896 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,899 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,901 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,904 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,907 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,909 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,911 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2025-10-24T12:44:08,913 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,916 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,919 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,921 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,924 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,926 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,929 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,932 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,934 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,936 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,939 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,942 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,944 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,947 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,950 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,952 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,954 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2025-10-24T12:44:08,956 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,959 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,961 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,964 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,967 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,969 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,971 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,973 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,976 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,978 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,981 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2025-10-24T12:44:08,985 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2025-10-24T12:44:08,986 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-24T12:44:08,988 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-24T12:44:08,990 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2025-10-24T12:44:08,992 running install_egg_info 2025-10-24T12:44:09,028 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.18.1-py3.11.egg-info 2025-10-24T12:44:09,043 running install_scripts 2025-10-24T12:44:09,045 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,047 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,049 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,051 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,053 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,055 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,058 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,060 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,062 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,065 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,067 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts 2025-10-24T12:44:09,068 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/deepspeed to 755 2025-10-24T12:44:09,069 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_bench to 755 2025-10-24T12:44:09,070 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_io to 755 2025-10-24T12:44:09,071 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds to 755 2025-10-24T12:44:09,071 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/dsr to 755 2025-10-24T12:44:09,072 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_nvme_tune to 755 2025-10-24T12:44:09,073 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_report to 755 2025-10-24T12:44:09,073 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_elastic to 755 2025-10-24T12:44:09,074 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/deepspeed.pt to 755 2025-10-24T12:44:09,075 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.data/scripts/ds_ssh to 755 2025-10-24T12:44:09,092 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.1.dist-info/WHEEL 2025-10-24T12:44:09,095 creating '/tmp/pip-wheel-eltb9493/deepspeed-0.18.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2025-10-24T12:44:09,100 adding 'deepspeed/__init__.py' 2025-10-24T12:44:09,102 adding 'deepspeed/constants.py' 2025-10-24T12:44:09,104 adding 'deepspeed/env_report.py' 2025-10-24T12:44:09,106 adding 'deepspeed/git_version_info.py' 2025-10-24T12:44:09,107 adding 'deepspeed/git_version_info_installed.py' 2025-10-24T12:44:09,110 adding 'deepspeed/accelerator/__init__.py' 2025-10-24T12:44:09,112 adding 'deepspeed/accelerator/abstract_accelerator.py' 2025-10-24T12:44:09,114 adding 'deepspeed/accelerator/cpu_accelerator.py' 2025-10-24T12:44:09,116 adding 'deepspeed/accelerator/cuda_accelerator.py' 2025-10-24T12:44:09,119 adding 'deepspeed/accelerator/hpu_accelerator.py' 2025-10-24T12:44:09,121 adding 'deepspeed/accelerator/mlu_accelerator.py' 2025-10-24T12:44:09,123 adding 'deepspeed/accelerator/mps_accelerator.py' 2025-10-24T12:44:09,126 adding 'deepspeed/accelerator/npu_accelerator.py' 2025-10-24T12:44:09,128 adding 'deepspeed/accelerator/real_accelerator.py' 2025-10-24T12:44:09,130 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2025-10-24T12:44:09,133 adding 'deepspeed/accelerator/xpu_accelerator.py' 2025-10-24T12:44:09,135 adding 'deepspeed/autotuning/__init__.py' 2025-10-24T12:44:09,140 adding 'deepspeed/autotuning/autotuner.py' 2025-10-24T12:44:09,142 adding 'deepspeed/autotuning/config.py' 2025-10-24T12:44:09,144 adding 'deepspeed/autotuning/constants.py' 2025-10-24T12:44:09,147 adding 'deepspeed/autotuning/scheduler.py' 2025-10-24T12:44:09,149 adding 'deepspeed/autotuning/utils.py' 2025-10-24T12:44:09,152 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2025-10-24T12:44:09,153 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2025-10-24T12:44:09,154 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2025-10-24T12:44:09,156 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2025-10-24T12:44:09,158 adding 'deepspeed/autotuning/tuner/__init__.py' 2025-10-24T12:44:09,159 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2025-10-24T12:44:09,160 adding 'deepspeed/autotuning/tuner/cost_model.py' 2025-10-24T12:44:09,162 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2025-10-24T12:44:09,164 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2025-10-24T12:44:09,165 adding 'deepspeed/autotuning/tuner/utils.py' 2025-10-24T12:44:09,167 adding 'deepspeed/checkpoint/__init__.py' 2025-10-24T12:44:09,168 adding 'deepspeed/checkpoint/constants.py' 2025-10-24T12:44:09,170 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2025-10-24T12:44:09,173 adding 'deepspeed/checkpoint/ds_to_universal.py' 2025-10-24T12:44:09,175 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2025-10-24T12:44:09,176 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2025-10-24T12:44:09,178 adding 'deepspeed/checkpoint/reshape_utils.py' 2025-10-24T12:44:09,179 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2025-10-24T12:44:09,181 adding 'deepspeed/checkpoint/utils.py' 2025-10-24T12:44:09,182 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2025-10-24T12:44:09,184 adding 'deepspeed/comm/__init__.py' 2025-10-24T12:44:09,186 adding 'deepspeed/comm/backend.py' 2025-10-24T12:44:09,187 adding 'deepspeed/comm/ccl.py' 2025-10-24T12:44:09,191 adding 'deepspeed/comm/comm.py' 2025-10-24T12:44:09,192 adding 'deepspeed/comm/config.py' 2025-10-24T12:44:09,194 adding 'deepspeed/comm/constants.py' 2025-10-24T12:44:09,195 adding 'deepspeed/comm/reduce_op.py' 2025-10-24T12:44:09,197 adding 'deepspeed/comm/torch.py' 2025-10-24T12:44:09,199 adding 'deepspeed/comm/utils.py' 2025-10-24T12:44:09,200 adding 'deepspeed/compile/__init__.py' 2025-10-24T12:44:09,203 adding 'deepspeed/compile/backend.py' 2025-10-24T12:44:09,204 adding 'deepspeed/compile/config.py' 2025-10-24T12:44:09,206 adding 'deepspeed/compile/fx.py' 2025-10-24T12:44:09,207 adding 'deepspeed/compile/graph_param.py' 2025-10-24T12:44:09,209 adding 'deepspeed/compile/inductor.py' 2025-10-24T12:44:09,210 adding 'deepspeed/compile/init_z1.py' 2025-10-24T12:44:09,212 adding 'deepspeed/compile/init_z3.py' 2025-10-24T12:44:09,213 adding 'deepspeed/compile/input_storage.py' 2025-10-24T12:44:09,216 adding 'deepspeed/compile/list_schedule.py' 2025-10-24T12:44:09,217 adding 'deepspeed/compile/partitioner.py' 2025-10-24T12:44:09,218 adding 'deepspeed/compile/patch_compiled_func.py' 2025-10-24T12:44:09,220 adding 'deepspeed/compile/patch_fake_tensor.py' 2025-10-24T12:44:09,222 adding 'deepspeed/compile/util.py' 2025-10-24T12:44:09,224 adding 'deepspeed/compile/passes/__init__.py' 2025-10-24T12:44:09,226 adding 'deepspeed/compile/passes/offload_activation.py' 2025-10-24T12:44:09,228 adding 'deepspeed/compile/passes/offload_adam_states.py' 2025-10-24T12:44:09,230 adding 'deepspeed/compile/passes/offload_parameters.py' 2025-10-24T12:44:09,231 adding 'deepspeed/compile/passes/prefetch.py' 2025-10-24T12:44:09,233 adding 'deepspeed/compile/passes/selective_gather.py' 2025-10-24T12:44:09,234 adding 'deepspeed/compile/passes/zero1_compile.py' 2025-10-24T12:44:09,236 adding 'deepspeed/compile/passes/zero3_compile.py' 2025-10-24T12:44:09,238 adding 'deepspeed/compile/profilers/__init__.py' 2025-10-24T12:44:09,240 adding 'deepspeed/compile/profilers/comm_profile.py' 2025-10-24T12:44:09,242 adding 'deepspeed/compile/profilers/graph_profile.py' 2025-10-24T12:44:09,244 adding 'deepspeed/compression/__init__.py' 2025-10-24T12:44:09,247 adding 'deepspeed/compression/basic_layer.py' 2025-10-24T12:44:09,249 adding 'deepspeed/compression/compress.py' 2025-10-24T12:44:09,251 adding 'deepspeed/compression/config.py' 2025-10-24T12:44:09,253 adding 'deepspeed/compression/constants.py' 2025-10-24T12:44:09,255 adding 'deepspeed/compression/helper.py' 2025-10-24T12:44:09,256 adding 'deepspeed/compression/scheduler.py' 2025-10-24T12:44:09,258 adding 'deepspeed/compression/utils.py' 2025-10-24T12:44:09,260 adding 'deepspeed/datastates/__init__.py' 2025-10-24T12:44:09,261 adding 'deepspeed/datastates/config.py' 2025-10-24T12:44:09,262 adding 'deepspeed/elasticity/__init__.py' 2025-10-24T12:44:09,264 adding 'deepspeed/elasticity/config.py' 2025-10-24T12:44:09,265 adding 'deepspeed/elasticity/constants.py' 2025-10-24T12:44:09,266 adding 'deepspeed/elasticity/elastic_agent.py' 2025-10-24T12:44:09,269 adding 'deepspeed/elasticity/elasticity.py' 2025-10-24T12:44:09,270 adding 'deepspeed/elasticity/utils.py' 2025-10-24T12:44:09,271 adding 'deepspeed/inference/__init__.py' 2025-10-24T12:44:09,273 adding 'deepspeed/inference/config.py' 2025-10-24T12:44:09,277 adding 'deepspeed/inference/engine.py' 2025-10-24T12:44:09,279 adding 'deepspeed/inference/quantization/__init__.py' 2025-10-24T12:44:09,280 adding 'deepspeed/inference/quantization/layers.py' 2025-10-24T12:44:09,281 adding 'deepspeed/inference/quantization/quantization.py' 2025-10-24T12:44:09,283 adding 'deepspeed/inference/quantization/quantization_context.py' 2025-10-24T12:44:09,285 adding 'deepspeed/inference/quantization/utils.py' 2025-10-24T12:44:09,286 adding 'deepspeed/inference/v2/__init__.py' 2025-10-24T12:44:09,287 adding 'deepspeed/inference/v2/allocator.py' 2025-10-24T12:44:09,289 adding 'deepspeed/inference/v2/config_v2.py' 2025-10-24T12:44:09,290 adding 'deepspeed/inference/v2/engine_factory.py' 2025-10-24T12:44:09,292 adding 'deepspeed/inference/v2/engine_v2.py' 2025-10-24T12:44:09,293 adding 'deepspeed/inference/v2/inference_parameter.py' 2025-10-24T12:44:09,295 adding 'deepspeed/inference/v2/inference_utils.py' 2025-10-24T12:44:09,296 adding 'deepspeed/inference/v2/logging.py' 2025-10-24T12:44:09,297 adding 'deepspeed/inference/v2/scheduling_utils.py' 2025-10-24T12:44:09,299 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2025-10-24T12:44:09,300 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2025-10-24T12:44:09,301 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2025-10-24T12:44:09,303 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2025-10-24T12:44:09,305 adding 'deepspeed/inference/v2/kernels/__init__.py' 2025-10-24T12:44:09,306 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2025-10-24T12:44:09,308 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2025-10-24T12:44:09,309 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2025-10-24T12:44:09,311 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2025-10-24T12:44:09,312 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2025-10-24T12:44:09,313 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2025-10-24T12:44:09,315 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2025-10-24T12:44:09,316 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2025-10-24T12:44:09,318 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2025-10-24T12:44:09,320 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2025-10-24T12:44:09,321 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2025-10-24T12:44:09,323 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2025-10-24T12:44:09,325 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2025-10-24T12:44:09,326 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2025-10-24T12:44:09,328 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2025-10-24T12:44:09,329 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2025-10-24T12:44:09,330 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2025-10-24T12:44:09,332 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2025-10-24T12:44:09,333 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2025-10-24T12:44:09,335 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2025-10-24T12:44:09,337 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2025-10-24T12:44:09,339 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2025-10-24T12:44:09,340 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2025-10-24T12:44:09,342 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2025-10-24T12:44:09,344 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2025-10-24T12:44:09,345 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2025-10-24T12:44:09,347 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2025-10-24T12:44:09,349 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2025-10-24T12:44:09,350 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2025-10-24T12:44:09,352 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2025-10-24T12:44:09,353 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2025-10-24T12:44:09,355 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2025-10-24T12:44:09,356 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2025-10-24T12:44:09,358 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2025-10-24T12:44:09,359 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2025-10-24T12:44:09,362 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2025-10-24T12:44:09,363 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2025-10-24T12:44:09,365 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2025-10-24T12:44:09,366 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2025-10-24T12:44:09,367 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2025-10-24T12:44:09,369 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2025-10-24T12:44:09,370 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2025-10-24T12:44:09,372 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2025-10-24T12:44:09,374 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2025-10-24T12:44:09,375 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2025-10-24T12:44:09,376 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2025-10-24T12:44:09,378 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2025-10-24T12:44:09,380 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2025-10-24T12:44:09,381 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2025-10-24T12:44:09,383 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2025-10-24T12:44:09,384 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2025-10-24T12:44:09,386 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2025-10-24T12:44:09,387 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2025-10-24T12:44:09,389 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2025-10-24T12:44:09,390 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2025-10-24T12:44:09,392 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2025-10-24T12:44:09,393 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2025-10-24T12:44:09,395 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2025-10-24T12:44:09,396 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2025-10-24T12:44:09,397 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2025-10-24T12:44:09,399 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2025-10-24T12:44:09,401 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2025-10-24T12:44:09,402 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2025-10-24T12:44:09,403 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2025-10-24T12:44:09,406 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2025-10-24T12:44:09,409 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2025-10-24T12:44:09,411 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2025-10-24T12:44:09,412 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2025-10-24T12:44:09,414 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2025-10-24T12:44:09,415 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2025-10-24T12:44:09,416 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2025-10-24T12:44:09,417 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2025-10-24T12:44:09,420 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2025-10-24T12:44:09,421 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2025-10-24T12:44:09,422 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2025-10-24T12:44:09,423 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2025-10-24T12:44:09,425 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2025-10-24T12:44:09,426 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2025-10-24T12:44:09,428 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2025-10-24T12:44:09,429 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2025-10-24T12:44:09,431 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2025-10-24T12:44:09,432 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2025-10-24T12:44:09,433 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2025-10-24T12:44:09,435 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2025-10-24T12:44:09,437 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2025-10-24T12:44:09,439 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2025-10-24T12:44:09,440 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2025-10-24T12:44:09,442 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2025-10-24T12:44:09,443 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2025-10-24T12:44:09,445 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2025-10-24T12:44:09,447 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2025-10-24T12:44:09,448 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2025-10-24T12:44:09,450 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2025-10-24T12:44:09,452 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2025-10-24T12:44:09,453 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2025-10-24T12:44:09,454 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2025-10-24T12:44:09,455 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2025-10-24T12:44:09,456 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2025-10-24T12:44:09,458 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2025-10-24T12:44:09,459 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2025-10-24T12:44:09,461 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2025-10-24T12:44:09,462 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2025-10-24T12:44:09,463 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2025-10-24T12:44:09,464 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2025-10-24T12:44:09,466 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2025-10-24T12:44:09,468 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2025-10-24T12:44:09,469 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2025-10-24T12:44:09,470 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2025-10-24T12:44:09,472 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2025-10-24T12:44:09,473 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2025-10-24T12:44:09,474 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2025-10-24T12:44:09,476 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2025-10-24T12:44:09,477 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2025-10-24T12:44:09,478 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2025-10-24T12:44:09,480 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2025-10-24T12:44:09,481 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2025-10-24T12:44:09,483 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2025-10-24T12:44:09,484 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2025-10-24T12:44:09,485 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2025-10-24T12:44:09,487 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2025-10-24T12:44:09,489 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2025-10-24T12:44:09,491 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2025-10-24T12:44:09,493 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2025-10-24T12:44:09,494 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2025-10-24T12:44:09,497 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2025-10-24T12:44:09,499 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2025-10-24T12:44:09,501 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2025-10-24T12:44:09,504 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2025-10-24T12:44:09,505 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2025-10-24T12:44:09,506 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2025-10-24T12:44:09,507 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2025-10-24T12:44:09,509 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2025-10-24T12:44:09,510 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2025-10-24T12:44:09,511 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2025-10-24T12:44:09,513 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2025-10-24T12:44:09,514 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2025-10-24T12:44:09,516 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2025-10-24T12:44:09,517 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2025-10-24T12:44:09,518 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2025-10-24T12:44:09,520 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2025-10-24T12:44:09,521 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2025-10-24T12:44:09,522 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2025-10-24T12:44:09,524 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2025-10-24T12:44:09,525 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2025-10-24T12:44:09,527 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2025-10-24T12:44:09,529 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2025-10-24T12:44:09,530 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2025-10-24T12:44:09,532 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2025-10-24T12:44:09,533 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2025-10-24T12:44:09,535 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2025-10-24T12:44:09,536 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2025-10-24T12:44:09,538 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2025-10-24T12:44:09,539 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2025-10-24T12:44:09,541 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2025-10-24T12:44:09,542 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2025-10-24T12:44:09,544 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2025-10-24T12:44:09,545 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2025-10-24T12:44:09,547 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2025-10-24T12:44:09,549 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2025-10-24T12:44:09,550 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2025-10-24T12:44:09,551 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2025-10-24T12:44:09,553 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2025-10-24T12:44:09,555 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2025-10-24T12:44:09,556 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2025-10-24T12:44:09,558 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2025-10-24T12:44:09,559 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2025-10-24T12:44:09,561 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2025-10-24T12:44:09,562 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2025-10-24T12:44:09,564 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2025-10-24T12:44:09,565 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2025-10-24T12:44:09,567 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2025-10-24T12:44:09,568 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2025-10-24T12:44:09,570 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2025-10-24T12:44:09,571 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2025-10-24T12:44:09,573 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2025-10-24T12:44:09,575 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2025-10-24T12:44:09,576 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2025-10-24T12:44:09,578 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2025-10-24T12:44:09,579 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2025-10-24T12:44:09,580 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2025-10-24T12:44:09,581 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2025-10-24T12:44:09,583 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2025-10-24T12:44:09,584 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2025-10-24T12:44:09,585 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2025-10-24T12:44:09,587 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2025-10-24T12:44:09,589 adding 'deepspeed/inference/v2/modules/__init__.py' 2025-10-24T12:44:09,590 adding 'deepspeed/inference/v2/modules/ds_module.py' 2025-10-24T12:44:09,592 adding 'deepspeed/inference/v2/modules/heuristics.py' 2025-10-24T12:44:09,593 adding 'deepspeed/inference/v2/modules/module_registry.py' 2025-10-24T12:44:09,594 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2025-10-24T12:44:09,596 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2025-10-24T12:44:09,597 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2025-10-24T12:44:09,598 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2025-10-24T12:44:09,599 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2025-10-24T12:44:09,601 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2025-10-24T12:44:09,602 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2025-10-24T12:44:09,604 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2025-10-24T12:44:09,606 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2025-10-24T12:44:09,607 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2025-10-24T12:44:09,609 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2025-10-24T12:44:09,610 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2025-10-24T12:44:09,612 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2025-10-24T12:44:09,614 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2025-10-24T12:44:09,615 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2025-10-24T12:44:09,617 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2025-10-24T12:44:09,619 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2025-10-24T12:44:09,621 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2025-10-24T12:44:09,622 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2025-10-24T12:44:09,624 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2025-10-24T12:44:09,625 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2025-10-24T12:44:09,627 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2025-10-24T12:44:09,629 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2025-10-24T12:44:09,630 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2025-10-24T12:44:09,632 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2025-10-24T12:44:09,633 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2025-10-24T12:44:09,635 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2025-10-24T12:44:09,636 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2025-10-24T12:44:09,637 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2025-10-24T12:44:09,638 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2025-10-24T12:44:09,640 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2025-10-24T12:44:09,641 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2025-10-24T12:44:09,642 adding 'deepspeed/inference/v2/ragged/__init__.py' 2025-10-24T12:44:09,644 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2025-10-24T12:44:09,645 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2025-10-24T12:44:09,647 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2025-10-24T12:44:09,649 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2025-10-24T12:44:09,651 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2025-10-24T12:44:09,652 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2025-10-24T12:44:09,654 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2025-10-24T12:44:09,655 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2025-10-24T12:44:09,657 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2025-10-24T12:44:09,659 adding 'deepspeed/io/__init__.py' 2025-10-24T12:44:09,660 adding 'deepspeed/io/base_file_writer.py' 2025-10-24T12:44:09,661 adding 'deepspeed/io/base_io_buffer.py' 2025-10-24T12:44:09,662 adding 'deepspeed/io/constants.py' 2025-10-24T12:44:09,664 adding 'deepspeed/io/double_io_buffer.py' 2025-10-24T12:44:09,666 adding 'deepspeed/io/fast_file_writer.py' 2025-10-24T12:44:09,667 adding 'deepspeed/io/mock_file_writer.py' 2025-10-24T12:44:09,668 adding 'deepspeed/io/py_file_writer.py' 2025-10-24T12:44:09,669 adding 'deepspeed/io/single_io_buffer.py' 2025-10-24T12:44:09,671 adding 'deepspeed/io/utils.py' 2025-10-24T12:44:09,672 adding 'deepspeed/launcher/__init__.py' 2025-10-24T12:44:09,674 adding 'deepspeed/launcher/constants.py' 2025-10-24T12:44:09,676 adding 'deepspeed/launcher/launch.py' 2025-10-24T12:44:09,677 adding 'deepspeed/launcher/launcher_helper.py' 2025-10-24T12:44:09,679 adding 'deepspeed/launcher/multinode_runner.py' 2025-10-24T12:44:09,683 adding 'deepspeed/launcher/runner.py' 2025-10-24T12:44:09,685 adding 'deepspeed/linear/__init__.py' 2025-10-24T12:44:09,686 adding 'deepspeed/linear/config.py' 2025-10-24T12:44:09,687 adding 'deepspeed/linear/context_manager.py' 2025-10-24T12:44:09,689 adding 'deepspeed/linear/optimized_linear.py' 2025-10-24T12:44:09,691 adding 'deepspeed/linear/quantization.py' 2025-10-24T12:44:09,693 adding 'deepspeed/model_implementations/__init__.py' 2025-10-24T12:44:09,694 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2025-10-24T12:44:09,696 adding 'deepspeed/model_implementations/diffusers/unet.py' 2025-10-24T12:44:09,697 adding 'deepspeed/model_implementations/diffusers/vae.py' 2025-10-24T12:44:09,699 adding 'deepspeed/model_implementations/features/__init__.py' 2025-10-24T12:44:09,700 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2025-10-24T12:44:09,702 adding 'deepspeed/model_implementations/transformers/__init__.py' 2025-10-24T12:44:09,704 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2025-10-24T12:44:09,705 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2025-10-24T12:44:09,706 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2025-10-24T12:44:09,707 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2025-10-24T12:44:09,709 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2025-10-24T12:44:09,710 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2025-10-24T12:44:09,711 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2025-10-24T12:44:09,712 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2025-10-24T12:44:09,714 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2025-10-24T12:44:09,716 adding 'deepspeed/module_inject/__init__.py' 2025-10-24T12:44:09,719 adding 'deepspeed/module_inject/auto_tp.py' 2025-10-24T12:44:09,720 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2025-10-24T12:44:09,722 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2025-10-24T12:44:09,724 adding 'deepspeed/module_inject/inject.py' 2025-10-24T12:44:09,727 adding 'deepspeed/module_inject/layers.py' 2025-10-24T12:44:09,729 adding 'deepspeed/module_inject/load_checkpoint.py' 2025-10-24T12:44:09,730 adding 'deepspeed/module_inject/module_quantize.py' 2025-10-24T12:44:09,732 adding 'deepspeed/module_inject/policy.py' 2025-10-24T12:44:09,736 adding 'deepspeed/module_inject/replace_module.py' 2025-10-24T12:44:09,737 adding 'deepspeed/module_inject/replace_policy.py' 2025-10-24T12:44:09,738 adding 'deepspeed/module_inject/tp_shard.py' 2025-10-24T12:44:09,739 adding 'deepspeed/module_inject/utils.py' 2025-10-24T12:44:09,741 adding 'deepspeed/module_inject/containers/__init__.py' 2025-10-24T12:44:09,743 adding 'deepspeed/module_inject/containers/base.py' 2025-10-24T12:44:09,745 adding 'deepspeed/module_inject/containers/base_moe.py' 2025-10-24T12:44:09,746 adding 'deepspeed/module_inject/containers/bert.py' 2025-10-24T12:44:09,748 adding 'deepspeed/module_inject/containers/bloom.py' 2025-10-24T12:44:09,749 adding 'deepspeed/module_inject/containers/clip.py' 2025-10-24T12:44:09,750 adding 'deepspeed/module_inject/containers/distil_bert.py' 2025-10-24T12:44:09,752 adding 'deepspeed/module_inject/containers/gpt2.py' 2025-10-24T12:44:09,753 adding 'deepspeed/module_inject/containers/gptj.py' 2025-10-24T12:44:09,755 adding 'deepspeed/module_inject/containers/gptneo.py' 2025-10-24T12:44:09,756 adding 'deepspeed/module_inject/containers/gptneox.py' 2025-10-24T12:44:09,758 adding 'deepspeed/module_inject/containers/internlm.py' 2025-10-24T12:44:09,759 adding 'deepspeed/module_inject/containers/llama.py' 2025-10-24T12:44:09,761 adding 'deepspeed/module_inject/containers/llama2.py' 2025-10-24T12:44:09,762 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2025-10-24T12:44:09,764 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2025-10-24T12:44:09,765 adding 'deepspeed/module_inject/containers/opt.py' 2025-10-24T12:44:09,766 adding 'deepspeed/module_inject/containers/unet.py' 2025-10-24T12:44:09,768 adding 'deepspeed/module_inject/containers/vae.py' 2025-10-24T12:44:09,769 adding 'deepspeed/module_inject/containers/features/__init__.py' 2025-10-24T12:44:09,771 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2025-10-24T12:44:09,773 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2025-10-24T12:44:09,774 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2025-10-24T12:44:09,775 adding 'deepspeed/module_inject/containers/features/megatron.py' 2025-10-24T12:44:09,777 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2025-10-24T12:44:09,778 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2025-10-24T12:44:09,780 adding 'deepspeed/moe/__init__.py' 2025-10-24T12:44:09,782 adding 'deepspeed/moe/experts.py' 2025-10-24T12:44:09,783 adding 'deepspeed/moe/layer.py' 2025-10-24T12:44:09,785 adding 'deepspeed/moe/mappings.py' 2025-10-24T12:44:09,788 adding 'deepspeed/moe/sharded_moe.py' 2025-10-24T12:44:09,790 adding 'deepspeed/moe/utils.py' 2025-10-24T12:44:09,792 adding 'deepspeed/monitor/__init__.py' 2025-10-24T12:44:09,793 adding 'deepspeed/monitor/comet.py' 2025-10-24T12:44:09,795 adding 'deepspeed/monitor/config.py' 2025-10-24T12:44:09,796 adding 'deepspeed/monitor/csv_monitor.py' 2025-10-24T12:44:09,797 adding 'deepspeed/monitor/monitor.py' 2025-10-24T12:44:09,799 adding 'deepspeed/monitor/tensorboard.py' 2025-10-24T12:44:09,800 adding 'deepspeed/monitor/utils.py' 2025-10-24T12:44:09,801 adding 'deepspeed/monitor/wandb.py' 2025-10-24T12:44:09,803 adding 'deepspeed/nebula/__init__.py' 2025-10-24T12:44:09,804 adding 'deepspeed/nebula/config.py' 2025-10-24T12:44:09,805 adding 'deepspeed/nebula/constants.py' 2025-10-24T12:44:09,807 adding 'deepspeed/nvme/__init__.py' 2025-10-24T12:44:09,809 adding 'deepspeed/nvme/ds_aio_args.py' 2025-10-24T12:44:09,810 adding 'deepspeed/nvme/ds_aio_basic.py' 2025-10-24T12:44:09,811 adding 'deepspeed/nvme/ds_aio_constants.py' 2025-10-24T12:44:09,812 adding 'deepspeed/nvme/ds_aio_handle.py' 2025-10-24T12:44:09,814 adding 'deepspeed/nvme/ds_aio_job.py' 2025-10-24T12:44:09,815 adding 'deepspeed/nvme/io_engine.py' 2025-10-24T12:44:09,816 adding 'deepspeed/nvme/parse_nvme_stats.py' 2025-10-24T12:44:09,818 adding 'deepspeed/nvme/perf_generate_param.py' 2025-10-24T12:44:09,819 adding 'deepspeed/nvme/perf_run_sweep.py' 2025-10-24T12:44:09,820 adding 'deepspeed/nvme/perf_sweep_utils.py' 2025-10-24T12:44:09,822 adding 'deepspeed/nvme/test_ds_aio.py' 2025-10-24T12:44:09,823 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2025-10-24T12:44:09,825 adding 'deepspeed/nvme/torch_fastio_engine.py' 2025-10-24T12:44:09,826 adding 'deepspeed/nvme/torch_io.py' 2025-10-24T12:44:09,827 adding 'deepspeed/nvme/validate_async_io.py' 2025-10-24T12:44:09,829 adding 'deepspeed/ops/__init__.py' 2025-10-24T12:44:09,830 adding 'deepspeed/ops/adagrad/__init__.py' 2025-10-24T12:44:09,832 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2025-10-24T12:44:09,833 adding 'deepspeed/ops/adam/__init__.py' 2025-10-24T12:44:09,835 adding 'deepspeed/ops/adam/cpu_adam.py' 2025-10-24T12:44:09,837 adding 'deepspeed/ops/adam/fused_adam.py' 2025-10-24T12:44:09,838 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2025-10-24T12:44:09,840 adding 'deepspeed/ops/adam/zenflow_cpu_adam.py' 2025-10-24T12:44:09,843 adding 'deepspeed/ops/adam/zenflow_torch_adam.py' 2025-10-24T12:44:09,845 adding 'deepspeed/ops/aio/__init__.py' 2025-10-24T12:44:09,847 adding 'deepspeed/ops/compile/__init__.py' 2025-10-24T12:44:09,850 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2025-10-24T12:44:09,851 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2025-10-24T12:44:09,853 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2025-10-24T12:44:09,854 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2025-10-24T12:44:09,856 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2025-10-24T12:44:09,857 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2025-10-24T12:44:09,860 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2025-10-24T12:44:09,862 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2025-10-24T12:44:09,863 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2025-10-24T12:44:09,864 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2025-10-24T12:44:09,866 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2025-10-24T12:44:09,867 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2025-10-24T12:44:09,869 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2025-10-24T12:44:09,870 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2025-10-24T12:44:09,871 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2025-10-24T12:44:09,873 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2025-10-24T12:44:09,874 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2025-10-24T12:44:09,875 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2025-10-24T12:44:09,877 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2025-10-24T12:44:09,878 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2025-10-24T12:44:09,879 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2025-10-24T12:44:09,880 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2025-10-24T12:44:09,882 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2025-10-24T12:44:09,883 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2025-10-24T12:44:09,884 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2025-10-24T12:44:09,886 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2025-10-24T12:44:09,888 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2025-10-24T12:44:09,889 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2025-10-24T12:44:09,891 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2025-10-24T12:44:09,892 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2025-10-24T12:44:09,895 adding 'deepspeed/ops/csrc/compile/deepcompile.cpp' 2025-10-24T12:44:09,897 adding 'deepspeed/ops/csrc/compile/init.cpp' 2025-10-24T12:44:09,898 adding 'deepspeed/ops/csrc/compile/util.cpp' 2025-10-24T12:44:09,899 adding 'deepspeed/ops/csrc/compile/z1.cpp' 2025-10-24T12:44:09,901 adding 'deepspeed/ops/csrc/compile/z1.h' 2025-10-24T12:44:09,902 adding 'deepspeed/ops/csrc/compile/z2.cpp' 2025-10-24T12:44:09,903 adding 'deepspeed/ops/csrc/compile/z2.h' 2025-10-24T12:44:09,906 adding 'deepspeed/ops/csrc/compile/z3.cpp' 2025-10-24T12:44:09,907 adding 'deepspeed/ops/csrc/compile/z3.h' 2025-10-24T12:44:09,909 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2025-10-24T12:44:09,912 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2025-10-24T12:44:09,915 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2025-10-24T12:44:09,916 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2025-10-24T12:44:09,917 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2025-10-24T12:44:09,919 adding 'deepspeed/ops/csrc/cpu/comm/riscv64/shm.h' 2025-10-24T12:44:09,921 adding 'deepspeed/ops/csrc/cpu/comm/x86_64/shm.h' 2025-10-24T12:44:09,923 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2025-10-24T12:44:09,925 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2025-10-24T12:44:09,927 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2025-10-24T12:44:09,929 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2025-10-24T12:44:09,930 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2025-10-24T12:44:09,938 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2025-10-24T12:44:09,943 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2025-10-24T12:44:09,945 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2025-10-24T12:44:09,948 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2025-10-24T12:44:09,950 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2025-10-24T12:44:09,951 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2025-10-24T12:44:09,953 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2025-10-24T12:44:09,955 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2025-10-24T12:44:09,958 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2025-10-24T12:44:09,960 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2025-10-24T12:44:09,962 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2025-10-24T12:44:09,964 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2025-10-24T12:44:09,972 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2025-10-24T12:44:09,975 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2025-10-24T12:44:09,977 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2025-10-24T12:44:09,981 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2025-10-24T12:44:09,985 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2025-10-24T12:44:09,988 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2025-10-24T12:44:09,990 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2025-10-24T12:44:09,992 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2025-10-24T12:44:09,994 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2025-10-24T12:44:09,995 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2025-10-24T12:44:09,997 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2025-10-24T12:44:09,999 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2025-10-24T12:44:10,001 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2025-10-24T12:44:10,002 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2025-10-24T12:44:10,005 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2025-10-24T12:44:10,006 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2025-10-24T12:44:10,008 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2025-10-24T12:44:10,009 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2025-10-24T12:44:10,010 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2025-10-24T12:44:10,012 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2025-10-24T12:44:10,014 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2025-10-24T12:44:10,015 adding 'deepspeed/ops/csrc/includes/Timer.h' 2025-10-24T12:44:10,017 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2025-10-24T12:44:10,018 adding 'deepspeed/ops/csrc/includes/compat.h' 2025-10-24T12:44:10,019 adding 'deepspeed/ops/csrc/includes/context.h' 2025-10-24T12:44:10,021 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2025-10-24T12:44:10,022 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2025-10-24T12:44:10,024 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2025-10-24T12:44:10,025 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2025-10-24T12:44:10,027 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2025-10-24T12:44:10,028 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2025-10-24T12:44:10,031 adding 'deepspeed/ops/csrc/includes/deepcompile.h' 2025-10-24T12:44:10,033 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2025-10-24T12:44:10,034 adding 'deepspeed/ops/csrc/includes/dropout.h' 2025-10-24T12:44:10,036 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2025-10-24T12:44:10,037 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2025-10-24T12:44:10,038 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2025-10-24T12:44:10,040 adding 'deepspeed/ops/csrc/includes/gelu.h' 2025-10-24T12:44:10,041 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2025-10-24T12:44:10,043 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2025-10-24T12:44:10,045 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2025-10-24T12:44:10,047 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2025-10-24T12:44:10,048 adding 'deepspeed/ops/csrc/includes/quantization.h' 2025-10-24T12:44:10,050 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2025-10-24T12:44:10,052 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2025-10-24T12:44:10,054 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2025-10-24T12:44:10,056 adding 'deepspeed/ops/csrc/includes/simd.h' 2025-10-24T12:44:10,058 adding 'deepspeed/ops/csrc/includes/softmax.h' 2025-10-24T12:44:10,059 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2025-10-24T12:44:10,061 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2025-10-24T12:44:10,062 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2025-10-24T12:44:10,064 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2025-10-24T12:44:10,066 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2025-10-24T12:44:10,068 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2025-10-24T12:44:10,069 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2025-10-24T12:44:10,071 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2025-10-24T12:44:10,072 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2025-10-24T12:44:10,074 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2025-10-24T12:44:10,076 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2025-10-24T12:44:10,078 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2025-10-24T12:44:10,081 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2025-10-24T12:44:10,082 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2025-10-24T12:44:10,084 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2025-10-24T12:44:10,086 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2025-10-24T12:44:10,088 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2025-10-24T12:44:10,089 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2025-10-24T12:44:10,091 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2025-10-24T12:44:10,092 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2025-10-24T12:44:10,094 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2025-10-24T12:44:10,097 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2025-10-24T12:44:10,098 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2025-10-24T12:44:10,100 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2025-10-24T12:44:10,102 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2025-10-24T12:44:10,105 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2025-10-24T12:44:10,109 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2025-10-24T12:44:10,110 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2025-10-24T12:44:10,113 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2025-10-24T12:44:10,117 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2025-10-24T12:44:10,120 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2025-10-24T12:44:10,122 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2025-10-24T12:44:10,125 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2025-10-24T12:44:10,127 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2025-10-24T12:44:10,129 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2025-10-24T12:44:10,132 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2025-10-24T12:44:10,133 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2025-10-24T12:44:10,139 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2025-10-24T12:44:10,141 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2025-10-24T12:44:10,143 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2025-10-24T12:44:10,145 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2025-10-24T12:44:10,148 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2025-10-24T12:44:10,151 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2025-10-24T12:44:10,153 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2025-10-24T12:44:10,154 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2025-10-24T12:44:10,156 adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp' 2025-10-24T12:44:10,157 adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp' 2025-10-24T12:44:10,159 adding 'deepspeed/ops/csrc/utils/tensor_cast.h' 2025-10-24T12:44:10,161 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2025-10-24T12:44:10,163 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2025-10-24T12:44:10,165 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2025-10-24T12:44:10,166 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2025-10-24T12:44:10,169 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2025-10-24T12:44:10,170 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2025-10-24T12:44:10,171 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2025-10-24T12:44:10,173 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2025-10-24T12:44:10,174 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2025-10-24T12:44:10,176 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2025-10-24T12:44:10,178 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2025-10-24T12:44:10,179 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2025-10-24T12:44:10,181 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2025-10-24T12:44:10,182 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2025-10-24T12:44:10,183 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2025-10-24T12:44:10,185 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2025-10-24T12:44:10,186 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2025-10-24T12:44:10,188 adding 'deepspeed/ops/gds/__init__.py' 2025-10-24T12:44:10,190 adding 'deepspeed/ops/lamb/__init__.py' 2025-10-24T12:44:10,192 adding 'deepspeed/ops/lamb/fused_lamb.py' 2025-10-24T12:44:10,193 adding 'deepspeed/ops/lion/__init__.py' 2025-10-24T12:44:10,195 adding 'deepspeed/ops/lion/cpu_lion.py' 2025-10-24T12:44:10,196 adding 'deepspeed/ops/lion/fused_lion.py' 2025-10-24T12:44:10,197 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2025-10-24T12:44:10,200 adding 'deepspeed/ops/op_builder/__init__.py' 2025-10-24T12:44:10,201 adding 'deepspeed/ops/op_builder/all_ops.py' 2025-10-24T12:44:10,202 adding 'deepspeed/ops/op_builder/async_io.py' 2025-10-24T12:44:10,206 adding 'deepspeed/ops/op_builder/builder.py' 2025-10-24T12:44:10,208 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2025-10-24T12:44:10,209 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2025-10-24T12:44:10,210 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2025-10-24T12:44:10,211 adding 'deepspeed/ops/op_builder/dc.py' 2025-10-24T12:44:10,213 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2025-10-24T12:44:10,214 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2025-10-24T12:44:10,215 adding 'deepspeed/ops/op_builder/fused_adam.py' 2025-10-24T12:44:10,217 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2025-10-24T12:44:10,218 adding 'deepspeed/ops/op_builder/fused_lion.py' 2025-10-24T12:44:10,219 adding 'deepspeed/ops/op_builder/gds.py' 2025-10-24T12:44:10,220 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2025-10-24T12:44:10,222 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2025-10-24T12:44:10,223 adding 'deepspeed/ops/op_builder/quantizer.py' 2025-10-24T12:44:10,224 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2025-10-24T12:44:10,226 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2025-10-24T12:44:10,227 adding 'deepspeed/ops/op_builder/random_ltd.py' 2025-10-24T12:44:10,228 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2025-10-24T12:44:10,230 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2025-10-24T12:44:10,231 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2025-10-24T12:44:10,232 adding 'deepspeed/ops/op_builder/transformer.py' 2025-10-24T12:44:10,233 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2025-10-24T12:44:10,235 adding 'deepspeed/ops/op_builder/utils.py' 2025-10-24T12:44:10,237 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2025-10-24T12:44:10,238 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2025-10-24T12:44:10,239 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2025-10-24T12:44:10,241 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2025-10-24T12:44:10,242 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2025-10-24T12:44:10,243 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2025-10-24T12:44:10,244 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2025-10-24T12:44:10,246 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2025-10-24T12:44:10,248 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2025-10-24T12:44:10,249 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2025-10-24T12:44:10,250 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2025-10-24T12:44:10,252 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2025-10-24T12:44:10,253 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2025-10-24T12:44:10,254 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2025-10-24T12:44:10,256 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2025-10-24T12:44:10,257 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2025-10-24T12:44:10,258 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2025-10-24T12:44:10,259 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2025-10-24T12:44:10,260 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2025-10-24T12:44:10,262 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2025-10-24T12:44:10,263 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2025-10-24T12:44:10,265 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2025-10-24T12:44:10,266 adding 'deepspeed/ops/op_builder/npu/builder.py' 2025-10-24T12:44:10,267 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2025-10-24T12:44:10,269 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2025-10-24T12:44:10,270 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2025-10-24T12:44:10,271 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2025-10-24T12:44:10,273 adding 'deepspeed/ops/op_builder/npu/inference.py' 2025-10-24T12:44:10,274 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2025-10-24T12:44:10,276 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2025-10-24T12:44:10,278 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2025-10-24T12:44:10,279 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2025-10-24T12:44:10,280 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2025-10-24T12:44:10,282 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2025-10-24T12:44:10,285 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2025-10-24T12:44:10,287 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2025-10-24T12:44:10,288 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2025-10-24T12:44:10,290 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2025-10-24T12:44:10,291 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2025-10-24T12:44:10,292 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2025-10-24T12:44:10,293 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2025-10-24T12:44:10,295 adding 'deepspeed/ops/op_builder/xpu/inference.py' 2025-10-24T12:44:10,296 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2025-10-24T12:44:10,298 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2025-10-24T12:44:10,299 adding 'deepspeed/ops/quantizer/__init__.py' 2025-10-24T12:44:10,301 adding 'deepspeed/ops/quantizer/quantizer.py' 2025-10-24T12:44:10,303 adding 'deepspeed/ops/random_ltd/__init__.py' 2025-10-24T12:44:10,304 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2025-10-24T12:44:10,306 adding 'deepspeed/ops/sparse_attention/__init__.py' 2025-10-24T12:44:10,307 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2025-10-24T12:44:10,311 adding 'deepspeed/ops/sparse_attention/matmul.py' 2025-10-24T12:44:10,313 adding 'deepspeed/ops/sparse_attention/softmax.py' 2025-10-24T12:44:10,315 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2025-10-24T12:44:10,317 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2025-10-24T12:44:10,320 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2025-10-24T12:44:10,322 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2025-10-24T12:44:10,324 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2025-10-24T12:44:10,326 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2025-10-24T12:44:10,327 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2025-10-24T12:44:10,329 adding 'deepspeed/ops/transformer/__init__.py' 2025-10-24T12:44:10,332 adding 'deepspeed/ops/transformer/transformer.py' 2025-10-24T12:44:10,333 adding 'deepspeed/ops/transformer/inference/__init__.py' 2025-10-24T12:44:10,334 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2025-10-24T12:44:10,336 adding 'deepspeed/ops/transformer/inference/config.py' 2025-10-24T12:44:10,337 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2025-10-24T12:44:10,339 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2025-10-24T12:44:10,340 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2025-10-24T12:44:10,342 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2025-10-24T12:44:10,343 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2025-10-24T12:44:10,345 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2025-10-24T12:44:10,347 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2025-10-24T12:44:10,349 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2025-10-24T12:44:10,350 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2025-10-24T12:44:10,351 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2025-10-24T12:44:10,353 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2025-10-24T12:44:10,354 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2025-10-24T12:44:10,355 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2025-10-24T12:44:10,356 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2025-10-24T12:44:10,357 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2025-10-24T12:44:10,358 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2025-10-24T12:44:10,360 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2025-10-24T12:44:10,361 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2025-10-24T12:44:10,363 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2025-10-24T12:44:10,364 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2025-10-24T12:44:10,365 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2025-10-24T12:44:10,366 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2025-10-24T12:44:10,368 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2025-10-24T12:44:10,369 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2025-10-24T12:44:10,370 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2025-10-24T12:44:10,372 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2025-10-24T12:44:10,374 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2025-10-24T12:44:10,375 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2025-10-24T12:44:10,376 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2025-10-24T12:44:10,378 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2025-10-24T12:44:10,380 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2025-10-24T12:44:10,382 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2025-10-24T12:44:10,383 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2025-10-24T12:44:10,385 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2025-10-24T12:44:10,387 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2025-10-24T12:44:10,389 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2025-10-24T12:44:10,390 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2025-10-24T12:44:10,392 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2025-10-24T12:44:10,393 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2025-10-24T12:44:10,395 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2025-10-24T12:44:10,397 adding 'deepspeed/pipe/__init__.py' 2025-10-24T12:44:10,398 adding 'deepspeed/profiling/__init__.py' 2025-10-24T12:44:10,400 adding 'deepspeed/profiling/config.py' 2025-10-24T12:44:10,401 adding 'deepspeed/profiling/constants.py' 2025-10-24T12:44:10,402 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2025-10-24T12:44:10,408 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2025-10-24T12:44:10,410 adding 'deepspeed/runtime/__init__.py' 2025-10-24T12:44:10,411 adding 'deepspeed/runtime/base_optimizer.py' 2025-10-24T12:44:10,414 adding 'deepspeed/runtime/bf16_optimizer.py' 2025-10-24T12:44:10,416 adding 'deepspeed/runtime/compiler.py' 2025-10-24T12:44:10,420 adding 'deepspeed/runtime/config.py' 2025-10-24T12:44:10,422 adding 'deepspeed/runtime/config_utils.py' 2025-10-24T12:44:10,424 adding 'deepspeed/runtime/constants.py' 2025-10-24T12:44:10,425 adding 'deepspeed/runtime/dataloader.py' 2025-10-24T12:44:10,427 adding 'deepspeed/runtime/eigenvalue.py' 2025-10-24T12:44:10,448 adding 'deepspeed/runtime/engine.py' 2025-10-24T12:44:10,452 adding 'deepspeed/runtime/hybrid_engine.py' 2025-10-24T12:44:10,456 adding 'deepspeed/runtime/lr_schedules.py' 2025-10-24T12:44:10,457 adding 'deepspeed/runtime/precision_config.py' 2025-10-24T12:44:10,459 adding 'deepspeed/runtime/progressive_layer_drop.py' 2025-10-24T12:44:10,460 adding 'deepspeed/runtime/quantize.py' 2025-10-24T12:44:10,462 adding 'deepspeed/runtime/sparse_tensor.py' 2025-10-24T12:44:10,464 adding 'deepspeed/runtime/state_dict_factory.py' 2025-10-24T12:44:10,465 adding 'deepspeed/runtime/torch_autocast.py' 2025-10-24T12:44:10,471 adding 'deepspeed/runtime/utils.py' 2025-10-24T12:44:10,473 adding 'deepspeed/runtime/weight_quantizer.py' 2025-10-24T12:44:10,474 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2025-10-24T12:44:10,479 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2025-10-24T12:44:10,481 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2025-10-24T12:44:10,483 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2025-10-24T12:44:10,484 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2025-10-24T12:44:10,485 adding 'deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py' 2025-10-24T12:44:10,487 adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py' 2025-10-24T12:44:10,488 adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py' 2025-10-24T12:44:10,490 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2025-10-24T12:44:10,491 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2025-10-24T12:44:10,492 adding 'deepspeed/runtime/checkpoint_engine/utils.py' 2025-10-24T12:44:10,494 adding 'deepspeed/runtime/comm/__init__.py' 2025-10-24T12:44:10,496 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2025-10-24T12:44:10,498 adding 'deepspeed/runtime/comm/compressed.py' 2025-10-24T12:44:10,499 adding 'deepspeed/runtime/comm/hccl.py' 2025-10-24T12:44:10,501 adding 'deepspeed/runtime/comm/mpi.py' 2025-10-24T12:44:10,503 adding 'deepspeed/runtime/comm/nccl.py' 2025-10-24T12:44:10,504 adding 'deepspeed/runtime/compression/__init__.py' 2025-10-24T12:44:10,505 adding 'deepspeed/runtime/compression/cupy.py' 2025-10-24T12:44:10,507 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2025-10-24T12:44:10,509 adding 'deepspeed/runtime/data_pipeline/config.py' 2025-10-24T12:44:10,510 adding 'deepspeed/runtime/data_pipeline/constants.py' 2025-10-24T12:44:10,512 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2025-10-24T12:44:10,514 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2025-10-24T12:44:10,515 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2025-10-24T12:44:10,517 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2025-10-24T12:44:10,518 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2025-10-24T12:44:10,520 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2025-10-24T12:44:10,521 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2025-10-24T12:44:10,527 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2025-10-24T12:44:10,529 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2025-10-24T12:44:10,532 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2025-10-24T12:44:10,534 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2025-10-24T12:44:10,537 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2025-10-24T12:44:10,539 adding 'deepspeed/runtime/domino/__init__.py' 2025-10-24T12:44:10,540 adding 'deepspeed/runtime/domino/async_linear.py' 2025-10-24T12:44:10,543 adding 'deepspeed/runtime/domino/transformer.py' 2025-10-24T12:44:10,544 adding 'deepspeed/runtime/fp16/__init__.py' 2025-10-24T12:44:10,547 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2025-10-24T12:44:10,550 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2025-10-24T12:44:10,552 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2025-10-24T12:44:10,554 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2025-10-24T12:44:10,556 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2025-10-24T12:44:10,559 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2025-10-24T12:44:10,562 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2025-10-24T12:44:10,563 adding 'deepspeed/runtime/model_checkpointing/__init__.py' 2025-10-24T12:44:10,564 adding 'deepspeed/runtime/model_checkpointing/config.py' 2025-10-24T12:44:10,566 adding 'deepspeed/runtime/model_checkpointing/constants.py' 2025-10-24T12:44:10,568 adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py' 2025-10-24T12:44:10,569 adding 'deepspeed/runtime/model_checkpointing/utils.py' 2025-10-24T12:44:10,570 adding 'deepspeed/runtime/model_checkpointing/writer_factory.py' 2025-10-24T12:44:10,572 adding 'deepspeed/runtime/pipe/__init__.py' 2025-10-24T12:44:10,579 adding 'deepspeed/runtime/pipe/engine.py' 2025-10-24T12:44:10,583 adding 'deepspeed/runtime/pipe/module.py' 2025-10-24T12:44:10,585 adding 'deepspeed/runtime/pipe/p2p.py' 2025-10-24T12:44:10,587 adding 'deepspeed/runtime/pipe/schedule.py' 2025-10-24T12:44:10,589 adding 'deepspeed/runtime/pipe/topology.py' 2025-10-24T12:44:10,591 adding 'deepspeed/runtime/sequence_parallel/__init__.py' 2025-10-24T12:44:10,593 adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py' 2025-10-24T12:44:10,600 adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py' 2025-10-24T12:44:10,602 adding 'deepspeed/runtime/superoffload/__init__.py' 2025-10-24T12:44:10,605 adding 'deepspeed/runtime/superoffload/superoffload_stage3.py' 2025-10-24T12:44:10,607 adding 'deepspeed/runtime/superoffload/superoffload_utils.py' 2025-10-24T12:44:10,609 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2025-10-24T12:44:10,610 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2025-10-24T12:44:10,611 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2025-10-24T12:44:10,613 adding 'deepspeed/runtime/swap_tensor/constants.py' 2025-10-24T12:44:10,616 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2025-10-24T12:44:10,617 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2025-10-24T12:44:10,620 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2025-10-24T12:44:10,622 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2025-10-24T12:44:10,624 adding 'deepspeed/runtime/swap_tensor/utils.py' 2025-10-24T12:44:10,625 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2025-10-24T12:44:10,627 adding 'deepspeed/runtime/tensor_parallel/config.py' 2025-10-24T12:44:10,628 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2025-10-24T12:44:10,630 adding 'deepspeed/runtime/zenflow/__init__.py' 2025-10-24T12:44:10,632 adding 'deepspeed/runtime/zenflow/engine.py' 2025-10-24T12:44:10,635 adding 'deepspeed/runtime/zenflow/engine_stage3.py' 2025-10-24T12:44:10,637 adding 'deepspeed/runtime/zenflow/zenflow_config.py' 2025-10-24T12:44:10,640 adding 'deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py' 2025-10-24T12:44:10,642 adding 'deepspeed/runtime/zenflow/zenflow_utils.py' 2025-10-24T12:44:10,644 adding 'deepspeed/runtime/zero/__init__.py' 2025-10-24T12:44:10,646 adding 'deepspeed/runtime/zero/config.py' 2025-10-24T12:44:10,648 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2025-10-24T12:44:10,649 adding 'deepspeed/runtime/zero/leaf_module_config.py' 2025-10-24T12:44:10,651 adding 'deepspeed/runtime/zero/linear.py' 2025-10-24T12:44:10,653 adding 'deepspeed/runtime/zero/mics.py' 2025-10-24T12:44:10,655 adding 'deepspeed/runtime/zero/mics_utils.py' 2025-10-24T12:44:10,657 adding 'deepspeed/runtime/zero/offload_config.py' 2025-10-24T12:44:10,658 adding 'deepspeed/runtime/zero/offload_states.py' 2025-10-24T12:44:10,661 adding 'deepspeed/runtime/zero/parameter_offload.py' 2025-10-24T12:44:10,673 adding 'deepspeed/runtime/zero/partition_parameters.py' 2025-10-24T12:44:10,677 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2025-10-24T12:44:10,679 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2025-10-24T12:44:10,695 adding 'deepspeed/runtime/zero/stage3.py' 2025-10-24T12:44:10,712 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2025-10-24T12:44:10,714 adding 'deepspeed/runtime/zero/test.py' 2025-10-24T12:44:10,715 adding 'deepspeed/runtime/zero/tiling.py' 2025-10-24T12:44:10,717 adding 'deepspeed/runtime/zero/utils.py' 2025-10-24T12:44:10,719 adding 'deepspeed/runtime/zero/muon/__init__.py' 2025-10-24T12:44:10,721 adding 'deepspeed/runtime/zero/muon/muon_optimizer.py' 2025-10-24T12:44:10,723 adding 'deepspeed/runtime/zero/muon/original_muon.py' 2025-10-24T12:44:10,724 adding 'deepspeed/sequence/__init__.py' 2025-10-24T12:44:10,726 adding 'deepspeed/sequence/cross_entropy.py' 2025-10-24T12:44:10,730 adding 'deepspeed/sequence/fpdt_layer.py' 2025-10-24T12:44:10,733 adding 'deepspeed/sequence/layer.py' 2025-10-24T12:44:10,735 adding 'deepspeed/utils/__init__.py' 2025-10-24T12:44:10,736 adding 'deepspeed/utils/bwc.py' 2025-10-24T12:44:10,738 adding 'deepspeed/utils/comms_logging.py' 2025-10-24T12:44:10,740 adding 'deepspeed/utils/config.py' 2025-10-24T12:44:10,741 adding 'deepspeed/utils/debug.py' 2025-10-24T12:44:10,742 adding 'deepspeed/utils/exceptions.py' 2025-10-24T12:44:10,746 adding 'deepspeed/utils/groups.py' 2025-10-24T12:44:10,747 adding 'deepspeed/utils/init_on_device.py' 2025-10-24T12:44:10,749 adding 'deepspeed/utils/logging.py' 2025-10-24T12:44:10,750 adding 'deepspeed/utils/mixed_precision_linkage.py' 2025-10-24T12:44:10,752 adding 'deepspeed/utils/numa.py' 2025-10-24T12:44:10,753 adding 'deepspeed/utils/nvtx.py' 2025-10-24T12:44:10,755 adding 'deepspeed/utils/tensor_fragment.py' 2025-10-24T12:44:10,757 adding 'deepspeed/utils/timer.py' 2025-10-24T12:44:10,758 adding 'deepspeed/utils/torch.py' 2025-10-24T12:44:10,760 adding 'deepspeed/utils/types.py' 2025-10-24T12:44:10,761 adding 'deepspeed/utils/z3_leaf_module.py' 2025-10-24T12:44:10,765 adding 'deepspeed/utils/zero_to_fp32.py' 2025-10-24T12:44:10,768 adding 'deepspeed-0.18.1.data/scripts/deepspeed' 2025-10-24T12:44:10,769 adding 'deepspeed-0.18.1.data/scripts/deepspeed.pt' 2025-10-24T12:44:10,770 adding 'deepspeed-0.18.1.data/scripts/ds' 2025-10-24T12:44:10,771 adding 'deepspeed-0.18.1.data/scripts/ds_bench' 2025-10-24T12:44:10,772 adding 'deepspeed-0.18.1.data/scripts/ds_elastic' 2025-10-24T12:44:10,774 adding 'deepspeed-0.18.1.data/scripts/ds_io' 2025-10-24T12:44:10,775 adding 'deepspeed-0.18.1.data/scripts/ds_nvme_tune' 2025-10-24T12:44:10,776 adding 'deepspeed-0.18.1.data/scripts/ds_report' 2025-10-24T12:44:10,777 adding 'deepspeed-0.18.1.data/scripts/ds_ssh' 2025-10-24T12:44:10,778 adding 'deepspeed-0.18.1.data/scripts/dsr' 2025-10-24T12:44:10,782 adding 'deepspeed-0.18.1.dist-info/licenses/LICENSE' 2025-10-24T12:44:10,787 adding 'deepspeed-0.18.1.dist-info/METADATA' 2025-10-24T12:44:10,788 adding 'deepspeed-0.18.1.dist-info/WHEEL' 2025-10-24T12:44:10,789 adding 'deepspeed-0.18.1.dist-info/entry_points.txt' 2025-10-24T12:44:10,790 adding 'deepspeed-0.18.1.dist-info/top_level.txt' 2025-10-24T12:44:10,807 adding 'deepspeed-0.18.1.dist-info/RECORD' 2025-10-24T12:44:10,838 removing build/bdist.linux-armv7l/wheel 2025-10-24T12:44:11,114 deepspeed build time = 13.445891618728638 secs 2025-10-24T12:44:11,240 Building wheel for deepspeed (setup.py): finished with status 'done' 2025-10-24T12:44:11,260 Created wheel for deepspeed: filename=deepspeed-0.18.1-py3-none-any.whl size=1764180 sha256=5b86199df0324c59913dc827c8771d0942a2b1804f8c9d92e08358308adb31f7 2025-10-24T12:44:11,262 Stored in directory: /tmp/pip-ephem-wheel-cache-g4b8nbj1/wheels/28/28/3e/16d1e4f8b96d87988e2cf5787f2ed0a819ea4a4c8a0e3f2871 2025-10-24T12:44:11,308 Successfully built deepspeed 2025-10-24T12:44:11,363 Removed build tracker: '/tmp/pip-build-tracker-2kgrtazu'