2026-03-13T21:21:31,259 Created temporary directory: /tmp/pip-ephem-wheel-cache-vc6cnxgn 2026-03-13T21:21:31,261 Created temporary directory: /tmp/pip-build-tracker-_pzamlnb 2026-03-13T21:21:31,262 Initialized build tracking at /tmp/pip-build-tracker-_pzamlnb 2026-03-13T21:21:31,262 Created build tracker: /tmp/pip-build-tracker-_pzamlnb 2026-03-13T21:21:31,263 Entered build tracker: /tmp/pip-build-tracker-_pzamlnb 2026-03-13T21:21:31,264 Created temporary directory: /tmp/pip-wheel-48_jrya3 2026-03-13T21:21:31,266 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-03-13T21:21:31,269 Created temporary directory: /tmp/pip-ephem-wheel-cache-rikeiq1k 2026-03-13T21:21:31,294 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-03-13T21:21:31,298 2 location(s) to search for versions of deepspeed: 2026-03-13T21:21:31,298 * https://pypi.org/simple/deepspeed/ 2026-03-13T21:21:31,298 * https://www.piwheels.org/simple/deepspeed/ 2026-03-13T21:21:31,299 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2026-03-13T21:21:31,300 Getting page https://pypi.org/simple/deepspeed/ 2026-03-13T21:21:31,301 Found index url https://pypi.org/simple 2026-03-13T21:21:31,473 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2026-03-13T21:21:31,498 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,498 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2026-03-13T21:21:31,499 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,500 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2026-03-13T21:21:31,501 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,501 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2026-03-13T21:21:31,502 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,503 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2026-03-13T21:21:31,504 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,504 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2026-03-13T21:21:31,505 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2026-03-13T21:21:31,506 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2026-03-13T21:21:31,507 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2026-03-13T21:21:31,507 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2026-03-13T21:21:31,508 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2026-03-13T21:21:31,508 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2026-03-13T21:21:31,509 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2026-03-13T21:21:31,510 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2026-03-13T21:21:31,510 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2026-03-13T21:21:31,511 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2026-03-13T21:21:31,512 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2026-03-13T21:21:31,512 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2026-03-13T21:21:31,513 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2026-03-13T21:21:31,514 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2026-03-13T21:21:31,515 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2026-03-13T21:21:31,515 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2026-03-13T21:21:31,516 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2026-03-13T21:21:31,517 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2026-03-13T21:21:31,518 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2026-03-13T21:21:31,519 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2026-03-13T21:21:31,519 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2026-03-13T21:21:31,520 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2026-03-13T21:21:31,520 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2026-03-13T21:21:31,521 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2026-03-13T21:21:31,521 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2026-03-13T21:21:31,522 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2026-03-13T21:21:31,523 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2026-03-13T21:21:31,523 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2026-03-13T21:21:31,524 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2026-03-13T21:21:31,525 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2026-03-13T21:21:31,526 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2026-03-13T21:21:31,526 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2026-03-13T21:21:31,527 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2026-03-13T21:21:31,528 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2026-03-13T21:21:31,528 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2026-03-13T21:21:31,529 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2026-03-13T21:21:31,530 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2026-03-13T21:21:31,531 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2026-03-13T21:21:31,531 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2026-03-13T21:21:31,532 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2026-03-13T21:21:31,533 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2026-03-13T21:21:31,533 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2026-03-13T21:21:31,534 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2026-03-13T21:21:31,535 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2026-03-13T21:21:31,535 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2026-03-13T21:21:31,536 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2026-03-13T21:21:31,536 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2026-03-13T21:21:31,537 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2026-03-13T21:21:31,538 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2026-03-13T21:21:31,539 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2026-03-13T21:21:31,539 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2026-03-13T21:21:31,540 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2026-03-13T21:21:31,541 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2026-03-13T21:21:31,541 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2026-03-13T21:21:31,542 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2026-03-13T21:21:31,543 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2026-03-13T21:21:31,544 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2026-03-13T21:21:31,545 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2026-03-13T21:21:31,545 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2026-03-13T21:21:31,546 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2026-03-13T21:21:31,546 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2026-03-13T21:21:31,547 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2026-03-13T21:21:31,548 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2026-03-13T21:21:31,548 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2026-03-13T21:21:31,549 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2026-03-13T21:21:31,550 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2026-03-13T21:21:31,550 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2026-03-13T21:21:31,551 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2026-03-13T21:21:31,552 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2026-03-13T21:21:31,552 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2026-03-13T21:21:31,553 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2026-03-13T21:21:31,554 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2026-03-13T21:21:31,554 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2026-03-13T21:21:31,555 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2026-03-13T21:21:31,556 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2026-03-13T21:21:31,557 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2026-03-13T21:21:31,557 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2026-03-13T21:21:31,558 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2026-03-13T21:21:31,558 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2026-03-13T21:21:31,559 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2026-03-13T21:21:31,560 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2026-03-13T21:21:31,560 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2026-03-13T21:21:31,561 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2026-03-13T21:21:31,562 Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2 2026-03-13T21:21:31,562 Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3 2026-03-13T21:21:31,563 Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4 2026-03-13T21:21:31,564 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,564 Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5 2026-03-13T21:21:31,565 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,566 Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0 2026-03-13T21:21:31,566 Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1 2026-03-13T21:21:31,567 Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2 2026-03-13T21:21:31,568 Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3 2026-03-13T21:21:31,568 Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4 2026-03-13T21:21:31,569 Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0 2026-03-13T21:21:31,570 Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1 2026-03-13T21:21:31,570 Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2 2026-03-13T21:21:31,571 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,571 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,572 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,572 Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3 2026-03-13T21:21:31,573 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,574 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,574 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,575 Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4 2026-03-13T21:21:31,576 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,576 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,577 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/) 2026-03-13T21:21:31,578 Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5 2026-03-13T21:21:31,578 Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6 2026-03-13T21:21:31,579 Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7 2026-03-13T21:21:31,579 Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8 2026-03-13T21:21:31,580 Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9 2026-03-13T21:21:31,581 Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0 2026-03-13T21:21:31,581 Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1 2026-03-13T21:21:31,582 Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2 2026-03-13T21:21:31,582 Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3 2026-03-13T21:21:31,583 Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4 2026-03-13T21:21:31,584 Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5 2026-03-13T21:21:31,585 Found link https://files.pythonhosted.org/packages/d4/a9/6130c78d84980ed636092be1a262d6429d539105724e675b6f65ef74a05e/deepspeed-0.17.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.6 2026-03-13T21:21:31,586 Found link https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.0 2026-03-13T21:21:31,586 Found link https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.1 2026-03-13T21:21:31,587 Found link https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.2 2026-03-13T21:21:31,588 Found link https://files.pythonhosted.org/packages/1b/88/989a2346b7fd618695ad468f4e29a98656a053143fae5587c2924ddb34f8/deepspeed-0.18.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.3 2026-03-13T21:21:31,588 Found link https://files.pythonhosted.org/packages/1d/06/b07729962ab914bd72c320fa54bea1c6d8e74cc652b05e3770eec05cd469/deepspeed-0.18.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.4 2026-03-13T21:21:31,589 Found link https://files.pythonhosted.org/packages/ca/0a/97f1896665690fb6199342284a6afb96cdfe10603f5edf83d1386ecfd081/deepspeed-0.18.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.5 2026-03-13T21:21:31,590 Found link https://files.pythonhosted.org/packages/fc/45/861baf605f6388c81109b1228ea211da62fb59b7a5b2606f90bd98f4b99e/deepspeed-0.18.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.6 2026-03-13T21:21:31,591 Found link https://files.pythonhosted.org/packages/30/00/ad310cf94e0e397c416087e6c4dc782429292206b2b1a3ffbd388ac95a67/deepspeed-0.18.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.7 2026-03-13T21:21:31,591 Found link https://files.pythonhosted.org/packages/19/11/46b9eb3806ca7a5e9bdddb7e873855a2d59a9f87f0675ae8231678d98434/deepspeed-0.18.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.8 2026-03-13T21:21:31,592 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2026-03-13T21:21:31,593 Getting page https://www.piwheels.org/simple/deepspeed/ 2026-03-13T21:21:31,594 Found index url https://www.piwheels.org/simple 2026-03-13T21:21:31,749 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2026-03-13T21:21:31,774 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.7-py3-none-any.whl#sha256=e8fe68f4be025ab2af17d9046daaee6b9f98b4ddf9390ad91a3487069e0a4df7 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,774 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.6-py3-none-any.whl#sha256=8bab8d6e72582f7f2b2ffed41b2b17ecef4f48753dc5eec289aa3e431f57e9cf (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,775 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.5-py3-none-any.whl#sha256=8438d14528feaab46ad81e3bd4bd58fdfa76d5f173d0ab1caae6b432b86bd2f3 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,776 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.4-py3-none-any.whl#sha256=b19c1be796079c1ffd173425030e11139d10b6bd020b4f0d441ac41788578a99 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,776 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.3-py3-none-any.whl#sha256=1617db36397c415e4c08da013fe2c749dc8d48022760dd469ebaf8af8b41f7d0 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,777 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.2-py3-none-any.whl#sha256=5dba331b1bed4f81b2efcdebf44168cc0b4bd0aa818c07b73c6299918439c570 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,777 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.1-py3-none-any.whl#sha256=5b86199df0324c59913dc827c8771d0942a2b1804f8c9d92e08358308adb31f7 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,778 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.0-py3-none-any.whl#sha256=3806dbea5c2f5799704a24d865cc115c4144608ad04994b8096a3cfd085e52d3 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,779 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.6-py3-none-any.whl#sha256=6142b8dbad6e01ce0890830a65ca1c102f2bf8216edcca0ba86b7c81febd2754 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,779 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.5-py3-none-any.whl#sha256=2fcd7e824802bae8190b39577b346f58a20cba5bd72a63f4fd6a8d9b7ef8e498 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,780 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.4-py3-none-any.whl#sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,781 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,781 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,782 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,782 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,783 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,783 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,784 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,785 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,785 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,786 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,787 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,787 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,788 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,788 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,789 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,790 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,790 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,791 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,791 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,792 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,792 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,793 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,793 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,794 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,795 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,795 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,796 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,796 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,797 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,798 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,799 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,799 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,799 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,800 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,800 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,801 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,801 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,802 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,802 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,803 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,804 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,804 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,805 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,805 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,806 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,807 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,807 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,808 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,808 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,809 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,809 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,810 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,811 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,811 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,812 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,812 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,813 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,814 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,815 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,815 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,816 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,816 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,816 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,817 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,817 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,818 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,819 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,819 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,820 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,820 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,821 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,822 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,822 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,823 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,824 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,824 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,824 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,825 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,825 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,826 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,826 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,827 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,828 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,828 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,829 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,829 Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2026-03-13T21:21:31,830 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2026-03-13T21:21:31,831 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2026-03-13T21:21:31,864 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2026-03-13T21:21:31,883 Collecting deepspeed==0.18.8 2026-03-13T21:21:31,885 Created temporary directory: /tmp/pip-unpack-kzyfqn7v 2026-03-13T21:21:32,018 Downloading deepspeed-0.18.8.tar.gz (1.6 MB) 2026-03-13T21:21:35,054 Added deepspeed==0.18.8 from https://files.pythonhosted.org/packages/19/11/46b9eb3806ca7a5e9bdddb7e873855a2d59a9f87f0675ae8231678d98434/deepspeed-0.18.8.tar.gz to build tracker '/tmp/pip-build-tracker-_pzamlnb' 2026-03-13T21:21:35,056 Running setup.py (path:/tmp/pip-wheel-48_jrya3/deepspeed_6dcdeb4894ef4a8ebdd8c46437aa8666/setup.py) egg_info for package deepspeed 2026-03-13T21:21:35,057 Created temporary directory: /tmp/pip-pip-egg-info-_u50kiq2 2026-03-13T21:21:35,057 Preparing metadata (setup.py): started 2026-03-13T21:21:35,059 Running command python setup.py egg_info 2026-03-13T21:21:36,139 fatal: not a git repository (or any of the parent directories): .git 2026-03-13T21:21:36,604 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2026-03-13T21:21:36,605  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2026-03-13T21:21:36,605 DS_BUILD_OPS=0 2026-03-13T21:21:36,606 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2026-03-13T21:21:36,606 version=0.18.8, git_hash=unknown, git_branch=unknown 2026-03-13T21:21:36,607 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2026-03-13T21:21:36,608 ext_modules=[] 2026-03-13T21:21:36,608 running egg_info 2026-03-13T21:21:36,632 creating /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info 2026-03-13T21:21:36,633 writing /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/PKG-INFO 2026-03-13T21:21:36,658 writing dependency_links to /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/dependency_links.txt 2026-03-13T21:21:36,659 writing entry points to /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/entry_points.txt 2026-03-13T21:21:36,673 writing requirements to /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/requires.txt 2026-03-13T21:21:36,674 writing top-level names to /tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/top_level.txt 2026-03-13T21:21:36,675 writing manifest file '/tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/SOURCES.txt' 2026-03-13T21:21:36,931 reading manifest file '/tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/SOURCES.txt' 2026-03-13T21:21:36,933 reading manifest template 'MANIFEST.in' 2026-03-13T21:21:36,935 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2026-03-13T21:21:36,935 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2026-03-13T21:21:38,841 warning: no files found matching '*.hip' under directory 'deepspeed' 2026-03-13T21:21:39,957 warning: no files found matching '*.cc' under directory 'deepspeed' 2026-03-13T21:21:40,664 warning: no files found matching '*.tr' under directory 'csrc' 2026-03-13T21:21:41,028 warning: no files found matching '*.cc' under directory 'csrc' 2026-03-13T21:21:41,304 warning: no files found matching '*.py' under directory 'benchmarks' 2026-03-13T21:21:41,314 adding license file 'LICENSE' 2026-03-13T21:21:41,358 writing manifest file '/tmp/pip-pip-egg-info-_u50kiq2/deepspeed.egg-info/SOURCES.txt' 2026-03-13T21:21:41,361 deepspeed build time = 5.218937158584595 secs 2026-03-13T21:21:41,509 Preparing metadata (setup.py): finished with status 'done' 2026-03-13T21:21:41,515 Source in /tmp/pip-wheel-48_jrya3/deepspeed_6dcdeb4894ef4a8ebdd8c46437aa8666 has version 0.18.8, which satisfies requirement deepspeed==0.18.8 from https://files.pythonhosted.org/packages/19/11/46b9eb3806ca7a5e9bdddb7e873855a2d59a9f87f0675ae8231678d98434/deepspeed-0.18.8.tar.gz 2026-03-13T21:21:41,516 Removed deepspeed==0.18.8 from https://files.pythonhosted.org/packages/19/11/46b9eb3806ca7a5e9bdddb7e873855a2d59a9f87f0675ae8231678d98434/deepspeed-0.18.8.tar.gz from build tracker '/tmp/pip-build-tracker-_pzamlnb' 2026-03-13T21:21:41,525 Created temporary directory: /tmp/pip-unpack-b9tcz635 2026-03-13T21:21:41,526 Building wheels for collected packages: deepspeed 2026-03-13T21:21:41,530 Created temporary directory: /tmp/pip-wheel-7j0432_x 2026-03-13T21:21:41,531 Building wheel for deepspeed (setup.py): started 2026-03-13T21:21:41,532 Destination directory: /tmp/pip-wheel-7j0432_x 2026-03-13T21:21:41,532 Running command python setup.py bdist_wheel 2026-03-13T21:21:42,027 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2026-03-13T21:21:42,030  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2026-03-13T21:21:42,159 DS_BUILD_OPS=0 2026-03-13T21:21:42,273 Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False} 2026-03-13T21:21:42,292 fatal: not a git repository (or any of the parent directories): .git 2026-03-13T21:21:42,294 version=0.18.8, git_hash=unknown, git_branch=unknown 2026-03-13T21:21:42,294 install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm'] 2026-03-13T21:21:42,295 ext_modules=[] 2026-03-13T21:21:42,692 running bdist_wheel 2026-03-13T21:21:42,823 running build 2026-03-13T21:21:42,823 running build_py 2026-03-13T21:21:42,853 creating build/lib/deepspeed 2026-03-13T21:21:42,855 copying deepspeed/env_report.py -> build/lib/deepspeed 2026-03-13T21:21:42,858 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2026-03-13T21:21:42,860 copying deepspeed/__init__.py -> build/lib/deepspeed 2026-03-13T21:21:42,863 copying deepspeed/compat.py -> build/lib/deepspeed 2026-03-13T21:21:42,865 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2026-03-13T21:21:42,866 copying deepspeed/constants.py -> build/lib/deepspeed 2026-03-13T21:21:42,869 creating build/lib/deepspeed/nvme 2026-03-13T21:21:42,870 copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,872 copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,874 copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,877 copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,878 copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,880 copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,882 copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,884 copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,886 copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,888 copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,891 copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,893 copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,895 copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,896 copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,899 copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,901 copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme 2026-03-13T21:21:42,904 creating build/lib/deepspeed/runtime 2026-03-13T21:21:42,905 copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,907 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,909 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,912 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,914 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,917 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,919 copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,921 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,924 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,926 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,928 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,930 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,932 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,934 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,936 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,939 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,942 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,944 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,947 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,949 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2026-03-13T21:21:42,956 creating build/lib/deepspeed/model_implementations 2026-03-13T21:21:42,957 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2026-03-13T21:21:42,959 creating build/lib/deepspeed/nebula 2026-03-13T21:21:42,960 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2026-03-13T21:21:42,962 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2026-03-13T21:21:42,963 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2026-03-13T21:21:42,966 creating build/lib/deepspeed/compression 2026-03-13T21:21:42,967 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,970 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,972 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,976 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,978 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,980 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,982 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,985 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2026-03-13T21:21:42,987 creating build/lib/deepspeed/sequence 2026-03-13T21:21:42,988 copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence 2026-03-13T21:21:42,990 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2026-03-13T21:21:42,992 copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence 2026-03-13T21:21:42,996 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2026-03-13T21:21:42,999 creating build/lib/deepspeed/inference 2026-03-13T21:21:43,000 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2026-03-13T21:21:43,003 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2026-03-13T21:21:43,005 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2026-03-13T21:21:43,008 creating build/lib/deepspeed/linear 2026-03-13T21:21:43,009 copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear 2026-03-13T21:21:43,011 copying deepspeed/linear/config.py -> build/lib/deepspeed/linear 2026-03-13T21:21:43,013 copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear 2026-03-13T21:21:43,015 copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear 2026-03-13T21:21:43,017 copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear 2026-03-13T21:21:43,019 creating build/lib/deepspeed/profiling 2026-03-13T21:21:43,020 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2026-03-13T21:21:43,022 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2026-03-13T21:21:43,024 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2026-03-13T21:21:43,027 creating build/lib/deepspeed/launcher 2026-03-13T21:21:43,028 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,030 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,032 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,034 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,037 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,039 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2026-03-13T21:21:43,042 creating build/lib/deepspeed/datastates 2026-03-13T21:21:43,043 copying deepspeed/datastates/config.py -> build/lib/deepspeed/datastates 2026-03-13T21:21:43,045 copying deepspeed/datastates/__init__.py -> build/lib/deepspeed/datastates 2026-03-13T21:21:43,048 creating build/lib/deepspeed/utils 2026-03-13T21:21:43,049 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,051 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,054 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,056 copying deepspeed/utils/config.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,057 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,059 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,061 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,063 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,066 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,068 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,071 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,073 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,075 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,077 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,079 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,082 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,084 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,087 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2026-03-13T21:21:43,090 creating build/lib/deepspeed/pipe 2026-03-13T21:21:43,091 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2026-03-13T21:21:43,093 creating build/lib/deepspeed/moe 2026-03-13T21:21:43,094 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,096 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,099 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,101 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,103 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,105 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2026-03-13T21:21:43,108 creating build/lib/deepspeed/io 2026-03-13T21:21:43,109 copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,110 copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,112 copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,114 copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,116 copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,118 copying deepspeed/io/__init__.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,120 copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,122 copying deepspeed/io/utils.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,123 copying deepspeed/io/constants.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,125 copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io 2026-03-13T21:21:43,128 creating build/lib/deepspeed/ops 2026-03-13T21:21:43,129 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2026-03-13T21:21:43,131 creating build/lib/deepspeed/elasticity 2026-03-13T21:21:43,132 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,135 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,137 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,139 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,141 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,143 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2026-03-13T21:21:43,145 creating build/lib/deepspeed/autotuning 2026-03-13T21:21:43,146 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,149 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,152 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,154 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,156 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,159 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2026-03-13T21:21:43,162 creating build/lib/deepspeed/compile 2026-03-13T21:21:43,163 copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,165 copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,168 copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,170 copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,171 copying deepspeed/compile/config.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,173 copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,176 copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,178 copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,180 copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,182 copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,184 copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,187 copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,189 copying deepspeed/compile/util.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,192 copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile 2026-03-13T21:21:43,194 creating build/lib/deepspeed/module_inject 2026-03-13T21:21:43,195 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,198 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,200 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,202 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,205 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,207 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,210 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,212 copying deepspeed/module_inject/autotp_config.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,215 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,217 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,219 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,221 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,223 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,225 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2026-03-13T21:21:43,228 creating build/lib/deepspeed/comm 2026-03-13T21:21:43,229 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,230 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,232 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,235 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,237 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,240 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,242 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,244 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,246 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2026-03-13T21:21:43,248 creating build/lib/deepspeed/accelerator 2026-03-13T21:21:43,249 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,252 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,254 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,257 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,259 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,261 copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,263 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,265 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,268 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,270 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,272 copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator 2026-03-13T21:21:43,275 creating build/lib/deepspeed/monitor 2026-03-13T21:21:43,276 copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,278 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,280 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,282 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,284 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,286 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,288 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,289 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2026-03-13T21:21:43,292 creating build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,293 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,295 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,298 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,299 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,302 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,304 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,306 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,308 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,310 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,312 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2026-03-13T21:21:43,315 creating build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,316 copying deepspeed/runtime/zenflow/engine_stage3.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,320 copying deepspeed/runtime/zenflow/zenflow_utils.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,322 copying deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,326 copying deepspeed/runtime/zenflow/zenflow_config.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,328 copying deepspeed/runtime/zenflow/__init__.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,331 copying deepspeed/runtime/zenflow/engine.py -> build/lib/deepspeed/runtime/zenflow 2026-03-13T21:21:43,335 creating build/lib/deepspeed/runtime/compression 2026-03-13T21:21:43,336 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2026-03-13T21:21:43,339 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2026-03-13T21:21:43,342 creating build/lib/deepspeed/runtime/superoffload 2026-03-13T21:21:43,343 copying deepspeed/runtime/superoffload/__init__.py -> build/lib/deepspeed/runtime/superoffload 2026-03-13T21:21:43,345 copying deepspeed/runtime/superoffload/superoffload_stage3.py -> build/lib/deepspeed/runtime/superoffload 2026-03-13T21:21:43,348 copying deepspeed/runtime/superoffload/superoffload_utils.py -> build/lib/deepspeed/runtime/superoffload 2026-03-13T21:21:43,351 creating build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,352 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,355 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,357 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,360 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,362 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,365 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2026-03-13T21:21:43,369 creating build/lib/deepspeed/runtime/sequence_parallel 2026-03-13T21:21:43,370 copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2026-03-13T21:21:43,372 copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel 2026-03-13T21:21:43,374 copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel 2026-03-13T21:21:43,379 creating build/lib/deepspeed/runtime/domino 2026-03-13T21:21:43,380 copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino 2026-03-13T21:21:43,382 copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino 2026-03-13T21:21:43,384 copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino 2026-03-13T21:21:43,387 creating build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,388 copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,391 copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,393 copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,395 copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,397 copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,399 copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:43,402 creating build/lib/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:43,403 copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:43,405 copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:43,407 copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:43,409 copying deepspeed/runtime/tensor_parallel/init_utils.py -> build/lib/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:43,412 creating build/lib/deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:43,413 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:43,415 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:43,417 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:43,421 creating build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,423 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,425 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,430 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,432 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,438 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,441 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,443 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,445 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,448 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,450 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,452 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,455 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,460 copying deepspeed/runtime/zero/leaf_module_config.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,462 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,465 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,467 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,470 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,472 copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero 2026-03-13T21:21:43,475 creating build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,476 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,478 copying deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,480 copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,482 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,484 copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,486 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,488 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,490 copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:43,493 creating build/lib/deepspeed/runtime/data_pipeline 2026-03-13T21:21:43,494 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2026-03-13T21:21:43,497 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2026-03-13T21:21:43,499 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2026-03-13T21:21:43,502 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2026-03-13T21:21:43,504 creating build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,505 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,508 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,510 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,513 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,515 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,518 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,520 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,523 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,525 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2026-03-13T21:21:43,528 creating build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,529 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,532 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,534 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,536 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,538 copying deepspeed/runtime/comm/utils.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,540 copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,543 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2026-03-13T21:21:43,545 creating build/lib/deepspeed/runtime/fp16 2026-03-13T21:21:43,547 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2026-03-13T21:21:43,549 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2026-03-13T21:21:43,552 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2026-03-13T21:21:43,554 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2026-03-13T21:21:43,557 creating build/lib/deepspeed/runtime/zero/muon 2026-03-13T21:21:43,558 copying deepspeed/runtime/zero/muon/original_muon.py -> build/lib/deepspeed/runtime/zero/muon 2026-03-13T21:21:43,560 copying deepspeed/runtime/zero/muon/muon_optimizer.py -> build/lib/deepspeed/runtime/zero/muon 2026-03-13T21:21:43,562 copying deepspeed/runtime/zero/muon/__init__.py -> build/lib/deepspeed/runtime/zero/muon 2026-03-13T21:21:43,565 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,566 copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,569 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,571 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,573 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,575 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,578 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:43,582 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,584 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,587 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,590 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,592 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,594 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:43,597 creating build/lib/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:43,598 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:43,600 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:43,602 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:43,605 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:43,608 creating build/lib/deepspeed/model_implementations/diffusers 2026-03-13T21:21:43,609 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2026-03-13T21:21:43,612 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2026-03-13T21:21:43,614 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2026-03-13T21:21:43,616 creating build/lib/deepspeed/model_implementations/features 2026-03-13T21:21:43,617 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2026-03-13T21:21:43,619 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2026-03-13T21:21:43,622 creating build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,623 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,625 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,627 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,629 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,631 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,633 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,635 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,637 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,639 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,641 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2026-03-13T21:21:43,643 creating build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,644 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,646 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,648 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,650 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,652 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2026-03-13T21:21:43,655 creating build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,656 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,659 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,661 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,663 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,665 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,667 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,669 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,671 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,673 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2026-03-13T21:21:43,676 creating build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,677 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,679 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,681 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,684 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,686 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,689 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,691 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:43,694 creating build/lib/deepspeed/inference/v2/kernels 2026-03-13T21:21:43,696 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2026-03-13T21:21:43,697 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2026-03-13T21:21:43,700 creating build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,701 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,704 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,707 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,709 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,711 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,713 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,716 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2026-03-13T21:21:43,719 creating build/lib/deepspeed/inference/v2/modules 2026-03-13T21:21:43,720 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2026-03-13T21:21:43,723 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2026-03-13T21:21:43,725 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2026-03-13T21:21:43,727 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2026-03-13T21:21:43,729 creating build/lib/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:43,730 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:43,733 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:43,734 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:43,736 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:43,739 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:43,740 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:43,743 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:43,745 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:43,747 copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:43,751 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,752 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,754 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,756 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,758 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,760 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,762 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,765 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,767 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,769 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:43,771 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:43,772 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:43,775 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:43,776 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:43,779 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:43,782 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:43,783 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:43,785 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:43,787 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:43,789 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:43,792 creating build/lib/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:43,794 copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:43,796 copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:43,798 copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:43,800 copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:43,803 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:43,804 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:43,806 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:43,808 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:43,810 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:43,813 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:43,814 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:43,816 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:43,818 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:43,820 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:43,823 creating build/lib/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:43,824 copying deepspeed/inference/v2/model_implementations/exaone4/container.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:43,826 copying deepspeed/inference/v2/model_implementations/exaone4/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:43,828 copying deepspeed/inference/v2/model_implementations/exaone4/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:43,829 copying deepspeed/inference/v2/model_implementations/exaone4/model.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:43,832 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:43,834 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:43,836 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:43,837 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:43,839 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:43,842 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,843 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,846 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,848 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,850 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,852 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,854 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,856 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,858 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,860 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:43,862 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:43,863 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:43,865 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:43,867 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:43,869 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:43,871 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:43,872 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:43,874 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:43,876 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:43,878 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:43,881 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:43,882 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:43,884 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:43,886 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:43,888 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:43,891 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:43,892 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:43,895 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:43,896 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:43,898 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:43,899 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:43,902 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:43,903 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:43,905 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:43,908 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:43,909 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:43,911 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:43,913 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:43,915 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:43,917 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:43,919 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:43,920 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:43,922 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:43,924 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:43,926 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:43,928 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:43,931 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:43,932 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:43,934 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:43,936 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:43,938 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:43,940 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:43,941 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:43,944 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:43,946 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:43,947 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:43,949 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:43,952 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:43,953 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:43,955 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:43,958 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:43,959 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:43,961 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:43,963 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:43,965 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:43,966 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:43,968 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:43,970 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:43,972 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:43,974 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,975 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,977 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,979 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,981 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,983 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:43,985 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:43,986 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:43,988 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:43,991 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:43,992 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:43,994 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:43,997 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:43,998 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:44,000 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:44,003 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:44,004 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:44,006 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:44,008 creating build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,010 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,012 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,014 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,016 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,018 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,020 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,022 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:44,024 creating build/lib/deepspeed/inference/v2/modules/implementations 2026-03-13T21:21:44,025 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2026-03-13T21:21:44,028 creating build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,029 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,031 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,033 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,035 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,037 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,039 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,041 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,043 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:44,046 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:44,047 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:44,049 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:44,051 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:44,054 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:44,055 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:44,058 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:44,060 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:44,061 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:44,063 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:44,066 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:44,068 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:44,070 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:44,072 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:44,073 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:44,075 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:44,078 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:44,079 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:44,081 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:44,083 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:44,086 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:44,087 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:44,089 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:44,091 creating build/lib/deepspeed/profiling/flops_profiler 2026-03-13T21:21:44,092 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2026-03-13T21:21:44,312 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2026-03-13T21:21:44,315 creating build/lib/deepspeed/ops/gds 2026-03-13T21:21:44,316 copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds 2026-03-13T21:21:44,319 creating build/lib/deepspeed/ops/lion 2026-03-13T21:21:44,321 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2026-03-13T21:21:44,323 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2026-03-13T21:21:44,326 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2026-03-13T21:21:44,329 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2026-03-13T21:21:44,332 creating build/lib/deepspeed/ops/adagrad 2026-03-13T21:21:44,333 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2026-03-13T21:21:44,335 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2026-03-13T21:21:44,339 creating build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,341 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,344 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,348 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,350 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,353 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,357 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,359 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2026-03-13T21:21:44,363 creating build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,364 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,367 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,370 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,372 copying deepspeed/ops/adam/zenflow_torch_adam.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,376 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,379 copying deepspeed/ops/adam/zenflow_cpu_adam.py -> build/lib/deepspeed/ops/adam 2026-03-13T21:21:44,382 creating build/lib/deepspeed/ops/lamb 2026-03-13T21:21:44,384 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2026-03-13T21:21:44,386 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2026-03-13T21:21:44,390 creating build/lib/deepspeed/ops/random_ltd 2026-03-13T21:21:44,391 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2026-03-13T21:21:44,393 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2026-03-13T21:21:44,397 creating build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,399 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,401 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,404 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,407 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,409 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,412 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,415 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,417 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,419 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,421 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,423 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,425 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,427 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,430 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,432 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,434 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,436 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,438 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,441 copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,443 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,445 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,447 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,449 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,451 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,453 copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,455 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2026-03-13T21:21:44,458 creating build/lib/deepspeed/ops/aio 2026-03-13T21:21:44,459 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2026-03-13T21:21:44,461 creating build/lib/deepspeed/ops/compile 2026-03-13T21:21:44,462 copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile 2026-03-13T21:21:44,465 creating build/lib/deepspeed/ops/deepspeed4science 2026-03-13T21:21:44,466 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2026-03-13T21:21:44,468 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2026-03-13T21:21:44,470 creating build/lib/deepspeed/ops/transformer 2026-03-13T21:21:44,471 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2026-03-13T21:21:44,474 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2026-03-13T21:21:44,477 creating build/lib/deepspeed/ops/fp_quantizer 2026-03-13T21:21:44,478 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2026-03-13T21:21:44,480 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2026-03-13T21:21:44,482 copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer 2026-03-13T21:21:44,484 copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer 2026-03-13T21:21:44,487 creating build/lib/deepspeed/ops/quantizer 2026-03-13T21:21:44,488 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2026-03-13T21:21:44,490 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2026-03-13T21:21:44,493 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:44,494 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:44,497 creating build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,498 copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,500 copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,502 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,504 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,506 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,508 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,510 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:44,513 creating build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,514 copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,516 copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,518 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,520 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,522 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,525 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,527 copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,529 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,531 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:44,533 creating build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,535 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,537 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,539 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,540 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,542 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,544 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,546 copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:44,548 creating build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,549 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,552 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,555 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,557 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,559 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,561 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,563 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,565 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,567 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2026-03-13T21:21:44,569 creating build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,571 copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,575 copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,578 copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,581 copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,587 copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,591 copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:44,596 creating build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,812 copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,814 copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,816 copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,818 copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,820 copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:44,823 creating build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,824 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,827 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,829 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,832 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,834 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,836 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,838 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,841 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,843 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,846 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2026-03-13T21:21:44,849 creating build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,850 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,853 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,855 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,857 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,859 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,861 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,863 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,866 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,868 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,870 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:44,874 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,875 copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,877 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,880 copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,882 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,884 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,886 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,888 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,890 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,892 copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,895 copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,897 copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,899 copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,901 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,903 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,906 copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,908 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,910 copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,912 copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,914 copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,916 copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,918 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,920 copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,922 copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:44,925 creating build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,926 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,928 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,930 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,932 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,934 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,936 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2026-03-13T21:21:44,939 creating build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,940 copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,942 copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,944 copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,946 copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,948 copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,951 copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,953 copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,956 copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes 2026-03-13T21:21:44,958 creating build/lib/deepspeed/compile/profilers 2026-03-13T21:21:44,959 copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers 2026-03-13T21:21:44,962 copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers 2026-03-13T21:21:44,964 copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers 2026-03-13T21:21:44,967 creating build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,968 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,970 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,973 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,975 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,977 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,979 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,981 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,983 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,985 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,988 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,990 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,992 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,994 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,997 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:44,999 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:45,001 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:45,003 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:45,005 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:45,008 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2026-03-13T21:21:45,010 creating build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,011 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,014 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,016 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,018 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,020 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,023 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,025 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2026-03-13T21:21:45,028 running egg_info 2026-03-13T21:21:45,055 writing deepspeed.egg-info/PKG-INFO 2026-03-13T21:21:45,080 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2026-03-13T21:21:45,082 writing entry points to deepspeed.egg-info/entry_points.txt 2026-03-13T21:21:45,096 writing requirements to deepspeed.egg-info/requires.txt 2026-03-13T21:21:45,097 writing top-level names to deepspeed.egg-info/top_level.txt 2026-03-13T21:21:45,273 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2026-03-13T21:21:45,345 reading manifest template 'MANIFEST.in' 2026-03-13T21:21:45,347 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2026-03-13T21:21:45,347 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2026-03-13T21:21:47,305 warning: no files found matching '*.hip' under directory 'deepspeed' 2026-03-13T21:21:48,466 warning: no files found matching '*.cc' under directory 'deepspeed' 2026-03-13T21:21:49,185 warning: no files found matching '*.tr' under directory 'csrc' 2026-03-13T21:21:49,318 warning: no files found matching '*.cc' under directory 'csrc' 2026-03-13T21:21:49,366 warning: no files found matching '*.py' under directory 'benchmarks' 2026-03-13T21:21:49,372 adding license file 'LICENSE' 2026-03-13T21:21:49,426 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2026-03-13T21:21:49,435 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2026-03-13T21:21:49,436 !! 2026-03-13T21:21:49,437 ******************************************************************************** 2026-03-13T21:21:49,437 ############################ 2026-03-13T21:21:49,438 # Package would be ignored # 2026-03-13T21:21:49,438 ############################ 2026-03-13T21:21:49,439 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2026-03-13T21:21:49,439 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,440 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,440 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2026-03-13T21:21:49,441 to the `packages` configuration field. 2026-03-13T21:21:49,442 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,442 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,443 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,444 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,445 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,446 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2026-03-13T21:21:49,446 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2026-03-13T21:21:49,447 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,448 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,448 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,449 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,450 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,451 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,452 even if it does not contain any `.py` files. 2026-03-13T21:21:49,452 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,453 directory, all directories are treated like packages. 2026-03-13T21:21:49,453 ******************************************************************************** 2026-03-13T21:21:49,454 !! 2026-03-13T21:21:49,455 check.warn(importable) 2026-03-13T21:21:49,455 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2026-03-13T21:21:49,456 !! 2026-03-13T21:21:49,457 ******************************************************************************** 2026-03-13T21:21:49,457 ############################ 2026-03-13T21:21:49,458 # Package would be ignored # 2026-03-13T21:21:49,458 ############################ 2026-03-13T21:21:49,459 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2026-03-13T21:21:49,459 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,460 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,460 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2026-03-13T21:21:49,460 to the `packages` configuration field. 2026-03-13T21:21:49,461 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,461 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,462 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,462 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,463 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,464 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2026-03-13T21:21:49,464 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2026-03-13T21:21:49,465 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,465 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,465 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,466 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,467 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,468 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,469 even if it does not contain any `.py` files. 2026-03-13T21:21:49,469 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,470 directory, all directories are treated like packages. 2026-03-13T21:21:49,470 ******************************************************************************** 2026-03-13T21:21:49,471 !! 2026-03-13T21:21:49,471 check.warn(importable) 2026-03-13T21:21:49,472 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2026-03-13T21:21:49,472 !! 2026-03-13T21:21:49,473 ******************************************************************************** 2026-03-13T21:21:49,474 ############################ 2026-03-13T21:21:49,474 # Package would be ignored # 2026-03-13T21:21:49,474 ############################ 2026-03-13T21:21:49,475 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2026-03-13T21:21:49,475 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,476 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,477 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2026-03-13T21:21:49,477 to the `packages` configuration field. 2026-03-13T21:21:49,478 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,478 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,479 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,480 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,480 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,481 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2026-03-13T21:21:49,481 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2026-03-13T21:21:49,482 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,482 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,482 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,483 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,484 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,485 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,485 even if it does not contain any `.py` files. 2026-03-13T21:21:49,485 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,486 directory, all directories are treated like packages. 2026-03-13T21:21:49,486 ******************************************************************************** 2026-03-13T21:21:49,487 !! 2026-03-13T21:21:49,487 check.warn(importable) 2026-03-13T21:21:49,487 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2026-03-13T21:21:49,488 !! 2026-03-13T21:21:49,489 ******************************************************************************** 2026-03-13T21:21:49,489 ############################ 2026-03-13T21:21:49,489 # Package would be ignored # 2026-03-13T21:21:49,490 ############################ 2026-03-13T21:21:49,490 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2026-03-13T21:21:49,491 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,491 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,492 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2026-03-13T21:21:49,492 to the `packages` configuration field. 2026-03-13T21:21:49,493 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,494 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,494 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,495 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,496 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,497 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2026-03-13T21:21:49,497 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2026-03-13T21:21:49,497 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,498 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,498 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,499 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,500 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,501 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,502 even if it does not contain any `.py` files. 2026-03-13T21:21:49,502 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,503 directory, all directories are treated like packages. 2026-03-13T21:21:49,503 ******************************************************************************** 2026-03-13T21:21:49,504 !! 2026-03-13T21:21:49,504 check.warn(importable) 2026-03-13T21:21:49,505 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2026-03-13T21:21:49,505 !! 2026-03-13T21:21:49,506 ******************************************************************************** 2026-03-13T21:21:49,506 ############################ 2026-03-13T21:21:49,506 # Package would be ignored # 2026-03-13T21:21:49,507 ############################ 2026-03-13T21:21:49,507 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2026-03-13T21:21:49,507 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,508 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,508 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2026-03-13T21:21:49,509 to the `packages` configuration field. 2026-03-13T21:21:49,509 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,510 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,510 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,511 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,512 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,513 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2026-03-13T21:21:49,513 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2026-03-13T21:21:49,513 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,514 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,515 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,516 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,517 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,518 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,518 even if it does not contain any `.py` files. 2026-03-13T21:21:49,519 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,519 directory, all directories are treated like packages. 2026-03-13T21:21:49,519 ******************************************************************************** 2026-03-13T21:21:49,520 !! 2026-03-13T21:21:49,521 check.warn(importable) 2026-03-13T21:21:49,521 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2026-03-13T21:21:49,522 !! 2026-03-13T21:21:49,523 ******************************************************************************** 2026-03-13T21:21:49,523 ############################ 2026-03-13T21:21:49,523 # Package would be ignored # 2026-03-13T21:21:49,524 ############################ 2026-03-13T21:21:49,524 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2026-03-13T21:21:49,525 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,526 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,526 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2026-03-13T21:21:49,526 to the `packages` configuration field. 2026-03-13T21:21:49,527 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,527 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,528 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,528 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,529 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,530 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2026-03-13T21:21:49,530 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2026-03-13T21:21:49,530 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,531 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,531 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,532 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,533 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,534 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,534 even if it does not contain any `.py` files. 2026-03-13T21:21:49,535 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,535 directory, all directories are treated like packages. 2026-03-13T21:21:49,536 ******************************************************************************** 2026-03-13T21:21:49,537 !! 2026-03-13T21:21:49,537 check.warn(importable) 2026-03-13T21:21:49,537 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2026-03-13T21:21:49,538 !! 2026-03-13T21:21:49,539 ******************************************************************************** 2026-03-13T21:21:49,539 ############################ 2026-03-13T21:21:49,540 # Package would be ignored # 2026-03-13T21:21:49,540 ############################ 2026-03-13T21:21:49,540 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2026-03-13T21:21:49,541 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,542 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,542 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2026-03-13T21:21:49,543 to the `packages` configuration field. 2026-03-13T21:21:49,543 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,544 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,544 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,545 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,546 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,547 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2026-03-13T21:21:49,547 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2026-03-13T21:21:49,548 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,549 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,549 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,550 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,551 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,551 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,552 even if it does not contain any `.py` files. 2026-03-13T21:21:49,552 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,552 directory, all directories are treated like packages. 2026-03-13T21:21:49,553 ******************************************************************************** 2026-03-13T21:21:49,553 !! 2026-03-13T21:21:49,554 check.warn(importable) 2026-03-13T21:21:49,554 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2026-03-13T21:21:49,554 !! 2026-03-13T21:21:49,555 ******************************************************************************** 2026-03-13T21:21:49,556 ############################ 2026-03-13T21:21:49,556 # Package would be ignored # 2026-03-13T21:21:49,556 ############################ 2026-03-13T21:21:49,557 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2026-03-13T21:21:49,557 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,558 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,558 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2026-03-13T21:21:49,559 to the `packages` configuration field. 2026-03-13T21:21:49,560 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,560 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,561 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,561 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,562 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,563 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2026-03-13T21:21:49,564 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2026-03-13T21:21:49,564 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,564 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,565 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,566 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,567 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,568 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,568 even if it does not contain any `.py` files. 2026-03-13T21:21:49,569 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,569 directory, all directories are treated like packages. 2026-03-13T21:21:49,569 ******************************************************************************** 2026-03-13T21:21:49,571 !! 2026-03-13T21:21:49,571 check.warn(importable) 2026-03-13T21:21:49,571 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2026-03-13T21:21:49,572 !! 2026-03-13T21:21:49,573 ******************************************************************************** 2026-03-13T21:21:49,573 ############################ 2026-03-13T21:21:49,573 # Package would be ignored # 2026-03-13T21:21:49,574 ############################ 2026-03-13T21:21:49,574 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2026-03-13T21:21:49,574 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,575 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,575 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2026-03-13T21:21:49,576 to the `packages` configuration field. 2026-03-13T21:21:49,576 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,577 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,577 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,578 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,579 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,580 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2026-03-13T21:21:49,580 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2026-03-13T21:21:49,581 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,581 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,581 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,582 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,583 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,584 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,585 even if it does not contain any `.py` files. 2026-03-13T21:21:49,585 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,586 directory, all directories are treated like packages. 2026-03-13T21:21:49,586 ******************************************************************************** 2026-03-13T21:21:49,587 !! 2026-03-13T21:21:49,587 check.warn(importable) 2026-03-13T21:21:49,588 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2026-03-13T21:21:49,588 !! 2026-03-13T21:21:49,589 ******************************************************************************** 2026-03-13T21:21:49,589 ############################ 2026-03-13T21:21:49,590 # Package would be ignored # 2026-03-13T21:21:49,590 ############################ 2026-03-13T21:21:49,591 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2026-03-13T21:21:49,591 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,592 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,593 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2026-03-13T21:21:49,593 to the `packages` configuration field. 2026-03-13T21:21:49,594 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,595 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,595 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,597 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,598 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,599 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2026-03-13T21:21:49,599 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2026-03-13T21:21:49,600 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,600 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,600 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,601 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,602 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,603 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,603 even if it does not contain any `.py` files. 2026-03-13T21:21:49,603 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,604 directory, all directories are treated like packages. 2026-03-13T21:21:49,604 ******************************************************************************** 2026-03-13T21:21:49,605 !! 2026-03-13T21:21:49,605 check.warn(importable) 2026-03-13T21:21:49,606 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2026-03-13T21:21:49,606 !! 2026-03-13T21:21:49,607 ******************************************************************************** 2026-03-13T21:21:49,607 ############################ 2026-03-13T21:21:49,608 # Package would be ignored # 2026-03-13T21:21:49,608 ############################ 2026-03-13T21:21:49,609 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2026-03-13T21:21:49,609 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,610 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,611 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2026-03-13T21:21:49,611 to the `packages` configuration field. 2026-03-13T21:21:49,612 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,613 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,613 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,614 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,615 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,616 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2026-03-13T21:21:49,616 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2026-03-13T21:21:49,617 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,617 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,618 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,619 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,620 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,621 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,622 even if it does not contain any `.py` files. 2026-03-13T21:21:49,622 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,623 directory, all directories are treated like packages. 2026-03-13T21:21:49,623 ******************************************************************************** 2026-03-13T21:21:49,624 !! 2026-03-13T21:21:49,624 check.warn(importable) 2026-03-13T21:21:49,625 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2026-03-13T21:21:49,625 !! 2026-03-13T21:21:49,626 ******************************************************************************** 2026-03-13T21:21:49,627 ############################ 2026-03-13T21:21:49,627 # Package would be ignored # 2026-03-13T21:21:49,628 ############################ 2026-03-13T21:21:49,628 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2026-03-13T21:21:49,628 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,629 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,630 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2026-03-13T21:21:49,630 to the `packages` configuration field. 2026-03-13T21:21:49,631 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,631 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,632 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,633 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,634 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,635 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2026-03-13T21:21:49,635 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2026-03-13T21:21:49,636 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,636 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,637 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,637 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,638 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,640 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,640 even if it does not contain any `.py` files. 2026-03-13T21:21:49,641 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,641 directory, all directories are treated like packages. 2026-03-13T21:21:49,642 ******************************************************************************** 2026-03-13T21:21:49,643 !! 2026-03-13T21:21:49,643 check.warn(importable) 2026-03-13T21:21:49,644 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2026-03-13T21:21:49,644 !! 2026-03-13T21:21:49,645 ******************************************************************************** 2026-03-13T21:21:49,646 ############################ 2026-03-13T21:21:49,646 # Package would be ignored # 2026-03-13T21:21:49,647 ############################ 2026-03-13T21:21:49,647 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2026-03-13T21:21:49,648 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,649 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,649 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2026-03-13T21:21:49,650 to the `packages` configuration field. 2026-03-13T21:21:49,651 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,652 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,652 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,653 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,654 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,655 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2026-03-13T21:21:49,656 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2026-03-13T21:21:49,656 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,657 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,657 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,658 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,659 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,660 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,660 even if it does not contain any `.py` files. 2026-03-13T21:21:49,661 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,661 directory, all directories are treated like packages. 2026-03-13T21:21:49,662 ******************************************************************************** 2026-03-13T21:21:49,663 !! 2026-03-13T21:21:49,663 check.warn(importable) 2026-03-13T21:21:49,664 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration. 2026-03-13T21:21:49,664 !! 2026-03-13T21:21:49,665 ******************************************************************************** 2026-03-13T21:21:49,665 ############################ 2026-03-13T21:21:49,666 # Package would be ignored # 2026-03-13T21:21:49,666 ############################ 2026-03-13T21:21:49,667 Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1], 2026-03-13T21:21:49,667 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,668 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,669 package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added 2026-03-13T21:21:49,669 to the `packages` configuration field. 2026-03-13T21:21:49,670 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,671 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,671 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,672 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,673 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,674 If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are 2026-03-13T21:21:49,674 already explicitly excluding 'deepspeed.ops.csrc.compile' via 2026-03-13T21:21:49,675 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,675 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,676 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,677 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,678 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,679 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,680 even if it does not contain any `.py` files. 2026-03-13T21:21:49,680 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,680 directory, all directories are treated like packages. 2026-03-13T21:21:49,681 ******************************************************************************** 2026-03-13T21:21:49,682 !! 2026-03-13T21:21:49,682 check.warn(importable) 2026-03-13T21:21:49,683 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2026-03-13T21:21:49,683 !! 2026-03-13T21:21:49,684 ******************************************************************************** 2026-03-13T21:21:49,684 ############################ 2026-03-13T21:21:49,685 # Package would be ignored # 2026-03-13T21:21:49,685 ############################ 2026-03-13T21:21:49,686 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2026-03-13T21:21:49,686 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,687 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,687 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2026-03-13T21:21:49,688 to the `packages` configuration field. 2026-03-13T21:21:49,689 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,689 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,690 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,691 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,692 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,693 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2026-03-13T21:21:49,694 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2026-03-13T21:21:49,694 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,695 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,695 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,696 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,697 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,699 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,699 even if it does not contain any `.py` files. 2026-03-13T21:21:49,700 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,700 directory, all directories are treated like packages. 2026-03-13T21:21:49,701 ******************************************************************************** 2026-03-13T21:21:49,702 !! 2026-03-13T21:21:49,702 check.warn(importable) 2026-03-13T21:21:49,703 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2026-03-13T21:21:49,703 !! 2026-03-13T21:21:49,704 ******************************************************************************** 2026-03-13T21:21:49,705 ############################ 2026-03-13T21:21:49,706 # Package would be ignored # 2026-03-13T21:21:49,706 ############################ 2026-03-13T21:21:49,707 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2026-03-13T21:21:49,707 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,708 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,708 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2026-03-13T21:21:49,709 to the `packages` configuration field. 2026-03-13T21:21:49,710 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,710 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,710 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,711 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,712 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,713 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2026-03-13T21:21:49,713 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2026-03-13T21:21:49,714 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,715 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,715 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,716 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,717 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,718 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,719 even if it does not contain any `.py` files. 2026-03-13T21:21:49,719 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,719 directory, all directories are treated like packages. 2026-03-13T21:21:49,720 ******************************************************************************** 2026-03-13T21:21:49,721 !! 2026-03-13T21:21:49,721 check.warn(importable) 2026-03-13T21:21:49,722 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.arm64' is absent from the `packages` configuration. 2026-03-13T21:21:49,722 !! 2026-03-13T21:21:49,723 ******************************************************************************** 2026-03-13T21:21:49,724 ############################ 2026-03-13T21:21:49,724 # Package would be ignored # 2026-03-13T21:21:49,725 ############################ 2026-03-13T21:21:49,725 Python recognizes 'deepspeed.ops.csrc.cpu.comm.arm64' as an importable package[^1], 2026-03-13T21:21:49,726 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,727 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,728 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.arm64' is explicitly added 2026-03-13T21:21:49,728 to the `packages` configuration field. 2026-03-13T21:21:49,729 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,730 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,730 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,731 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,732 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,734 If you don't want 'deepspeed.ops.csrc.cpu.comm.arm64' to be distributed and are 2026-03-13T21:21:49,734 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.arm64' via 2026-03-13T21:21:49,735 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,736 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,736 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,737 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,738 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,739 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,740 even if it does not contain any `.py` files. 2026-03-13T21:21:49,740 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,740 directory, all directories are treated like packages. 2026-03-13T21:21:49,741 ******************************************************************************** 2026-03-13T21:21:49,742 !! 2026-03-13T21:21:49,742 check.warn(importable) 2026-03-13T21:21:49,743 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.riscv64' is absent from the `packages` configuration. 2026-03-13T21:21:49,744 !! 2026-03-13T21:21:49,744 ******************************************************************************** 2026-03-13T21:21:49,745 ############################ 2026-03-13T21:21:49,745 # Package would be ignored # 2026-03-13T21:21:49,746 ############################ 2026-03-13T21:21:49,746 Python recognizes 'deepspeed.ops.csrc.cpu.comm.riscv64' as an importable package[^1], 2026-03-13T21:21:49,747 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,748 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,748 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.riscv64' is explicitly added 2026-03-13T21:21:49,749 to the `packages` configuration field. 2026-03-13T21:21:49,750 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,750 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,750 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,751 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,753 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,754 If you don't want 'deepspeed.ops.csrc.cpu.comm.riscv64' to be distributed and are 2026-03-13T21:21:49,754 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.riscv64' via 2026-03-13T21:21:49,755 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,755 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,756 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,757 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,758 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,759 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,760 even if it does not contain any `.py` files. 2026-03-13T21:21:49,760 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,761 directory, all directories are treated like packages. 2026-03-13T21:21:49,761 ******************************************************************************** 2026-03-13T21:21:49,763 !! 2026-03-13T21:21:49,763 check.warn(importable) 2026-03-13T21:21:49,764 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.x86_64' is absent from the `packages` configuration. 2026-03-13T21:21:49,764 !! 2026-03-13T21:21:49,765 ******************************************************************************** 2026-03-13T21:21:49,765 ############################ 2026-03-13T21:21:49,766 # Package would be ignored # 2026-03-13T21:21:49,766 ############################ 2026-03-13T21:21:49,766 Python recognizes 'deepspeed.ops.csrc.cpu.comm.x86_64' as an importable package[^1], 2026-03-13T21:21:49,767 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,767 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,768 package, please make sure that 'deepspeed.ops.csrc.cpu.comm.x86_64' is explicitly added 2026-03-13T21:21:49,768 to the `packages` configuration field. 2026-03-13T21:21:49,769 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,770 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,770 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,771 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,772 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,772 If you don't want 'deepspeed.ops.csrc.cpu.comm.x86_64' to be distributed and are 2026-03-13T21:21:49,773 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.x86_64' via 2026-03-13T21:21:49,773 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,774 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,774 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,775 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,776 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,777 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,778 even if it does not contain any `.py` files. 2026-03-13T21:21:49,779 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,779 directory, all directories are treated like packages. 2026-03-13T21:21:49,780 ******************************************************************************** 2026-03-13T21:21:49,781 !! 2026-03-13T21:21:49,781 check.warn(importable) 2026-03-13T21:21:49,782 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2026-03-13T21:21:49,782 !! 2026-03-13T21:21:49,783 ******************************************************************************** 2026-03-13T21:21:49,784 ############################ 2026-03-13T21:21:49,784 # Package would be ignored # 2026-03-13T21:21:49,785 ############################ 2026-03-13T21:21:49,785 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2026-03-13T21:21:49,786 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,787 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,787 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2026-03-13T21:21:49,788 to the `packages` configuration field. 2026-03-13T21:21:49,789 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,790 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,790 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,791 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,792 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,793 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2026-03-13T21:21:49,793 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2026-03-13T21:21:49,794 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,794 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,795 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,795 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,796 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,797 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,798 even if it does not contain any `.py` files. 2026-03-13T21:21:49,798 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,799 directory, all directories are treated like packages. 2026-03-13T21:21:49,799 ******************************************************************************** 2026-03-13T21:21:49,800 !! 2026-03-13T21:21:49,801 check.warn(importable) 2026-03-13T21:21:49,801 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2026-03-13T21:21:49,802 !! 2026-03-13T21:21:49,803 ******************************************************************************** 2026-03-13T21:21:49,803 ############################ 2026-03-13T21:21:49,804 # Package would be ignored # 2026-03-13T21:21:49,804 ############################ 2026-03-13T21:21:49,805 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2026-03-13T21:21:49,805 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,807 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,807 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2026-03-13T21:21:49,808 to the `packages` configuration field. 2026-03-13T21:21:49,808 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,809 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,809 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,810 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,812 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,813 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2026-03-13T21:21:49,813 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2026-03-13T21:21:49,814 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,814 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,815 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,816 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,817 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,818 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,819 even if it does not contain any `.py` files. 2026-03-13T21:21:49,819 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,819 directory, all directories are treated like packages. 2026-03-13T21:21:49,820 ******************************************************************************** 2026-03-13T21:21:49,820 !! 2026-03-13T21:21:49,821 check.warn(importable) 2026-03-13T21:21:49,821 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2026-03-13T21:21:49,821 !! 2026-03-13T21:21:49,822 ******************************************************************************** 2026-03-13T21:21:49,823 ############################ 2026-03-13T21:21:49,823 # Package would be ignored # 2026-03-13T21:21:49,823 ############################ 2026-03-13T21:21:49,824 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2026-03-13T21:21:49,824 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,825 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,825 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2026-03-13T21:21:49,826 to the `packages` configuration field. 2026-03-13T21:21:49,827 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,827 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,828 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,829 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,830 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,831 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2026-03-13T21:21:49,831 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2026-03-13T21:21:49,832 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,832 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,833 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,834 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,835 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,836 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,837 even if it does not contain any `.py` files. 2026-03-13T21:21:49,837 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,838 directory, all directories are treated like packages. 2026-03-13T21:21:49,838 ******************************************************************************** 2026-03-13T21:21:49,839 !! 2026-03-13T21:21:49,840 check.warn(importable) 2026-03-13T21:21:49,841 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2026-03-13T21:21:49,841 !! 2026-03-13T21:21:49,842 ******************************************************************************** 2026-03-13T21:21:49,843 ############################ 2026-03-13T21:21:49,843 # Package would be ignored # 2026-03-13T21:21:49,844 ############################ 2026-03-13T21:21:49,845 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2026-03-13T21:21:49,845 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,846 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,846 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2026-03-13T21:21:49,846 to the `packages` configuration field. 2026-03-13T21:21:49,847 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,847 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,848 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,849 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,850 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,850 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2026-03-13T21:21:49,851 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2026-03-13T21:21:49,851 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,852 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,852 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,853 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,854 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,855 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,856 even if it does not contain any `.py` files. 2026-03-13T21:21:49,856 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,857 directory, all directories are treated like packages. 2026-03-13T21:21:49,857 ******************************************************************************** 2026-03-13T21:21:49,858 !! 2026-03-13T21:21:49,859 check.warn(importable) 2026-03-13T21:21:49,860 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2026-03-13T21:21:49,860 !! 2026-03-13T21:21:49,861 ******************************************************************************** 2026-03-13T21:21:49,862 ############################ 2026-03-13T21:21:49,862 # Package would be ignored # 2026-03-13T21:21:49,863 ############################ 2026-03-13T21:21:49,863 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2026-03-13T21:21:49,864 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,865 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,865 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2026-03-13T21:21:49,866 to the `packages` configuration field. 2026-03-13T21:21:49,867 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,867 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,868 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,869 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,870 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,871 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2026-03-13T21:21:49,872 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2026-03-13T21:21:49,872 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,873 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,873 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,874 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,874 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,876 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,876 even if it does not contain any `.py` files. 2026-03-13T21:21:49,876 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,877 directory, all directories are treated like packages. 2026-03-13T21:21:49,877 ******************************************************************************** 2026-03-13T21:21:49,879 !! 2026-03-13T21:21:49,879 check.warn(importable) 2026-03-13T21:21:49,880 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2026-03-13T21:21:49,880 !! 2026-03-13T21:21:49,881 ******************************************************************************** 2026-03-13T21:21:49,881 ############################ 2026-03-13T21:21:49,882 # Package would be ignored # 2026-03-13T21:21:49,882 ############################ 2026-03-13T21:21:49,883 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2026-03-13T21:21:49,883 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,884 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,885 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2026-03-13T21:21:49,885 to the `packages` configuration field. 2026-03-13T21:21:49,886 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,887 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,887 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,888 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,889 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,890 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2026-03-13T21:21:49,891 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2026-03-13T21:21:49,891 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,892 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,892 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,893 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,895 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,896 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,897 even if it does not contain any `.py` files. 2026-03-13T21:21:49,897 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,898 directory, all directories are treated like packages. 2026-03-13T21:21:49,898 ******************************************************************************** 2026-03-13T21:21:49,899 !! 2026-03-13T21:21:49,899 check.warn(importable) 2026-03-13T21:21:49,900 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2026-03-13T21:21:49,900 !! 2026-03-13T21:21:49,901 ******************************************************************************** 2026-03-13T21:21:49,901 ############################ 2026-03-13T21:21:49,902 # Package would be ignored # 2026-03-13T21:21:49,902 ############################ 2026-03-13T21:21:49,902 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2026-03-13T21:21:49,903 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,904 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,904 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2026-03-13T21:21:49,905 to the `packages` configuration field. 2026-03-13T21:21:49,906 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,906 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,907 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,907 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,908 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,909 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2026-03-13T21:21:49,910 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2026-03-13T21:21:49,910 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,911 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,911 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,912 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,913 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,915 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,915 even if it does not contain any `.py` files. 2026-03-13T21:21:49,915 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,916 directory, all directories are treated like packages. 2026-03-13T21:21:49,916 ******************************************************************************** 2026-03-13T21:21:49,917 !! 2026-03-13T21:21:49,918 check.warn(importable) 2026-03-13T21:21:49,918 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2026-03-13T21:21:49,919 !! 2026-03-13T21:21:49,920 ******************************************************************************** 2026-03-13T21:21:49,921 ############################ 2026-03-13T21:21:49,921 # Package would be ignored # 2026-03-13T21:21:49,921 ############################ 2026-03-13T21:21:49,922 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2026-03-13T21:21:49,923 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,924 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,924 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2026-03-13T21:21:49,925 to the `packages` configuration field. 2026-03-13T21:21:49,925 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,926 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,926 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,927 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,927 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,928 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2026-03-13T21:21:49,929 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2026-03-13T21:21:49,929 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,929 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,930 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,930 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,931 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,933 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,933 even if it does not contain any `.py` files. 2026-03-13T21:21:49,933 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,934 directory, all directories are treated like packages. 2026-03-13T21:21:49,934 ******************************************************************************** 2026-03-13T21:21:49,935 !! 2026-03-13T21:21:49,936 check.warn(importable) 2026-03-13T21:21:49,936 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration. 2026-03-13T21:21:49,937 !! 2026-03-13T21:21:49,938 ******************************************************************************** 2026-03-13T21:21:49,938 ############################ 2026-03-13T21:21:49,939 # Package would be ignored # 2026-03-13T21:21:49,940 ############################ 2026-03-13T21:21:49,940 Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1], 2026-03-13T21:21:49,940 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:49,941 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:49,942 package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added 2026-03-13T21:21:49,943 to the `packages` configuration field. 2026-03-13T21:21:49,944 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:49,944 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:49,945 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:49,945 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:49,947 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:49,948 If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are 2026-03-13T21:21:49,949 already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via 2026-03-13T21:21:49,949 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:49,950 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:49,950 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:49,951 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:49,952 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:49,954 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:49,992 even if it does not contain any `.py` files. 2026-03-13T21:21:49,992 On the other hand, currently there is no concept of package data 2026-03-13T21:21:49,993 directory, all directories are treated like packages. 2026-03-13T21:21:49,993 ******************************************************************************** 2026-03-13T21:21:49,994 !! 2026-03-13T21:21:49,995 check.warn(importable) 2026-03-13T21:21:49,995 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2026-03-13T21:21:49,996 !! 2026-03-13T21:21:49,997 ******************************************************************************** 2026-03-13T21:21:49,997 ############################ 2026-03-13T21:21:49,997 # Package would be ignored # 2026-03-13T21:21:49,998 ############################ 2026-03-13T21:21:49,998 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2026-03-13T21:21:49,999 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,000 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,000 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2026-03-13T21:21:50,001 to the `packages` configuration field. 2026-03-13T21:21:50,002 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,003 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,003 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,004 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,005 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,006 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2026-03-13T21:21:50,007 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2026-03-13T21:21:50,007 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,008 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,008 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,009 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,010 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,012 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,012 even if it does not contain any `.py` files. 2026-03-13T21:21:50,013 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,013 directory, all directories are treated like packages. 2026-03-13T21:21:50,014 ******************************************************************************** 2026-03-13T21:21:50,015 !! 2026-03-13T21:21:50,016 check.warn(importable) 2026-03-13T21:21:50,016 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2026-03-13T21:21:50,017 !! 2026-03-13T21:21:50,018 ******************************************************************************** 2026-03-13T21:21:50,018 ############################ 2026-03-13T21:21:50,019 # Package would be ignored # 2026-03-13T21:21:50,019 ############################ 2026-03-13T21:21:50,020 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2026-03-13T21:21:50,021 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,021 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,022 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2026-03-13T21:21:50,023 to the `packages` configuration field. 2026-03-13T21:21:50,023 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,024 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,025 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,025 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,026 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,028 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2026-03-13T21:21:50,028 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2026-03-13T21:21:50,029 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,029 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,030 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,031 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,032 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,033 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,034 even if it does not contain any `.py` files. 2026-03-13T21:21:50,034 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,035 directory, all directories are treated like packages. 2026-03-13T21:21:50,035 ******************************************************************************** 2026-03-13T21:21:50,037 !! 2026-03-13T21:21:50,037 check.warn(importable) 2026-03-13T21:21:50,038 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2026-03-13T21:21:50,038 !! 2026-03-13T21:21:50,039 ******************************************************************************** 2026-03-13T21:21:50,040 ############################ 2026-03-13T21:21:50,041 # Package would be ignored # 2026-03-13T21:21:50,041 ############################ 2026-03-13T21:21:50,042 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2026-03-13T21:21:50,042 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,044 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,044 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2026-03-13T21:21:50,045 to the `packages` configuration field. 2026-03-13T21:21:50,046 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,046 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,047 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,048 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,049 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,050 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2026-03-13T21:21:50,051 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2026-03-13T21:21:50,051 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,052 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,052 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,053 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,055 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,056 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,057 even if it does not contain any `.py` files. 2026-03-13T21:21:50,058 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,059 directory, all directories are treated like packages. 2026-03-13T21:21:50,059 ******************************************************************************** 2026-03-13T21:21:50,061 !! 2026-03-13T21:21:50,061 check.warn(importable) 2026-03-13T21:21:50,062 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2026-03-13T21:21:50,063 !! 2026-03-13T21:21:50,064 ******************************************************************************** 2026-03-13T21:21:50,064 ############################ 2026-03-13T21:21:50,065 # Package would be ignored # 2026-03-13T21:21:50,066 ############################ 2026-03-13T21:21:50,066 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2026-03-13T21:21:50,067 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,068 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,069 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2026-03-13T21:21:50,069 to the `packages` configuration field. 2026-03-13T21:21:50,071 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,072 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,072 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,073 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,075 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,076 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2026-03-13T21:21:50,077 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2026-03-13T21:21:50,078 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,078 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,079 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,080 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,082 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,084 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,084 even if it does not contain any `.py` files. 2026-03-13T21:21:50,085 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,086 directory, all directories are treated like packages. 2026-03-13T21:21:50,086 ******************************************************************************** 2026-03-13T21:21:50,088 !! 2026-03-13T21:21:50,089 check.warn(importable) 2026-03-13T21:21:50,089 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2026-03-13T21:21:50,090 !! 2026-03-13T21:21:50,091 ******************************************************************************** 2026-03-13T21:21:50,091 ############################ 2026-03-13T21:21:50,092 # Package would be ignored # 2026-03-13T21:21:50,093 ############################ 2026-03-13T21:21:50,093 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2026-03-13T21:21:50,094 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,095 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,096 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2026-03-13T21:21:50,097 to the `packages` configuration field. 2026-03-13T21:21:50,098 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,098 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,099 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,100 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,101 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,103 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2026-03-13T21:21:50,103 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2026-03-13T21:21:50,104 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,105 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,105 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,107 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,108 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,110 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,110 even if it does not contain any `.py` files. 2026-03-13T21:21:50,111 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,112 directory, all directories are treated like packages. 2026-03-13T21:21:50,112 ******************************************************************************** 2026-03-13T21:21:50,114 !! 2026-03-13T21:21:50,114 check.warn(importable) 2026-03-13T21:21:50,115 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2026-03-13T21:21:50,116 !! 2026-03-13T21:21:50,117 ******************************************************************************** 2026-03-13T21:21:50,117 ############################ 2026-03-13T21:21:50,118 # Package would be ignored # 2026-03-13T21:21:50,119 ############################ 2026-03-13T21:21:50,120 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2026-03-13T21:21:50,120 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,122 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,122 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2026-03-13T21:21:50,123 to the `packages` configuration field. 2026-03-13T21:21:50,125 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,126 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,127 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,128 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,130 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,131 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2026-03-13T21:21:50,132 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2026-03-13T21:21:50,132 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,133 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,133 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,134 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,136 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,137 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,138 even if it does not contain any `.py` files. 2026-03-13T21:21:50,138 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,139 directory, all directories are treated like packages. 2026-03-13T21:21:50,140 ******************************************************************************** 2026-03-13T21:21:50,141 !! 2026-03-13T21:21:50,141 check.warn(importable) 2026-03-13T21:21:50,142 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2026-03-13T21:21:50,143 !! 2026-03-13T21:21:50,144 ******************************************************************************** 2026-03-13T21:21:50,145 ############################ 2026-03-13T21:21:50,146 # Package would be ignored # 2026-03-13T21:21:50,146 ############################ 2026-03-13T21:21:50,147 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2026-03-13T21:21:50,147 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,149 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,149 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2026-03-13T21:21:50,150 to the `packages` configuration field. 2026-03-13T21:21:50,151 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,152 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,153 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,154 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,155 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,156 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2026-03-13T21:21:50,157 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2026-03-13T21:21:50,157 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,158 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,158 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,159 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,161 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,163 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,163 even if it does not contain any `.py` files. 2026-03-13T21:21:50,164 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,164 directory, all directories are treated like packages. 2026-03-13T21:21:50,165 ******************************************************************************** 2026-03-13T21:21:50,165 !! 2026-03-13T21:21:50,166 check.warn(importable) 2026-03-13T21:21:50,166 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2026-03-13T21:21:50,167 !! 2026-03-13T21:21:50,168 ******************************************************************************** 2026-03-13T21:21:50,168 ############################ 2026-03-13T21:21:50,169 # Package would be ignored # 2026-03-13T21:21:50,169 ############################ 2026-03-13T21:21:50,170 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2026-03-13T21:21:50,170 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,171 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,172 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2026-03-13T21:21:50,172 to the `packages` configuration field. 2026-03-13T21:21:50,173 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,174 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,174 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,175 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,176 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,177 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2026-03-13T21:21:50,177 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2026-03-13T21:21:50,178 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,178 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,179 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,180 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,181 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,182 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,183 even if it does not contain any `.py` files. 2026-03-13T21:21:50,183 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,184 directory, all directories are treated like packages. 2026-03-13T21:21:50,184 ******************************************************************************** 2026-03-13T21:21:50,185 !! 2026-03-13T21:21:50,186 check.warn(importable) 2026-03-13T21:21:50,186 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2026-03-13T21:21:50,187 !! 2026-03-13T21:21:50,188 ******************************************************************************** 2026-03-13T21:21:50,188 ############################ 2026-03-13T21:21:50,189 # Package would be ignored # 2026-03-13T21:21:50,189 ############################ 2026-03-13T21:21:50,190 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2026-03-13T21:21:50,191 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,191 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,192 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2026-03-13T21:21:50,192 to the `packages` configuration field. 2026-03-13T21:21:50,193 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,194 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,194 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,195 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,196 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,196 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2026-03-13T21:21:50,197 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2026-03-13T21:21:50,197 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,198 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,198 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,199 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,200 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,201 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,202 even if it does not contain any `.py` files. 2026-03-13T21:21:50,202 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,203 directory, all directories are treated like packages. 2026-03-13T21:21:50,203 ******************************************************************************** 2026-03-13T21:21:50,204 !! 2026-03-13T21:21:50,205 check.warn(importable) 2026-03-13T21:21:50,205 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2026-03-13T21:21:50,206 !! 2026-03-13T21:21:50,207 ******************************************************************************** 2026-03-13T21:21:50,207 ############################ 2026-03-13T21:21:50,208 # Package would be ignored # 2026-03-13T21:21:50,208 ############################ 2026-03-13T21:21:50,209 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2026-03-13T21:21:50,209 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,210 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,211 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2026-03-13T21:21:50,211 to the `packages` configuration field. 2026-03-13T21:21:50,213 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,213 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,214 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,215 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,216 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,217 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2026-03-13T21:21:50,217 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2026-03-13T21:21:50,218 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,218 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,219 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,220 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,220 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,222 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,222 even if it does not contain any `.py` files. 2026-03-13T21:21:50,223 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,223 directory, all directories are treated like packages. 2026-03-13T21:21:50,224 ******************************************************************************** 2026-03-13T21:21:50,225 !! 2026-03-13T21:21:50,225 check.warn(importable) 2026-03-13T21:21:50,226 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2026-03-13T21:21:50,226 !! 2026-03-13T21:21:50,227 ******************************************************************************** 2026-03-13T21:21:50,227 ############################ 2026-03-13T21:21:50,228 # Package would be ignored # 2026-03-13T21:21:50,228 ############################ 2026-03-13T21:21:50,229 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2026-03-13T21:21:50,229 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,230 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,231 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2026-03-13T21:21:50,231 to the `packages` configuration field. 2026-03-13T21:21:50,232 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,233 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,233 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,234 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,236 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,237 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2026-03-13T21:21:50,237 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2026-03-13T21:21:50,238 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,239 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,240 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,241 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,242 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,243 even if it does not contain any `.py` files. 2026-03-13T21:21:50,243 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,244 directory, all directories are treated like packages. 2026-03-13T21:21:50,244 ******************************************************************************** 2026-03-13T21:21:50,246 !! 2026-03-13T21:21:50,246 check.warn(importable) 2026-03-13T21:21:50,246 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2026-03-13T21:21:50,247 !! 2026-03-13T21:21:50,248 ******************************************************************************** 2026-03-13T21:21:50,248 ############################ 2026-03-13T21:21:50,249 # Package would be ignored # 2026-03-13T21:21:50,249 ############################ 2026-03-13T21:21:50,250 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2026-03-13T21:21:50,250 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,251 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,251 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2026-03-13T21:21:50,252 to the `packages` configuration field. 2026-03-13T21:21:50,253 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,253 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,254 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,254 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,255 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,256 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2026-03-13T21:21:50,257 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2026-03-13T21:21:50,257 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,257 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,258 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,259 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,260 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,261 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,262 even if it does not contain any `.py` files. 2026-03-13T21:21:50,262 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,263 directory, all directories are treated like packages. 2026-03-13T21:21:50,263 ******************************************************************************** 2026-03-13T21:21:50,264 !! 2026-03-13T21:21:50,265 check.warn(importable) 2026-03-13T21:21:50,265 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2026-03-13T21:21:50,266 !! 2026-03-13T21:21:50,267 ******************************************************************************** 2026-03-13T21:21:50,267 ############################ 2026-03-13T21:21:50,268 # Package would be ignored # 2026-03-13T21:21:50,268 ############################ 2026-03-13T21:21:50,269 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2026-03-13T21:21:50,269 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,270 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,271 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2026-03-13T21:21:50,271 to the `packages` configuration field. 2026-03-13T21:21:50,272 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,273 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,274 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,274 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,275 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,276 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2026-03-13T21:21:50,276 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2026-03-13T21:21:50,277 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,277 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,278 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,279 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,279 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,281 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,282 even if it does not contain any `.py` files. 2026-03-13T21:21:50,283 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,284 directory, all directories are treated like packages. 2026-03-13T21:21:50,284 ******************************************************************************** 2026-03-13T21:21:50,285 !! 2026-03-13T21:21:50,286 check.warn(importable) 2026-03-13T21:21:50,286 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2026-03-13T21:21:50,287 !! 2026-03-13T21:21:50,288 ******************************************************************************** 2026-03-13T21:21:50,289 ############################ 2026-03-13T21:21:50,289 # Package would be ignored # 2026-03-13T21:21:50,290 ############################ 2026-03-13T21:21:50,290 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2026-03-13T21:21:50,291 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,292 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,293 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2026-03-13T21:21:50,294 to the `packages` configuration field. 2026-03-13T21:21:50,295 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,295 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,296 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,297 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,298 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,299 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2026-03-13T21:21:50,300 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2026-03-13T21:21:50,300 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,301 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,301 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,302 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,304 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,305 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,306 even if it does not contain any `.py` files. 2026-03-13T21:21:50,306 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,307 directory, all directories are treated like packages. 2026-03-13T21:21:50,307 ******************************************************************************** 2026-03-13T21:21:50,308 !! 2026-03-13T21:21:50,308 check.warn(importable) 2026-03-13T21:21:50,309 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2026-03-13T21:21:50,309 !! 2026-03-13T21:21:50,310 ******************************************************************************** 2026-03-13T21:21:50,311 ############################ 2026-03-13T21:21:50,312 # Package would be ignored # 2026-03-13T21:21:50,313 ############################ 2026-03-13T21:21:50,313 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2026-03-13T21:21:50,313 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,314 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,315 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2026-03-13T21:21:50,316 to the `packages` configuration field. 2026-03-13T21:21:50,317 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,317 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,318 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,319 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,320 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,321 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2026-03-13T21:21:50,322 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2026-03-13T21:21:50,322 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,323 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,324 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,325 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,326 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,328 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,329 even if it does not contain any `.py` files. 2026-03-13T21:21:50,329 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,330 directory, all directories are treated like packages. 2026-03-13T21:21:50,330 ******************************************************************************** 2026-03-13T21:21:50,331 !! 2026-03-13T21:21:50,332 check.warn(importable) 2026-03-13T21:21:50,332 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2026-03-13T21:21:50,333 !! 2026-03-13T21:21:50,334 ******************************************************************************** 2026-03-13T21:21:50,335 ############################ 2026-03-13T21:21:50,335 # Package would be ignored # 2026-03-13T21:21:50,336 ############################ 2026-03-13T21:21:50,336 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2026-03-13T21:21:50,336 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,338 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,338 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2026-03-13T21:21:50,339 to the `packages` configuration field. 2026-03-13T21:21:50,340 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,340 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,341 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,342 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,343 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,343 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2026-03-13T21:21:50,344 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2026-03-13T21:21:50,344 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,345 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,345 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,346 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,347 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,349 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,349 even if it does not contain any `.py` files. 2026-03-13T21:21:50,350 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,350 directory, all directories are treated like packages. 2026-03-13T21:21:50,350 ******************************************************************************** 2026-03-13T21:21:50,351 !! 2026-03-13T21:21:50,352 check.warn(importable) 2026-03-13T21:21:50,353 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration. 2026-03-13T21:21:50,353 !! 2026-03-13T21:21:50,354 ******************************************************************************** 2026-03-13T21:21:50,355 ############################ 2026-03-13T21:21:50,355 # Package would be ignored # 2026-03-13T21:21:50,356 ############################ 2026-03-13T21:21:50,356 Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1], 2026-03-13T21:21:50,357 but it is absent from setuptools' `packages` configuration. 2026-03-13T21:21:50,358 This leads to an ambiguous overall configuration. If you want to distribute this 2026-03-13T21:21:50,358 package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added 2026-03-13T21:21:50,359 to the `packages` configuration field. 2026-03-13T21:21:50,360 Alternatively, you can also rely on setuptools' discovery methods 2026-03-13T21:21:50,360 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2026-03-13T21:21:50,361 instead of `find_packages(...)`/`find:`). 2026-03-13T21:21:50,362 You can read more about "package discovery" on setuptools documentation page: 2026-03-13T21:21:50,363 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2026-03-13T21:21:50,364 If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are 2026-03-13T21:21:50,364 already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via 2026-03-13T21:21:50,365 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2026-03-13T21:21:50,365 you can try to use `exclude_package_data`, or `include-package-data=False` in 2026-03-13T21:21:50,366 combination with a more fine grained `package-data` configuration. 2026-03-13T21:21:50,367 You can read more about "package data files" on setuptools documentation page: 2026-03-13T21:21:50,368 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2026-03-13T21:21:50,370 [^1]: For Python, any directory (with suitable naming) can be imported, 2026-03-13T21:21:50,370 even if it does not contain any `.py` files. 2026-03-13T21:21:50,370 On the other hand, currently there is no concept of package data 2026-03-13T21:21:50,371 directory, all directories are treated like packages. 2026-03-13T21:21:50,371 ******************************************************************************** 2026-03-13T21:21:50,372 !! 2026-03-13T21:21:50,373 check.warn(importable) 2026-03-13T21:21:50,373 creating build/lib/deepspeed/ops/csrc/adagrad 2026-03-13T21:21:50,373 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2026-03-13T21:21:50,374 creating build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,374 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,375 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,375 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,376 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,376 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2026-03-13T21:21:50,377 creating build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,377 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,378 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,378 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,379 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,379 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,380 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:50,380 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,381 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,381 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,382 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,382 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,383 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,383 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,384 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,384 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,385 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,386 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,386 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,387 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,388 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,388 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,389 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,390 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,390 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:50,391 creating build/lib/deepspeed/ops/csrc/aio/py_test 2026-03-13T21:21:50,392 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2026-03-13T21:21:50,392 creating build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,392 copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,393 copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,393 copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,394 copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,394 copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,395 copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,395 copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,396 copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,397 copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile 2026-03-13T21:21:50,398 creating build/lib/deepspeed/ops/csrc/cpu/adam 2026-03-13T21:21:50,398 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2026-03-13T21:21:50,399 creating build/lib/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:50,399 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:50,400 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:50,401 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:50,402 copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:50,403 creating build/lib/deepspeed/ops/csrc/cpu/comm/arm64 2026-03-13T21:21:50,403 copying deepspeed/ops/csrc/cpu/comm/arm64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/arm64 2026-03-13T21:21:50,404 creating build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2026-03-13T21:21:50,404 copying deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/riscv64 2026-03-13T21:21:50,405 creating build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2026-03-13T21:21:50,405 copying deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/x86_64 2026-03-13T21:21:50,406 creating build/lib/deepspeed/ops/csrc/cpu/lion 2026-03-13T21:21:50,407 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2026-03-13T21:21:50,407 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,408 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,408 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,409 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,409 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,410 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,410 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:50,411 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:50,411 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:50,411 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:50,412 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:50,412 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:50,413 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,413 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,414 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,414 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,415 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,415 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,416 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,416 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:50,417 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,418 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,418 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,419 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,419 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,420 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,420 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,421 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:50,421 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:50,422 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:50,422 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:50,423 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:50,423 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:50,424 copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:50,425 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:50,425 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:50,425 copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:50,426 creating build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,427 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,427 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,428 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,428 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,428 copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,429 copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:50,430 creating build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,430 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,431 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,432 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,432 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,432 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,433 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,433 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,434 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,435 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,435 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,436 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,436 copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,437 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,440 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,442 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,445 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,447 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,449 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,451 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,454 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,456 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,459 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,462 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,464 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,467 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,469 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,473 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,475 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,478 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,480 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2026-03-13T21:21:50,483 creating build/lib/deepspeed/ops/csrc/lamb 2026-03-13T21:21:50,484 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2026-03-13T21:21:50,487 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2026-03-13T21:21:50,489 creating build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,490 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,493 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,496 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,498 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,500 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2026-03-13T21:21:50,503 creating build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,504 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,506 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,510 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,512 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,515 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,518 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,521 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2026-03-13T21:21:50,524 creating build/lib/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:50,525 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:50,528 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:50,530 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:50,533 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:50,536 creating build/lib/deepspeed/ops/csrc/sparse_attention 2026-03-13T21:21:50,537 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2026-03-13T21:21:50,539 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:50,541 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:50,543 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:50,546 creating build/lib/deepspeed/ops/csrc/spatial/includes 2026-03-13T21:21:50,546 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2026-03-13T21:21:50,549 creating build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,550 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,553 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,555 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,559 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,562 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,565 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,569 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,572 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2026-03-13T21:21:50,575 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,577 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,581 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,584 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,588 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,593 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,598 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,602 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,605 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,607 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,611 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:50,614 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:50,615 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:50,618 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:50,621 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:50,624 creating build/lib/deepspeed/ops/csrc/utils 2026-03-13T21:21:50,624 copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils 2026-03-13T21:21:50,627 copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils 2026-03-13T21:21:50,629 copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils 2026-03-13T21:21:50,631 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2026-03-13T21:21:50,632 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2026-03-13T21:21:50,635 creating build/lib/deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:50,636 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:50,638 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:50,641 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:50,644 creating build/lib/deepspeed/ops/csrc/xpu/common 2026-03-13T21:21:50,645 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2026-03-13T21:21:50,647 creating build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,648 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,651 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,653 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,656 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,658 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:50,661 creating build/lib/deepspeed/ops/csrc/xpu/packbits 2026-03-13T21:21:50,662 copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits 2026-03-13T21:21:50,664 creating build/lib/deepspeed/autotuning/config_templates 2026-03-13T21:21:50,665 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2026-03-13T21:21:50,667 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2026-03-13T21:21:50,669 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2026-03-13T21:21:50,671 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2026-03-13T21:21:50,673 creating build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,674 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,677 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,679 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,682 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,685 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:50,688 creating build/lib/deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:50,689 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:50,692 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:50,694 creating build/lib/deepspeed/inference/v2/ragged/includes 2026-03-13T21:21:50,695 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2026-03-13T21:21:50,697 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:50,699 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2026-03-13T21:21:50,700 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2026-03-13T21:21:50,703 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:50,703 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:50,706 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:50,708 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:50,710 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:50,712 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2026-03-13T21:21:50,713 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2026-03-13T21:21:50,716 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:50,718 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:50,720 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:50,722 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:50,724 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:50,727 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:50,729 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:50,731 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:50,734 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:50,736 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:50,738 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:50,741 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:50,744 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:50,746 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:50,749 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:50,752 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:50,755 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:50,760 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:50,764 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:50,767 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:50,769 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:50,771 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:50,773 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:50,776 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:50,779 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:50,781 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:50,783 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:50,786 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:50,788 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:50,790 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:50,793 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:50,795 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:50,798 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:50,800 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:50,802 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:50,805 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:50,808 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:50,810 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:50,813 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:50,815 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:50,818 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:50,820 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:50,822 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:50,825 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:50,827 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:50,829 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:50,832 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:50,835 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:50,838 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:50,840 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:50,842 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:50,845 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:50,847 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,848 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,851 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,854 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,856 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,858 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,861 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,864 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,867 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,870 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:50,873 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:50,876 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:50,879 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:50,882 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:50,885 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:50,888 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:50,968 running build_scripts 2026-03-13T21:21:50,969 creating build/scripts-3.11 2026-03-13T21:21:50,970 copying and adjusting bin/deepspeed -> build/scripts-3.11 2026-03-13T21:21:50,971 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2026-03-13T21:21:50,973 copying and adjusting bin/ds -> build/scripts-3.11 2026-03-13T21:21:50,974 copying bin/ds_ssh -> build/scripts-3.11 2026-03-13T21:21:50,976 copying and adjusting bin/ds_report -> build/scripts-3.11 2026-03-13T21:21:50,978 copying and adjusting bin/ds_bench -> build/scripts-3.11 2026-03-13T21:21:50,979 copying and adjusting bin/dsr -> build/scripts-3.11 2026-03-13T21:21:50,981 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2026-03-13T21:21:50,982 copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11 2026-03-13T21:21:50,984 copying and adjusting bin/ds_io -> build/scripts-3.11 2026-03-13T21:21:50,985 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2026-03-13T21:21:50,985 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2026-03-13T21:21:50,986 changing mode of build/scripts-3.11/ds from 644 to 755 2026-03-13T21:21:50,987 changing mode of build/scripts-3.11/ds_report from 644 to 755 2026-03-13T21:21:50,987 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2026-03-13T21:21:50,988 changing mode of build/scripts-3.11/dsr from 644 to 755 2026-03-13T21:21:50,988 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2026-03-13T21:21:50,989 changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755 2026-03-13T21:21:50,989 changing mode of build/scripts-3.11/ds_io from 644 to 755 2026-03-13T21:21:51,015 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2026-03-13T21:21:51,016 !! 2026-03-13T21:21:51,017 ******************************************************************************** 2026-03-13T21:21:51,017 Please avoid running ``setup.py`` directly. 2026-03-13T21:21:51,018 Instead, use pypa/build, pypa/installer or other 2026-03-13T21:21:51,018 standards-based tools. 2026-03-13T21:21:51,019 This deprecation is overdue, please update your project and remove deprecated 2026-03-13T21:21:51,020 calls to avoid build errors in the future. 2026-03-13T21:21:51,021 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2026-03-13T21:21:51,022 ******************************************************************************** 2026-03-13T21:21:51,023 !! 2026-03-13T21:21:51,024 self.initialize_options() 2026-03-13T21:21:51,043 installing to build/bdist.linux-armv7l/wheel 2026-03-13T21:21:51,044 running install 2026-03-13T21:21:51,067 running install_lib 2026-03-13T21:21:51,094 creating build/bdist.linux-armv7l/wheel 2026-03-13T21:21:51,097 creating build/bdist.linux-armv7l/wheel/deepspeed 2026-03-13T21:21:51,098 creating build/bdist.linux-armv7l/wheel/deepspeed/nvme 2026-03-13T21:21:51,100 copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,102 copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,103 copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,106 copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,108 copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,110 copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,111 copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,113 copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,115 copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,117 copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,119 copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,121 copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,123 copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,125 copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,127 copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,129 copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme 2026-03-13T21:21:51,132 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2026-03-13T21:21:51,133 copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,136 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zenflow 2026-03-13T21:21:51,137 copying build/lib/deepspeed/runtime/zenflow/engine_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,140 copying build/lib/deepspeed/runtime/zenflow/zenflow_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,142 copying build/lib/deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,145 copying build/lib/deepspeed/runtime/zenflow/zenflow_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,147 copying build/lib/deepspeed/runtime/zenflow/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,148 copying build/lib/deepspeed/runtime/zenflow/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow 2026-03-13T21:21:51,151 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2026-03-13T21:21:51,152 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2026-03-13T21:21:51,154 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression 2026-03-13T21:21:51,156 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,158 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,161 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,164 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/superoffload 2026-03-13T21:21:51,165 copying build/lib/deepspeed/runtime/superoffload/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2026-03-13T21:21:51,166 copying build/lib/deepspeed/runtime/superoffload/superoffload_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2026-03-13T21:21:51,169 copying build/lib/deepspeed/runtime/superoffload/superoffload_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload 2026-03-13T21:21:51,171 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,174 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,176 copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,178 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,181 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,183 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,186 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2026-03-13T21:21:51,187 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,189 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,192 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,195 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,197 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,200 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe 2026-03-13T21:21:51,204 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel 2026-03-13T21:21:51,205 copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2026-03-13T21:21:51,207 copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2026-03-13T21:21:51,209 copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel 2026-03-13T21:21:51,213 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,216 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,218 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,221 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino 2026-03-13T21:21:51,222 copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2026-03-13T21:21:51,224 copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2026-03-13T21:21:51,227 copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino 2026-03-13T21:21:51,230 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,231 copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,233 copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,235 copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,237 copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,239 copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,241 copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing 2026-03-13T21:21:51,243 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,246 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,250 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel 2026-03-13T21:21:51,251 copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2026-03-13T21:21:51,253 copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2026-03-13T21:21:51,255 copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2026-03-13T21:21:51,257 copying build/lib/deepspeed/runtime/tensor_parallel/init_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel 2026-03-13T21:21:51,259 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:51,260 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:51,262 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:51,264 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing 2026-03-13T21:21:51,267 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,270 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2026-03-13T21:21:51,272 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,274 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero/muon 2026-03-13T21:21:51,275 copying build/lib/deepspeed/runtime/zero/muon/original_muon.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2026-03-13T21:21:51,278 copying build/lib/deepspeed/runtime/zero/muon/muon_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2026-03-13T21:21:51,280 copying build/lib/deepspeed/runtime/zero/muon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon 2026-03-13T21:21:51,282 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,287 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,289 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,295 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,297 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,299 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,301 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,304 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,305 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,307 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,310 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,315 copying build/lib/deepspeed/runtime/zero/leaf_module_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,317 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,319 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,321 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,324 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,326 copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero 2026-03-13T21:21:51,329 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,330 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,332 copying build/lib/deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,334 copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,336 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,338 copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,340 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,342 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,344 copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine 2026-03-13T21:21:51,347 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2026-03-13T21:21:51,348 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,350 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,352 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,355 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,357 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,359 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,361 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling 2026-03-13T21:21:51,365 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,366 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,368 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,370 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,372 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,374 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing 2026-03-13T21:21:51,376 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2026-03-13T21:21:51,378 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2026-03-13T21:21:51,380 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2026-03-13T21:21:51,382 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline 2026-03-13T21:21:51,385 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,386 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,389 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,391 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,393 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,395 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,398 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,400 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,402 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,405 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor 2026-03-13T21:21:51,406 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,409 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,412 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,414 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime 2026-03-13T21:21:51,420 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2026-03-13T21:21:51,421 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,423 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,425 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,427 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,430 copying build/lib/deepspeed/runtime/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,432 copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,434 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm 2026-03-13T21:21:51,436 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2026-03-13T21:21:51,437 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2026-03-13T21:21:51,440 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2026-03-13T21:21:51,443 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2026-03-13T21:21:51,445 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16 2026-03-13T21:21:51,448 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2026-03-13T21:21:51,449 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2026-03-13T21:21:51,452 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2026-03-13T21:21:51,453 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2026-03-13T21:21:51,456 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit 2026-03-13T21:21:51,459 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2026-03-13T21:21:51,461 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2026-03-13T21:21:51,462 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2026-03-13T21:21:51,464 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2026-03-13T21:21:51,466 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers 2026-03-13T21:21:51,469 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2026-03-13T21:21:51,470 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2026-03-13T21:21:51,472 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features 2026-03-13T21:21:51,474 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations 2026-03-13T21:21:51,476 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2026-03-13T21:21:51,477 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,479 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,481 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,483 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,485 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,487 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,489 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,490 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,492 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,494 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers 2026-03-13T21:21:51,497 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2026-03-13T21:21:51,498 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2026-03-13T21:21:51,500 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2026-03-13T21:21:51,502 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula 2026-03-13T21:21:51,504 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2026-03-13T21:21:51,505 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,508 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,511 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,513 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,516 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,517 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,520 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,522 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression 2026-03-13T21:21:51,524 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:51,526 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:51,529 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2026-03-13T21:21:51,530 copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2026-03-13T21:21:51,532 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2026-03-13T21:21:51,534 copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2026-03-13T21:21:51,537 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence 2026-03-13T21:21:51,540 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2026-03-13T21:21:51,542 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2026-03-13T21:21:51,543 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2026-03-13T21:21:51,545 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2026-03-13T21:21:51,547 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2026-03-13T21:21:51,549 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2026-03-13T21:21:51,551 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization 2026-03-13T21:21:51,553 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2026-03-13T21:21:51,555 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2026-03-13T21:21:51,558 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2026-03-13T21:21:51,559 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,561 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:51,563 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:51,565 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:51,567 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:51,569 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe 2026-03-13T21:21:51,572 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,573 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,575 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,577 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,578 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,580 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,582 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,584 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,586 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,588 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding 2026-03-13T21:21:51,591 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:51,592 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:51,594 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:51,596 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:51,597 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon 2026-03-13T21:21:51,600 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:51,601 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:51,603 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:51,605 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:51,607 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral 2026-03-13T21:21:51,609 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:51,611 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:51,613 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:51,615 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:51,617 copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3 2026-03-13T21:21:51,619 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,621 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:51,622 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:51,624 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:51,626 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:51,628 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi 2026-03-13T21:21:51,630 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:51,631 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:51,633 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:51,635 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:51,636 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2 2026-03-13T21:21:51,639 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,642 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:51,643 copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:51,645 copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:51,646 copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:51,648 copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4 2026-03-13T21:21:51,650 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,653 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,656 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:51,657 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:51,659 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:51,660 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:51,662 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral 2026-03-13T21:21:51,665 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,667 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,669 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,671 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,673 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,675 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,677 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,678 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,680 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,682 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters 2026-03-13T21:21:51,684 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,686 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,689 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:51,690 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:51,692 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:51,694 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:51,696 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen 2026-03-13T21:21:51,699 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:51,700 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:51,702 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:51,704 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:51,706 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt 2026-03-13T21:21:51,709 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations 2026-03-13T21:21:51,712 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:51,713 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:51,715 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:51,717 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:51,719 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2 2026-03-13T21:21:51,721 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:51,725 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2026-03-13T21:21:51,727 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:51,728 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:51,729 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:51,732 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:51,734 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:51,735 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2026-03-13T21:21:51,738 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,739 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,741 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,743 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,744 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,746 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,748 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2026-03-13T21:21:51,751 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,752 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,754 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,756 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,758 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,760 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,761 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2026-03-13T21:21:51,764 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,765 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,767 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,769 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,770 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,772 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,774 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2026-03-13T21:21:51,777 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:51,778 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:51,780 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:51,781 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2026-03-13T21:21:51,783 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:51,786 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,787 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,789 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,791 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,793 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,795 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,797 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2026-03-13T21:21:51,799 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,800 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,802 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,804 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,806 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,808 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,810 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,812 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,814 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2026-03-13T21:21:51,816 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2026-03-13T21:21:51,817 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes 2026-03-13T21:21:51,820 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,821 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,823 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,825 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,827 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,828 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,830 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed 2026-03-13T21:21:51,833 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,834 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,837 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,839 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,840 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,842 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,844 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2026-03-13T21:21:51,846 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops 2026-03-13T21:21:51,848 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2026-03-13T21:21:51,849 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels 2026-03-13T21:21:51,852 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,853 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,855 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,857 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,859 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,861 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes 2026-03-13T21:21:51,865 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:51,867 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,868 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,870 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,872 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,874 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,876 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2026-03-13T21:21:51,878 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,879 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,881 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,883 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,885 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,887 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,889 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2026-03-13T21:21:51,891 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:51,893 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2026-03-13T21:21:51,894 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2026-03-13T21:21:51,896 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops 2026-03-13T21:21:51,898 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:51,900 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,901 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,903 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,905 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,907 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,908 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,911 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,913 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2026-03-13T21:21:51,916 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,917 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,919 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,921 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,923 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,925 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,927 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,929 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,931 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2026-03-13T21:21:51,934 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,935 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,937 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,939 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,941 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,943 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations 2026-03-13T21:21:51,945 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:51,946 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:51,948 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:51,951 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:51,954 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels 2026-03-13T21:21:51,958 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,959 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,961 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,963 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,965 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,968 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,971 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,972 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,974 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,976 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,978 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,980 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,982 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,984 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,987 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,989 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2026-03-13T21:21:51,991 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear 2026-03-13T21:21:51,993 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:51,996 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:51,997 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:51,999 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:52,001 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:52,003 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:52,005 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations 2026-03-13T21:21:52,007 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops 2026-03-13T21:21:52,009 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2026-03-13T21:21:52,011 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,014 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,017 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:52,018 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:52,019 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc 2026-03-13T21:21:52,021 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,024 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2026-03-13T21:21:52,025 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes 2026-03-13T21:21:52,026 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,029 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,031 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,033 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged 2026-03-13T21:21:52,036 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,037 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,039 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,041 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,043 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,045 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,047 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2026-03-13T21:21:52,049 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,050 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,052 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,054 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,056 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,057 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,059 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,061 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs 2026-03-13T21:21:52,063 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2026-03-13T21:21:52,066 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2026-03-13T21:21:52,067 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:52,068 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:52,070 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:52,293 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear 2026-03-13T21:21:52,295 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:52,296 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:52,298 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention 2026-03-13T21:21:52,300 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations 2026-03-13T21:21:52,303 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:52,305 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:52,306 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe 2026-03-13T21:21:52,309 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:52,310 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:52,312 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm 2026-03-13T21:21:52,315 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:52,316 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:52,318 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed 2026-03-13T21:21:52,321 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:52,322 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:52,324 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:52,326 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm 2026-03-13T21:21:52,328 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:52,330 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:52,332 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding 2026-03-13T21:21:52,333 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2026-03-13T21:21:52,335 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2026-03-13T21:21:52,338 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,339 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,341 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,343 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,345 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,347 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,349 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,351 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,353 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces 2026-03-13T21:21:52,354 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules 2026-03-13T21:21:52,356 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,358 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2 2026-03-13T21:21:52,360 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2026-03-13T21:21:52,361 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2026-03-13T21:21:52,364 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2026-03-13T21:21:52,365 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2026-03-13T21:21:52,367 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint 2026-03-13T21:21:52,369 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference 2026-03-13T21:21:52,373 creating build/bdist.linux-armv7l/wheel/deepspeed/linear 2026-03-13T21:21:52,374 copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2026-03-13T21:21:52,377 copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2026-03-13T21:21:52,379 copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2026-03-13T21:21:52,382 copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2026-03-13T21:21:52,384 copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear 2026-03-13T21:21:52,388 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2026-03-13T21:21:52,389 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2026-03-13T21:21:52,392 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2026-03-13T21:21:52,394 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2026-03-13T21:21:52,398 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler 2026-03-13T21:21:52,400 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2026-03-13T21:21:52,402 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling 2026-03-13T21:21:52,406 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2026-03-13T21:21:52,407 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,410 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,413 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,415 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,418 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,420 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher 2026-03-13T21:21:52,426 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:52,430 creating build/bdist.linux-armv7l/wheel/deepspeed/datastates 2026-03-13T21:21:52,431 copying build/lib/deepspeed/datastates/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2026-03-13T21:21:52,434 copying build/lib/deepspeed/datastates/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates 2026-03-13T21:21:52,437 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2026-03-13T21:21:52,438 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,442 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,445 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,447 copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,450 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,452 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,455 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,457 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,461 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,463 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,466 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,469 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,472 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,474 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,476 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,479 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,481 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,483 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils 2026-03-13T21:21:52,486 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2026-03-13T21:21:52,487 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe 2026-03-13T21:21:52,490 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2026-03-13T21:21:52,491 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,493 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,496 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,498 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,499 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,502 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe 2026-03-13T21:21:52,504 copying build/lib/deepspeed/compat.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:52,506 creating build/bdist.linux-armv7l/wheel/deepspeed/io 2026-03-13T21:21:52,507 copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,509 copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,511 copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,513 copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,516 copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,518 copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,520 copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,522 copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,523 copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,525 copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io 2026-03-13T21:21:52,527 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2026-03-13T21:21:52,529 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds 2026-03-13T21:21:52,530 copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds 2026-03-13T21:21:52,533 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2026-03-13T21:21:52,534 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2026-03-13T21:21:52,535 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2026-03-13T21:21:52,538 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2026-03-13T21:21:52,540 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion 2026-03-13T21:21:52,543 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2026-03-13T21:21:52,544 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,545 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,548 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,550 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,552 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,555 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,557 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,560 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization 2026-03-13T21:21:52,563 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2026-03-13T21:21:52,565 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:52,566 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:52,568 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc 2026-03-13T21:21:52,570 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2026-03-13T21:21:52,571 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes 2026-03-13T21:21:52,574 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2026-03-13T21:21:52,575 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2026-03-13T21:21:52,576 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common 2026-03-13T21:21:52,579 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2026-03-13T21:21:52,580 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad 2026-03-13T21:21:52,583 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:52,584 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:52,587 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:52,589 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam 2026-03-13T21:21:52,592 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,593 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,595 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,597 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,599 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,601 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes 2026-03-13T21:21:52,604 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits 2026-03-13T21:21:52,605 copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits 2026-03-13T21:21:52,608 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds 2026-03-13T21:21:52,609 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,611 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,613 copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,615 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,617 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,618 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,621 copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib 2026-03-13T21:21:52,624 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2026-03-13T21:21:52,625 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2026-03-13T21:21:52,627 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion 2026-03-13T21:21:52,629 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2026-03-13T21:21:52,630 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam 2026-03-13T21:21:52,633 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:52,634 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/x86_64 2026-03-13T21:21:52,636 copying build/lib/deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/x86_64 2026-03-13T21:21:52,639 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:52,641 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/riscv64 2026-03-13T21:21:52,642 copying build/lib/deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/riscv64 2026-03-13T21:21:52,644 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:52,647 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/arm64 2026-03-13T21:21:52,648 copying build/lib/deepspeed/ops/csrc/cpu/comm/arm64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/arm64 2026-03-13T21:21:52,650 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:52,653 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm 2026-03-13T21:21:52,656 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2026-03-13T21:21:52,657 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2026-03-13T21:21:52,659 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2026-03-13T21:21:52,661 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2026-03-13T21:21:52,663 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2026-03-13T21:21:52,665 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion 2026-03-13T21:21:52,668 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2026-03-13T21:21:52,669 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad 2026-03-13T21:21:52,672 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2026-03-13T21:21:52,673 copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2026-03-13T21:21:52,674 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2026-03-13T21:21:52,676 copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils 2026-03-13T21:21:52,679 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2026-03-13T21:21:52,680 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention 2026-03-13T21:21:52,683 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2026-03-13T21:21:52,684 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2026-03-13T21:21:52,686 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2026-03-13T21:21:52,688 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2026-03-13T21:21:52,690 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2026-03-13T21:21:52,692 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam 2026-03-13T21:21:52,695 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2026-03-13T21:21:52,696 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2026-03-13T21:21:52,698 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb 2026-03-13T21:21:52,701 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:52,702 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:52,705 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:52,707 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:52,709 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd 2026-03-13T21:21:52,713 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2026-03-13T21:21:52,714 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,716 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,718 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,720 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,722 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,725 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,727 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,729 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,731 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,734 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,736 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,738 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,740 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,742 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,744 copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,747 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,749 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,751 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,753 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,755 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,757 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,759 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,761 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,764 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,766 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,769 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,771 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,773 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,775 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,777 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes 2026-03-13T21:21:52,780 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2026-03-13T21:21:52,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,783 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,785 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,788 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,789 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,791 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,793 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common 2026-03-13T21:21:52,796 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2026-03-13T21:21:52,797 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test 2026-03-13T21:21:52,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,800 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,803 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,805 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,807 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,809 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,811 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,813 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,815 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,817 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,819 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,821 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,822 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,825 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,826 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,828 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,830 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,832 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib 2026-03-13T21:21:52,835 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile 2026-03-13T21:21:52,836 copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,838 copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,840 copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,842 copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,845 copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,847 copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,849 copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,851 copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,853 copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile 2026-03-13T21:21:52,855 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2026-03-13T21:21:52,857 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,859 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:52,860 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:52,863 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:52,865 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:52,868 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2026-03-13T21:21:52,870 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,872 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,874 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,878 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,880 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,883 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,886 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,888 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2026-03-13T21:21:52,890 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,893 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,896 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,898 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,900 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,902 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2026-03-13T21:21:52,907 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,908 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,910 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,913 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,915 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,919 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,921 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,924 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2026-03-13T21:21:52,927 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:52,928 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:52,930 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2026-03-13T21:21:52,933 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,934 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2026-03-13T21:21:52,936 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,937 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,942 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,945 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,948 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,950 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,951 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,954 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,956 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,959 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,961 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc 2026-03-13T21:21:52,964 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:52,965 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:52,968 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:52,971 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes 2026-03-13T21:21:52,973 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,976 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,980 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,983 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,985 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,988 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,991 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,994 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer 2026-03-13T21:21:52,997 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:52,998 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:53,001 copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer 2026-03-13T21:21:53,005 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:53,006 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:53,008 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes 2026-03-13T21:21:53,011 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2026-03-13T21:21:53,012 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2026-03-13T21:21:53,014 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad 2026-03-13T21:21:53,016 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops 2026-03-13T21:21:53,018 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2026-03-13T21:21:53,019 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,022 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,025 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,027 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,029 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,032 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,034 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention 2026-03-13T21:21:53,037 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:53,038 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:53,040 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:53,043 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:53,045 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc 2026-03-13T21:21:53,048 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2026-03-13T21:21:53,049 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,051 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,053 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,055 copying build/lib/deepspeed/ops/adam/zenflow_torch_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,058 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,060 copying build/lib/deepspeed/ops/adam/zenflow_cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam 2026-03-13T21:21:53,063 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2026-03-13T21:21:53,064 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2026-03-13T21:21:53,066 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb 2026-03-13T21:21:53,069 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2026-03-13T21:21:53,071 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2026-03-13T21:21:53,073 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd 2026-03-13T21:21:53,076 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2026-03-13T21:21:53,077 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,079 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,082 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,084 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,086 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,087 copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,089 copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,091 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,093 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,097 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,099 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,101 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu 2026-03-13T21:21:53,102 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,105 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,106 copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,108 copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,110 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,112 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,114 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,117 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,118 copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,120 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,122 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu 2026-03-13T21:21:53,125 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,127 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,128 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,130 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,132 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,134 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,136 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,138 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,139 copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu 2026-03-13T21:21:53,141 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,143 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,145 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,147 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,149 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,151 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,153 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,156 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,158 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,159 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,162 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,163 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,166 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,168 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,170 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,172 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,174 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,176 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,178 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,181 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu 2026-03-13T21:21:53,184 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,187 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,188 copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,191 copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,193 copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,196 copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,198 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,201 copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu 2026-03-13T21:21:53,203 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,205 copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,208 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,210 copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,213 copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,215 copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,217 copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,220 copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa 2026-03-13T21:21:53,222 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,225 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,227 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,230 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,233 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,235 copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,238 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder 2026-03-13T21:21:53,241 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2026-03-13T21:21:53,242 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio 2026-03-13T21:21:53,246 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile 2026-03-13T21:21:53,247 copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile 2026-03-13T21:21:53,250 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2026-03-13T21:21:53,252 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2026-03-13T21:21:53,254 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science 2026-03-13T21:21:53,258 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2026-03-13T21:21:53,260 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2026-03-13T21:21:53,262 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,265 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,268 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,272 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,275 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,277 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,279 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,281 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,284 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,286 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,287 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,290 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,292 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,294 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,296 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,299 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,302 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,304 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,306 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,308 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton 2026-03-13T21:21:53,311 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference 2026-03-13T21:21:53,314 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,315 copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,317 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,319 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,321 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,323 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,325 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,327 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,329 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,331 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,333 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,335 copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,336 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,339 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,341 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,344 copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,346 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,347 copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,349 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,351 copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,354 copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,356 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,358 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,359 copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding 2026-03-13T21:21:53,361 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2026-03-13T21:21:53,363 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer 2026-03-13T21:21:53,367 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2026-03-13T21:21:53,368 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2026-03-13T21:21:53,370 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2026-03-13T21:21:53,372 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2026-03-13T21:21:53,374 copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer 2026-03-13T21:21:53,377 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2026-03-13T21:21:53,378 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2026-03-13T21:21:53,380 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer 2026-03-13T21:21:53,382 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2026-03-13T21:21:53,383 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,386 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,389 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,391 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,393 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,395 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity 2026-03-13T21:21:53,397 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:53,399 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2026-03-13T21:21:53,400 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,404 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2026-03-13T21:21:53,406 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,408 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,410 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,411 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,413 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,415 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner 2026-03-13T21:21:53,417 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,420 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,422 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2026-03-13T21:21:53,423 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2026-03-13T21:21:53,426 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2026-03-13T21:21:53,428 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2026-03-13T21:21:53,429 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates 2026-03-13T21:21:53,431 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,433 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,435 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning 2026-03-13T21:21:53,438 creating build/bdist.linux-armv7l/wheel/deepspeed/compile 2026-03-13T21:21:53,439 copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,441 copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,443 copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,445 copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,446 copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,448 copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,450 copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,453 copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,454 copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,456 copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,459 copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,462 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes 2026-03-13T21:21:53,463 copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,465 copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,466 copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,469 copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,470 copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,473 copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,475 copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,477 copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes 2026-03-13T21:21:53,479 copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,482 creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers 2026-03-13T21:21:53,483 copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2026-03-13T21:21:53,485 copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2026-03-13T21:21:53,488 copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers 2026-03-13T21:21:53,489 copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,492 copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile 2026-03-13T21:21:53,494 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2026-03-13T21:21:53,495 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,498 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,500 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,502 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,504 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,507 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,510 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,511 copying build/lib/deepspeed/module_inject/autotp_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,514 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,516 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,518 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,522 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2026-03-13T21:21:53,523 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,525 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,527 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,529 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,531 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2026-03-13T21:21:53,532 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,534 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,537 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,539 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,541 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,543 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,545 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features 2026-03-13T21:21:53,548 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,549 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,551 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,553 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,555 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,557 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,559 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,561 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,562 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,564 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,566 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,568 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,571 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,573 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,575 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers 2026-03-13T21:21:53,577 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,580 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,581 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject 2026-03-13T21:21:53,583 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed 2026-03-13T21:21:53,586 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2026-03-13T21:21:53,587 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,589 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,590 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,593 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,595 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,598 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,600 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,602 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,604 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm 2026-03-13T21:21:53,606 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2026-03-13T21:21:53,607 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,610 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,612 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,615 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,617 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,619 copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,621 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,623 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,626 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,628 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,630 copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator 2026-03-13T21:21:53,633 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2026-03-13T21:21:53,634 copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,635 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,637 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,640 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,641 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,643 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,645 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,646 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor 2026-03-13T21:21:53,649 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2026-03-13T21:21:53,650 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,652 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,654 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,656 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,658 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,661 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,663 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,665 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,667 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,669 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint 2026-03-13T21:21:53,671 running install_egg_info 2026-03-13T21:21:53,704 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.18.8-py3.11.egg-info 2026-03-13T21:21:53,718 running install_scripts 2026-03-13T21:21:53,719 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,720 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,722 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,724 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,726 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,727 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,729 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,730 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,732 copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,734 copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,736 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts 2026-03-13T21:21:53,737 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_ssh to 755 2026-03-13T21:21:53,738 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/deepspeed to 755 2026-03-13T21:21:53,738 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_elastic to 755 2026-03-13T21:21:53,739 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/dsr to 755 2026-03-13T21:21:53,739 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/deepspeed.pt to 755 2026-03-13T21:21:53,740 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_report to 755 2026-03-13T21:21:53,740 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds to 755 2026-03-13T21:21:53,741 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_io to 755 2026-03-13T21:21:53,741 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_nvme_tune to 755 2026-03-13T21:21:53,742 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.data/scripts/ds_bench to 755 2026-03-13T21:21:53,754 creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.8.dist-info/WHEEL 2026-03-13T21:21:53,756 creating '/tmp/pip-wheel-7j0432_x/deepspeed-0.18.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-03-13T21:21:53,760 adding 'deepspeed/__init__.py' 2026-03-13T21:21:53,762 adding 'deepspeed/compat.py' 2026-03-13T21:21:53,763 adding 'deepspeed/constants.py' 2026-03-13T21:21:53,765 adding 'deepspeed/env_report.py' 2026-03-13T21:21:53,766 adding 'deepspeed/git_version_info.py' 2026-03-13T21:21:53,768 adding 'deepspeed/git_version_info_installed.py' 2026-03-13T21:21:53,769 adding 'deepspeed/accelerator/__init__.py' 2026-03-13T21:21:53,771 adding 'deepspeed/accelerator/abstract_accelerator.py' 2026-03-13T21:21:53,773 adding 'deepspeed/accelerator/cpu_accelerator.py' 2026-03-13T21:21:53,775 adding 'deepspeed/accelerator/cuda_accelerator.py' 2026-03-13T21:21:53,777 adding 'deepspeed/accelerator/hpu_accelerator.py' 2026-03-13T21:21:53,778 adding 'deepspeed/accelerator/mlu_accelerator.py' 2026-03-13T21:21:53,780 adding 'deepspeed/accelerator/mps_accelerator.py' 2026-03-13T21:21:53,781 adding 'deepspeed/accelerator/npu_accelerator.py' 2026-03-13T21:21:53,783 adding 'deepspeed/accelerator/real_accelerator.py' 2026-03-13T21:21:53,785 adding 'deepspeed/accelerator/sdaa_accelerator.py' 2026-03-13T21:21:53,786 adding 'deepspeed/accelerator/xpu_accelerator.py' 2026-03-13T21:21:53,788 adding 'deepspeed/autotuning/__init__.py' 2026-03-13T21:21:53,793 adding 'deepspeed/autotuning/autotuner.py' 2026-03-13T21:21:53,796 adding 'deepspeed/autotuning/config.py' 2026-03-13T21:21:53,798 adding 'deepspeed/autotuning/constants.py' 2026-03-13T21:21:53,800 adding 'deepspeed/autotuning/scheduler.py' 2026-03-13T21:21:53,802 adding 'deepspeed/autotuning/utils.py' 2026-03-13T21:21:53,804 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2026-03-13T21:21:53,805 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2026-03-13T21:21:53,807 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2026-03-13T21:21:53,808 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2026-03-13T21:21:53,810 adding 'deepspeed/autotuning/tuner/__init__.py' 2026-03-13T21:21:53,811 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2026-03-13T21:21:53,812 adding 'deepspeed/autotuning/tuner/cost_model.py' 2026-03-13T21:21:53,813 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2026-03-13T21:21:53,815 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2026-03-13T21:21:53,816 adding 'deepspeed/autotuning/tuner/utils.py' 2026-03-13T21:21:53,818 adding 'deepspeed/checkpoint/__init__.py' 2026-03-13T21:21:53,819 adding 'deepspeed/checkpoint/constants.py' 2026-03-13T21:21:53,821 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2026-03-13T21:21:53,824 adding 'deepspeed/checkpoint/ds_to_universal.py' 2026-03-13T21:21:53,826 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2026-03-13T21:21:53,827 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2026-03-13T21:21:53,829 adding 'deepspeed/checkpoint/reshape_utils.py' 2026-03-13T21:21:53,830 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2026-03-13T21:21:53,832 adding 'deepspeed/checkpoint/utils.py' 2026-03-13T21:21:53,833 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2026-03-13T21:21:53,835 adding 'deepspeed/comm/__init__.py' 2026-03-13T21:21:53,836 adding 'deepspeed/comm/backend.py' 2026-03-13T21:21:53,838 adding 'deepspeed/comm/ccl.py' 2026-03-13T21:21:53,842 adding 'deepspeed/comm/comm.py' 2026-03-13T21:21:53,844 adding 'deepspeed/comm/config.py' 2026-03-13T21:21:53,845 adding 'deepspeed/comm/constants.py' 2026-03-13T21:21:53,846 adding 'deepspeed/comm/reduce_op.py' 2026-03-13T21:21:53,848 adding 'deepspeed/comm/torch.py' 2026-03-13T21:21:53,850 adding 'deepspeed/comm/utils.py' 2026-03-13T21:21:53,852 adding 'deepspeed/compile/__init__.py' 2026-03-13T21:21:53,854 adding 'deepspeed/compile/backend.py' 2026-03-13T21:21:53,855 adding 'deepspeed/compile/config.py' 2026-03-13T21:21:53,857 adding 'deepspeed/compile/fx.py' 2026-03-13T21:21:53,858 adding 'deepspeed/compile/graph_param.py' 2026-03-13T21:21:53,860 adding 'deepspeed/compile/inductor.py' 2026-03-13T21:21:53,862 adding 'deepspeed/compile/init_z1.py' 2026-03-13T21:21:53,863 adding 'deepspeed/compile/init_z3.py' 2026-03-13T21:21:53,865 adding 'deepspeed/compile/input_storage.py' 2026-03-13T21:21:53,867 adding 'deepspeed/compile/list_schedule.py' 2026-03-13T21:21:53,868 adding 'deepspeed/compile/partitioner.py' 2026-03-13T21:21:53,870 adding 'deepspeed/compile/patch_compiled_func.py' 2026-03-13T21:21:53,871 adding 'deepspeed/compile/patch_fake_tensor.py' 2026-03-13T21:21:53,874 adding 'deepspeed/compile/util.py' 2026-03-13T21:21:53,876 adding 'deepspeed/compile/passes/__init__.py' 2026-03-13T21:21:53,877 adding 'deepspeed/compile/passes/offload_activation.py' 2026-03-13T21:21:53,879 adding 'deepspeed/compile/passes/offload_adam_states.py' 2026-03-13T21:21:53,881 adding 'deepspeed/compile/passes/offload_parameters.py' 2026-03-13T21:21:53,883 adding 'deepspeed/compile/passes/prefetch.py' 2026-03-13T21:21:53,884 adding 'deepspeed/compile/passes/selective_gather.py' 2026-03-13T21:21:53,885 adding 'deepspeed/compile/passes/zero1_compile.py' 2026-03-13T21:21:53,887 adding 'deepspeed/compile/passes/zero3_compile.py' 2026-03-13T21:21:53,889 adding 'deepspeed/compile/profilers/__init__.py' 2026-03-13T21:21:53,890 adding 'deepspeed/compile/profilers/comm_profile.py' 2026-03-13T21:21:53,892 adding 'deepspeed/compile/profilers/graph_profile.py' 2026-03-13T21:21:53,894 adding 'deepspeed/compression/__init__.py' 2026-03-13T21:21:53,897 adding 'deepspeed/compression/basic_layer.py' 2026-03-13T21:21:53,899 adding 'deepspeed/compression/compress.py' 2026-03-13T21:21:53,901 adding 'deepspeed/compression/config.py' 2026-03-13T21:21:53,902 adding 'deepspeed/compression/constants.py' 2026-03-13T21:21:53,905 adding 'deepspeed/compression/helper.py' 2026-03-13T21:21:53,906 adding 'deepspeed/compression/scheduler.py' 2026-03-13T21:21:53,908 adding 'deepspeed/compression/utils.py' 2026-03-13T21:21:53,909 adding 'deepspeed/datastates/__init__.py' 2026-03-13T21:21:53,910 adding 'deepspeed/datastates/config.py' 2026-03-13T21:21:53,912 adding 'deepspeed/elasticity/__init__.py' 2026-03-13T21:21:53,914 adding 'deepspeed/elasticity/config.py' 2026-03-13T21:21:53,915 adding 'deepspeed/elasticity/constants.py' 2026-03-13T21:21:53,916 adding 'deepspeed/elasticity/elastic_agent.py' 2026-03-13T21:21:53,919 adding 'deepspeed/elasticity/elasticity.py' 2026-03-13T21:21:53,920 adding 'deepspeed/elasticity/utils.py' 2026-03-13T21:21:53,922 adding 'deepspeed/inference/__init__.py' 2026-03-13T21:21:53,924 adding 'deepspeed/inference/config.py' 2026-03-13T21:21:53,927 adding 'deepspeed/inference/engine.py' 2026-03-13T21:21:53,929 adding 'deepspeed/inference/quantization/__init__.py' 2026-03-13T21:21:53,930 adding 'deepspeed/inference/quantization/layers.py' 2026-03-13T21:21:53,932 adding 'deepspeed/inference/quantization/quantization.py' 2026-03-13T21:21:53,933 adding 'deepspeed/inference/quantization/quantization_context.py' 2026-03-13T21:21:53,935 adding 'deepspeed/inference/quantization/utils.py' 2026-03-13T21:21:53,937 adding 'deepspeed/inference/v2/__init__.py' 2026-03-13T21:21:53,938 adding 'deepspeed/inference/v2/allocator.py' 2026-03-13T21:21:53,939 adding 'deepspeed/inference/v2/config_v2.py' 2026-03-13T21:21:53,941 adding 'deepspeed/inference/v2/engine_factory.py' 2026-03-13T21:21:53,943 adding 'deepspeed/inference/v2/engine_v2.py' 2026-03-13T21:21:53,944 adding 'deepspeed/inference/v2/inference_parameter.py' 2026-03-13T21:21:53,945 adding 'deepspeed/inference/v2/inference_utils.py' 2026-03-13T21:21:53,947 adding 'deepspeed/inference/v2/logging.py' 2026-03-13T21:21:53,948 adding 'deepspeed/inference/v2/scheduling_utils.py' 2026-03-13T21:21:53,950 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2026-03-13T21:21:53,951 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2026-03-13T21:21:53,953 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2026-03-13T21:21:53,954 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2026-03-13T21:21:53,956 adding 'deepspeed/inference/v2/kernels/__init__.py' 2026-03-13T21:21:53,957 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2026-03-13T21:21:53,959 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2026-03-13T21:21:53,960 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2026-03-13T21:21:53,962 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2026-03-13T21:21:53,963 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2026-03-13T21:21:53,964 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2026-03-13T21:21:53,966 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2026-03-13T21:21:53,967 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2026-03-13T21:21:53,969 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2026-03-13T21:21:53,970 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2026-03-13T21:21:53,972 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2026-03-13T21:21:53,973 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2026-03-13T21:21:53,975 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2026-03-13T21:21:53,976 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2026-03-13T21:21:53,978 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2026-03-13T21:21:53,979 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2026-03-13T21:21:53,981 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2026-03-13T21:21:53,982 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2026-03-13T21:21:53,984 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2026-03-13T21:21:53,987 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2026-03-13T21:21:53,989 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2026-03-13T21:21:53,991 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2026-03-13T21:21:53,994 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2026-03-13T21:21:53,995 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2026-03-13T21:21:53,998 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2026-03-13T21:21:53,999 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2026-03-13T21:21:54,002 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2026-03-13T21:21:54,005 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2026-03-13T21:21:54,006 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2026-03-13T21:21:54,008 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2026-03-13T21:21:54,010 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2026-03-13T21:21:54,012 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2026-03-13T21:21:54,014 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2026-03-13T21:21:54,016 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2026-03-13T21:21:54,018 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2026-03-13T21:21:54,020 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2026-03-13T21:21:54,022 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2026-03-13T21:21:54,024 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2026-03-13T21:21:54,025 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2026-03-13T21:21:54,027 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2026-03-13T21:21:54,029 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2026-03-13T21:21:54,031 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2026-03-13T21:21:54,033 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2026-03-13T21:21:54,035 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2026-03-13T21:21:54,036 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2026-03-13T21:21:54,038 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2026-03-13T21:21:54,040 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2026-03-13T21:21:54,042 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2026-03-13T21:21:54,044 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2026-03-13T21:21:54,046 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2026-03-13T21:21:54,047 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2026-03-13T21:21:54,049 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2026-03-13T21:21:54,050 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2026-03-13T21:21:54,052 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2026-03-13T21:21:54,054 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2026-03-13T21:21:54,056 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2026-03-13T21:21:54,058 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2026-03-13T21:21:54,060 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2026-03-13T21:21:54,061 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2026-03-13T21:21:54,063 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2026-03-13T21:21:54,065 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2026-03-13T21:21:54,067 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2026-03-13T21:21:54,069 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2026-03-13T21:21:54,071 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2026-03-13T21:21:54,074 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2026-03-13T21:21:54,078 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2026-03-13T21:21:54,080 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2026-03-13T21:21:54,082 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2026-03-13T21:21:54,084 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2026-03-13T21:21:54,085 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2026-03-13T21:21:54,086 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2026-03-13T21:21:54,087 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2026-03-13T21:21:54,089 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2026-03-13T21:21:54,090 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2026-03-13T21:21:54,092 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2026-03-13T21:21:54,093 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2026-03-13T21:21:54,095 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2026-03-13T21:21:54,096 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2026-03-13T21:21:54,098 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2026-03-13T21:21:54,099 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2026-03-13T21:21:54,100 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2026-03-13T21:21:54,102 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2026-03-13T21:21:54,103 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2026-03-13T21:21:54,104 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2026-03-13T21:21:54,106 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2026-03-13T21:21:54,108 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2026-03-13T21:21:54,109 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2026-03-13T21:21:54,111 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2026-03-13T21:21:54,112 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2026-03-13T21:21:54,113 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2026-03-13T21:21:54,115 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2026-03-13T21:21:54,117 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2026-03-13T21:21:54,118 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2026-03-13T21:21:54,120 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2026-03-13T21:21:54,121 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2026-03-13T21:21:54,123 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2026-03-13T21:21:54,124 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2026-03-13T21:21:54,125 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2026-03-13T21:21:54,127 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2026-03-13T21:21:54,129 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2026-03-13T21:21:54,130 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2026-03-13T21:21:54,131 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2026-03-13T21:21:54,132 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2026-03-13T21:21:54,133 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2026-03-13T21:21:54,135 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2026-03-13T21:21:54,137 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2026-03-13T21:21:54,138 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2026-03-13T21:21:54,139 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2026-03-13T21:21:54,140 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2026-03-13T21:21:54,142 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2026-03-13T21:21:54,143 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2026-03-13T21:21:54,145 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2026-03-13T21:21:54,147 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2026-03-13T21:21:54,148 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2026-03-13T21:21:54,150 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2026-03-13T21:21:54,151 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2026-03-13T21:21:54,152 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2026-03-13T21:21:54,154 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2026-03-13T21:21:54,155 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2026-03-13T21:21:54,156 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2026-03-13T21:21:54,158 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2026-03-13T21:21:54,160 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2026-03-13T21:21:54,162 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2026-03-13T21:21:54,164 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2026-03-13T21:21:54,166 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2026-03-13T21:21:54,169 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2026-03-13T21:21:54,170 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2026-03-13T21:21:54,172 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2026-03-13T21:21:54,173 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2026-03-13T21:21:54,175 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2026-03-13T21:21:54,176 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2026-03-13T21:21:54,177 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2026-03-13T21:21:54,178 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2026-03-13T21:21:54,180 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2026-03-13T21:21:54,181 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2026-03-13T21:21:54,182 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2026-03-13T21:21:54,184 adding 'deepspeed/inference/v2/model_implementations/exaone4/__init__.py' 2026-03-13T21:21:54,185 adding 'deepspeed/inference/v2/model_implementations/exaone4/container.py' 2026-03-13T21:21:54,187 adding 'deepspeed/inference/v2/model_implementations/exaone4/model.py' 2026-03-13T21:21:54,188 adding 'deepspeed/inference/v2/model_implementations/exaone4/policy.py' 2026-03-13T21:21:54,190 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2026-03-13T21:21:54,191 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2026-03-13T21:21:54,193 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2026-03-13T21:21:54,194 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2026-03-13T21:21:54,196 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2026-03-13T21:21:54,197 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2026-03-13T21:21:54,198 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2026-03-13T21:21:54,200 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2026-03-13T21:21:54,201 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2026-03-13T21:21:54,203 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2026-03-13T21:21:54,204 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2026-03-13T21:21:54,206 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2026-03-13T21:21:54,207 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2026-03-13T21:21:54,209 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2026-03-13T21:21:54,210 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2026-03-13T21:21:54,212 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2026-03-13T21:21:54,213 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2026-03-13T21:21:54,215 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2026-03-13T21:21:54,216 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2026-03-13T21:21:54,218 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2026-03-13T21:21:54,219 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2026-03-13T21:21:54,221 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2026-03-13T21:21:54,222 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2026-03-13T21:21:54,224 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2026-03-13T21:21:54,225 adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py' 2026-03-13T21:21:54,226 adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py' 2026-03-13T21:21:54,228 adding 'deepspeed/inference/v2/model_implementations/phi3/model.py' 2026-03-13T21:21:54,229 adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py' 2026-03-13T21:21:54,231 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2026-03-13T21:21:54,232 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2026-03-13T21:21:54,234 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2026-03-13T21:21:54,235 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2026-03-13T21:21:54,236 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2026-03-13T21:21:54,237 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2026-03-13T21:21:54,239 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2026-03-13T21:21:54,240 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2026-03-13T21:21:54,242 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py' 2026-03-13T21:21:54,243 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py' 2026-03-13T21:21:54,245 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py' 2026-03-13T21:21:54,246 adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py' 2026-03-13T21:21:54,248 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2026-03-13T21:21:54,249 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2026-03-13T21:21:54,251 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2026-03-13T21:21:54,252 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2026-03-13T21:21:54,253 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2026-03-13T21:21:54,255 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2026-03-13T21:21:54,256 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2026-03-13T21:21:54,257 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2026-03-13T21:21:54,259 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2026-03-13T21:21:54,261 adding 'deepspeed/inference/v2/modules/__init__.py' 2026-03-13T21:21:54,262 adding 'deepspeed/inference/v2/modules/ds_module.py' 2026-03-13T21:21:54,264 adding 'deepspeed/inference/v2/modules/heuristics.py' 2026-03-13T21:21:54,265 adding 'deepspeed/inference/v2/modules/module_registry.py' 2026-03-13T21:21:54,267 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2026-03-13T21:21:54,268 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2026-03-13T21:21:54,270 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2026-03-13T21:21:54,271 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2026-03-13T21:21:54,272 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2026-03-13T21:21:54,273 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2026-03-13T21:21:54,275 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2026-03-13T21:21:54,276 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2026-03-13T21:21:54,278 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2026-03-13T21:21:54,280 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2026-03-13T21:21:54,282 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2026-03-13T21:21:54,283 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2026-03-13T21:21:54,285 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2026-03-13T21:21:54,286 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2026-03-13T21:21:54,288 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2026-03-13T21:21:54,290 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2026-03-13T21:21:54,291 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2026-03-13T21:21:54,293 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2026-03-13T21:21:54,294 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2026-03-13T21:21:54,296 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2026-03-13T21:21:54,297 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2026-03-13T21:21:54,298 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2026-03-13T21:21:54,300 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2026-03-13T21:21:54,301 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2026-03-13T21:21:54,303 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2026-03-13T21:21:54,304 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2026-03-13T21:21:54,306 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2026-03-13T21:21:54,307 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2026-03-13T21:21:54,308 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2026-03-13T21:21:54,310 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2026-03-13T21:21:54,311 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2026-03-13T21:21:54,312 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2026-03-13T21:21:54,314 adding 'deepspeed/inference/v2/ragged/__init__.py' 2026-03-13T21:21:54,316 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2026-03-13T21:21:54,317 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2026-03-13T21:21:54,319 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2026-03-13T21:21:54,321 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2026-03-13T21:21:54,323 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2026-03-13T21:21:54,324 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2026-03-13T21:21:54,326 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2026-03-13T21:21:54,327 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2026-03-13T21:21:54,329 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2026-03-13T21:21:54,331 adding 'deepspeed/io/__init__.py' 2026-03-13T21:21:54,332 adding 'deepspeed/io/base_file_writer.py' 2026-03-13T21:21:54,333 adding 'deepspeed/io/base_io_buffer.py' 2026-03-13T21:21:54,335 adding 'deepspeed/io/constants.py' 2026-03-13T21:21:54,336 adding 'deepspeed/io/double_io_buffer.py' 2026-03-13T21:21:54,338 adding 'deepspeed/io/fast_file_writer.py' 2026-03-13T21:21:54,339 adding 'deepspeed/io/mock_file_writer.py' 2026-03-13T21:21:54,340 adding 'deepspeed/io/py_file_writer.py' 2026-03-13T21:21:54,342 adding 'deepspeed/io/single_io_buffer.py' 2026-03-13T21:21:54,343 adding 'deepspeed/io/utils.py' 2026-03-13T21:21:54,345 adding 'deepspeed/launcher/__init__.py' 2026-03-13T21:21:54,346 adding 'deepspeed/launcher/constants.py' 2026-03-13T21:21:54,348 adding 'deepspeed/launcher/launch.py' 2026-03-13T21:21:54,350 adding 'deepspeed/launcher/launcher_helper.py' 2026-03-13T21:21:54,352 adding 'deepspeed/launcher/multinode_runner.py' 2026-03-13T21:21:54,355 adding 'deepspeed/launcher/runner.py' 2026-03-13T21:21:54,357 adding 'deepspeed/linear/__init__.py' 2026-03-13T21:21:54,358 adding 'deepspeed/linear/config.py' 2026-03-13T21:21:54,360 adding 'deepspeed/linear/context_manager.py' 2026-03-13T21:21:54,362 adding 'deepspeed/linear/optimized_linear.py' 2026-03-13T21:21:54,363 adding 'deepspeed/linear/quantization.py' 2026-03-13T21:21:54,365 adding 'deepspeed/model_implementations/__init__.py' 2026-03-13T21:21:54,367 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2026-03-13T21:21:54,368 adding 'deepspeed/model_implementations/diffusers/unet.py' 2026-03-13T21:21:54,370 adding 'deepspeed/model_implementations/diffusers/vae.py' 2026-03-13T21:21:54,371 adding 'deepspeed/model_implementations/features/__init__.py' 2026-03-13T21:21:54,372 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2026-03-13T21:21:54,374 adding 'deepspeed/model_implementations/transformers/__init__.py' 2026-03-13T21:21:54,375 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2026-03-13T21:21:54,376 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2026-03-13T21:21:54,377 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2026-03-13T21:21:54,379 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2026-03-13T21:21:54,380 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2026-03-13T21:21:54,381 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2026-03-13T21:21:54,382 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2026-03-13T21:21:54,383 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2026-03-13T21:21:54,385 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2026-03-13T21:21:54,387 adding 'deepspeed/module_inject/__init__.py' 2026-03-13T21:21:54,390 adding 'deepspeed/module_inject/auto_tp.py' 2026-03-13T21:21:54,392 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2026-03-13T21:21:54,394 adding 'deepspeed/module_inject/autotp_config.py' 2026-03-13T21:21:54,396 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2026-03-13T21:21:54,398 adding 'deepspeed/module_inject/inject.py' 2026-03-13T21:21:54,403 adding 'deepspeed/module_inject/layers.py' 2026-03-13T21:21:54,405 adding 'deepspeed/module_inject/load_checkpoint.py' 2026-03-13T21:21:54,406 adding 'deepspeed/module_inject/module_quantize.py' 2026-03-13T21:21:54,408 adding 'deepspeed/module_inject/policy.py' 2026-03-13T21:21:54,412 adding 'deepspeed/module_inject/replace_module.py' 2026-03-13T21:21:54,413 adding 'deepspeed/module_inject/replace_policy.py' 2026-03-13T21:21:54,414 adding 'deepspeed/module_inject/tp_shard.py' 2026-03-13T21:21:54,416 adding 'deepspeed/module_inject/utils.py' 2026-03-13T21:21:54,418 adding 'deepspeed/module_inject/containers/__init__.py' 2026-03-13T21:21:54,420 adding 'deepspeed/module_inject/containers/base.py' 2026-03-13T21:21:54,421 adding 'deepspeed/module_inject/containers/base_moe.py' 2026-03-13T21:21:54,423 adding 'deepspeed/module_inject/containers/bert.py' 2026-03-13T21:21:54,425 adding 'deepspeed/module_inject/containers/bloom.py' 2026-03-13T21:21:54,426 adding 'deepspeed/module_inject/containers/clip.py' 2026-03-13T21:21:54,428 adding 'deepspeed/module_inject/containers/distil_bert.py' 2026-03-13T21:21:54,430 adding 'deepspeed/module_inject/containers/gpt2.py' 2026-03-13T21:21:54,432 adding 'deepspeed/module_inject/containers/gptj.py' 2026-03-13T21:21:54,434 adding 'deepspeed/module_inject/containers/gptneo.py' 2026-03-13T21:21:54,436 adding 'deepspeed/module_inject/containers/gptneox.py' 2026-03-13T21:21:54,438 adding 'deepspeed/module_inject/containers/internlm.py' 2026-03-13T21:21:54,440 adding 'deepspeed/module_inject/containers/llama.py' 2026-03-13T21:21:54,443 adding 'deepspeed/module_inject/containers/llama2.py' 2026-03-13T21:21:54,445 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2026-03-13T21:21:54,448 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2026-03-13T21:21:54,450 adding 'deepspeed/module_inject/containers/opt.py' 2026-03-13T21:21:54,452 adding 'deepspeed/module_inject/containers/unet.py' 2026-03-13T21:21:54,453 adding 'deepspeed/module_inject/containers/vae.py' 2026-03-13T21:21:54,455 adding 'deepspeed/module_inject/containers/features/__init__.py' 2026-03-13T21:21:54,456 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2026-03-13T21:21:54,458 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2026-03-13T21:21:54,459 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2026-03-13T21:21:54,460 adding 'deepspeed/module_inject/containers/features/megatron.py' 2026-03-13T21:21:54,462 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2026-03-13T21:21:54,463 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2026-03-13T21:21:54,465 adding 'deepspeed/moe/__init__.py' 2026-03-13T21:21:54,466 adding 'deepspeed/moe/experts.py' 2026-03-13T21:21:54,467 adding 'deepspeed/moe/layer.py' 2026-03-13T21:21:54,469 adding 'deepspeed/moe/mappings.py' 2026-03-13T21:21:54,472 adding 'deepspeed/moe/sharded_moe.py' 2026-03-13T21:21:54,473 adding 'deepspeed/moe/utils.py' 2026-03-13T21:21:54,475 adding 'deepspeed/monitor/__init__.py' 2026-03-13T21:21:54,477 adding 'deepspeed/monitor/comet.py' 2026-03-13T21:21:54,478 adding 'deepspeed/monitor/config.py' 2026-03-13T21:21:54,479 adding 'deepspeed/monitor/csv_monitor.py' 2026-03-13T21:21:54,481 adding 'deepspeed/monitor/monitor.py' 2026-03-13T21:21:54,482 adding 'deepspeed/monitor/tensorboard.py' 2026-03-13T21:21:54,483 adding 'deepspeed/monitor/utils.py' 2026-03-13T21:21:54,484 adding 'deepspeed/monitor/wandb.py' 2026-03-13T21:21:54,486 adding 'deepspeed/nebula/__init__.py' 2026-03-13T21:21:54,487 adding 'deepspeed/nebula/config.py' 2026-03-13T21:21:54,488 adding 'deepspeed/nebula/constants.py' 2026-03-13T21:21:54,490 adding 'deepspeed/nvme/__init__.py' 2026-03-13T21:21:54,492 adding 'deepspeed/nvme/ds_aio_args.py' 2026-03-13T21:21:54,493 adding 'deepspeed/nvme/ds_aio_basic.py' 2026-03-13T21:21:54,494 adding 'deepspeed/nvme/ds_aio_constants.py' 2026-03-13T21:21:54,496 adding 'deepspeed/nvme/ds_aio_handle.py' 2026-03-13T21:21:54,497 adding 'deepspeed/nvme/ds_aio_job.py' 2026-03-13T21:21:54,499 adding 'deepspeed/nvme/io_engine.py' 2026-03-13T21:21:54,500 adding 'deepspeed/nvme/parse_nvme_stats.py' 2026-03-13T21:21:54,502 adding 'deepspeed/nvme/perf_generate_param.py' 2026-03-13T21:21:54,505 adding 'deepspeed/nvme/perf_run_sweep.py' 2026-03-13T21:21:54,506 adding 'deepspeed/nvme/perf_sweep_utils.py' 2026-03-13T21:21:54,508 adding 'deepspeed/nvme/test_ds_aio.py' 2026-03-13T21:21:54,510 adding 'deepspeed/nvme/test_ds_aio_utils.py' 2026-03-13T21:21:54,512 adding 'deepspeed/nvme/torch_fastio_engine.py' 2026-03-13T21:21:54,513 adding 'deepspeed/nvme/torch_io.py' 2026-03-13T21:21:54,515 adding 'deepspeed/nvme/validate_async_io.py' 2026-03-13T21:21:54,517 adding 'deepspeed/ops/__init__.py' 2026-03-13T21:21:54,518 adding 'deepspeed/ops/adagrad/__init__.py' 2026-03-13T21:21:54,520 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2026-03-13T21:21:54,522 adding 'deepspeed/ops/adam/__init__.py' 2026-03-13T21:21:54,524 adding 'deepspeed/ops/adam/cpu_adam.py' 2026-03-13T21:21:54,527 adding 'deepspeed/ops/adam/fused_adam.py' 2026-03-13T21:21:54,528 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2026-03-13T21:21:54,530 adding 'deepspeed/ops/adam/zenflow_cpu_adam.py' 2026-03-13T21:21:54,534 adding 'deepspeed/ops/adam/zenflow_torch_adam.py' 2026-03-13T21:21:54,536 adding 'deepspeed/ops/aio/__init__.py' 2026-03-13T21:21:54,538 adding 'deepspeed/ops/compile/__init__.py' 2026-03-13T21:21:54,540 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2026-03-13T21:21:54,543 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2026-03-13T21:21:54,544 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2026-03-13T21:21:54,546 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2026-03-13T21:21:54,548 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2026-03-13T21:21:54,549 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2026-03-13T21:21:54,552 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2026-03-13T21:21:54,553 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2026-03-13T21:21:54,555 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2026-03-13T21:21:54,556 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2026-03-13T21:21:54,557 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2026-03-13T21:21:54,558 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2026-03-13T21:21:54,560 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp' 2026-03-13T21:21:54,562 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h' 2026-03-13T21:21:54,563 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2026-03-13T21:21:54,564 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2026-03-13T21:21:54,565 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp' 2026-03-13T21:21:54,566 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h' 2026-03-13T21:21:54,568 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2026-03-13T21:21:54,569 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2026-03-13T21:21:54,570 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2026-03-13T21:21:54,571 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2026-03-13T21:21:54,572 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2026-03-13T21:21:54,574 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2026-03-13T21:21:54,575 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2026-03-13T21:21:54,576 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2026-03-13T21:21:54,578 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp' 2026-03-13T21:21:54,579 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h' 2026-03-13T21:21:54,581 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2026-03-13T21:21:54,583 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2026-03-13T21:21:54,585 adding 'deepspeed/ops/csrc/compile/deepcompile.cpp' 2026-03-13T21:21:54,586 adding 'deepspeed/ops/csrc/compile/init.cpp' 2026-03-13T21:21:54,588 adding 'deepspeed/ops/csrc/compile/util.cpp' 2026-03-13T21:21:54,589 adding 'deepspeed/ops/csrc/compile/z1.cpp' 2026-03-13T21:21:54,590 adding 'deepspeed/ops/csrc/compile/z1.h' 2026-03-13T21:21:54,592 adding 'deepspeed/ops/csrc/compile/z2.cpp' 2026-03-13T21:21:54,593 adding 'deepspeed/ops/csrc/compile/z2.h' 2026-03-13T21:21:54,596 adding 'deepspeed/ops/csrc/compile/z3.cpp' 2026-03-13T21:21:54,597 adding 'deepspeed/ops/csrc/compile/z3.h' 2026-03-13T21:21:54,599 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2026-03-13T21:21:54,602 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2026-03-13T21:21:54,605 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2026-03-13T21:21:54,606 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2026-03-13T21:21:54,607 adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp' 2026-03-13T21:21:54,609 adding 'deepspeed/ops/csrc/cpu/comm/arm64/shm.h' 2026-03-13T21:21:54,611 adding 'deepspeed/ops/csrc/cpu/comm/riscv64/shm.h' 2026-03-13T21:21:54,613 adding 'deepspeed/ops/csrc/cpu/comm/x86_64/shm.h' 2026-03-13T21:21:54,615 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2026-03-13T21:21:54,617 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2026-03-13T21:21:54,619 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2026-03-13T21:21:54,620 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2026-03-13T21:21:54,622 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2026-03-13T21:21:54,630 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2026-03-13T21:21:54,635 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2026-03-13T21:21:54,637 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2026-03-13T21:21:54,640 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2026-03-13T21:21:54,642 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2026-03-13T21:21:54,643 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2026-03-13T21:21:54,645 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2026-03-13T21:21:54,647 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2026-03-13T21:21:54,649 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2026-03-13T21:21:54,652 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2026-03-13T21:21:54,653 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2026-03-13T21:21:54,655 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2026-03-13T21:21:54,662 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2026-03-13T21:21:54,666 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2026-03-13T21:21:54,668 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2026-03-13T21:21:54,672 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2026-03-13T21:21:54,675 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2026-03-13T21:21:54,679 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2026-03-13T21:21:54,680 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2026-03-13T21:21:54,682 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2026-03-13T21:21:54,684 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2026-03-13T21:21:54,685 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2026-03-13T21:21:54,688 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp' 2026-03-13T21:21:54,690 adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu' 2026-03-13T21:21:54,692 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h' 2026-03-13T21:21:54,693 adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h' 2026-03-13T21:21:54,696 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp' 2026-03-13T21:21:54,697 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h' 2026-03-13T21:21:54,698 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h' 2026-03-13T21:21:54,700 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp' 2026-03-13T21:21:54,701 adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h' 2026-03-13T21:21:54,702 adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp' 2026-03-13T21:21:54,705 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2026-03-13T21:21:54,706 adding 'deepspeed/ops/csrc/includes/Timer.h' 2026-03-13T21:21:54,707 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2026-03-13T21:21:54,708 adding 'deepspeed/ops/csrc/includes/compat.h' 2026-03-13T21:21:54,710 adding 'deepspeed/ops/csrc/includes/context.h' 2026-03-13T21:21:54,711 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2026-03-13T21:21:54,713 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2026-03-13T21:21:54,714 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2026-03-13T21:21:54,716 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2026-03-13T21:21:54,717 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2026-03-13T21:21:54,719 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2026-03-13T21:21:54,722 adding 'deepspeed/ops/csrc/includes/deepcompile.h' 2026-03-13T21:21:54,723 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2026-03-13T21:21:54,725 adding 'deepspeed/ops/csrc/includes/dropout.h' 2026-03-13T21:21:54,726 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2026-03-13T21:21:54,727 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2026-03-13T21:21:54,728 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2026-03-13T21:21:54,729 adding 'deepspeed/ops/csrc/includes/gelu.h' 2026-03-13T21:21:54,731 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2026-03-13T21:21:54,732 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2026-03-13T21:21:54,734 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2026-03-13T21:21:54,736 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2026-03-13T21:21:54,737 adding 'deepspeed/ops/csrc/includes/quantization.h' 2026-03-13T21:21:54,739 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2026-03-13T21:21:54,740 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2026-03-13T21:21:54,743 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2026-03-13T21:21:54,745 adding 'deepspeed/ops/csrc/includes/simd.h' 2026-03-13T21:21:54,746 adding 'deepspeed/ops/csrc/includes/softmax.h' 2026-03-13T21:21:54,748 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2026-03-13T21:21:54,749 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2026-03-13T21:21:54,751 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2026-03-13T21:21:54,753 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2026-03-13T21:21:54,755 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2026-03-13T21:21:54,756 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2026-03-13T21:21:54,758 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2026-03-13T21:21:54,759 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2026-03-13T21:21:54,760 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2026-03-13T21:21:54,763 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2026-03-13T21:21:54,765 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2026-03-13T21:21:54,767 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2026-03-13T21:21:54,770 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2026-03-13T21:21:54,771 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2026-03-13T21:21:54,773 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2026-03-13T21:21:54,775 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2026-03-13T21:21:54,777 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2026-03-13T21:21:54,778 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2026-03-13T21:21:54,780 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2026-03-13T21:21:54,781 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2026-03-13T21:21:54,783 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2026-03-13T21:21:54,786 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2026-03-13T21:21:54,787 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2026-03-13T21:21:54,789 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2026-03-13T21:21:54,791 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2026-03-13T21:21:54,794 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2026-03-13T21:21:54,798 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2026-03-13T21:21:54,800 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2026-03-13T21:21:54,801 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2026-03-13T21:21:54,805 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2026-03-13T21:21:54,808 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2026-03-13T21:21:54,811 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2026-03-13T21:21:54,813 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2026-03-13T21:21:54,815 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2026-03-13T21:21:54,818 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2026-03-13T21:21:54,820 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2026-03-13T21:21:54,821 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2026-03-13T21:21:54,827 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2026-03-13T21:21:54,828 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2026-03-13T21:21:54,830 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2026-03-13T21:21:54,832 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2026-03-13T21:21:54,835 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2026-03-13T21:21:54,837 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2026-03-13T21:21:54,839 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2026-03-13T21:21:54,841 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2026-03-13T21:21:54,843 adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp' 2026-03-13T21:21:54,844 adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp' 2026-03-13T21:21:54,845 adding 'deepspeed/ops/csrc/utils/tensor_cast.h' 2026-03-13T21:21:54,847 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2026-03-13T21:21:54,849 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2026-03-13T21:21:54,850 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2026-03-13T21:21:54,852 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp' 2026-03-13T21:21:54,854 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2026-03-13T21:21:54,856 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2026-03-13T21:21:54,857 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2026-03-13T21:21:54,859 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2026-03-13T21:21:54,860 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2026-03-13T21:21:54,862 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2026-03-13T21:21:54,864 adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp' 2026-03-13T21:21:54,866 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2026-03-13T21:21:54,867 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2026-03-13T21:21:54,869 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2026-03-13T21:21:54,870 adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py' 2026-03-13T21:21:54,872 adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py' 2026-03-13T21:21:54,873 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2026-03-13T21:21:54,875 adding 'deepspeed/ops/gds/__init__.py' 2026-03-13T21:21:54,877 adding 'deepspeed/ops/lamb/__init__.py' 2026-03-13T21:21:54,878 adding 'deepspeed/ops/lamb/fused_lamb.py' 2026-03-13T21:21:54,880 adding 'deepspeed/ops/lion/__init__.py' 2026-03-13T21:21:54,881 adding 'deepspeed/ops/lion/cpu_lion.py' 2026-03-13T21:21:54,883 adding 'deepspeed/ops/lion/fused_lion.py' 2026-03-13T21:21:54,884 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2026-03-13T21:21:54,887 adding 'deepspeed/ops/op_builder/__init__.py' 2026-03-13T21:21:54,888 adding 'deepspeed/ops/op_builder/all_ops.py' 2026-03-13T21:21:54,889 adding 'deepspeed/ops/op_builder/async_io.py' 2026-03-13T21:21:54,893 adding 'deepspeed/ops/op_builder/builder.py' 2026-03-13T21:21:54,895 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2026-03-13T21:21:54,896 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2026-03-13T21:21:54,897 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2026-03-13T21:21:54,899 adding 'deepspeed/ops/op_builder/dc.py' 2026-03-13T21:21:54,900 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2026-03-13T21:21:54,902 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2026-03-13T21:21:54,903 adding 'deepspeed/ops/op_builder/fused_adam.py' 2026-03-13T21:21:54,904 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2026-03-13T21:21:54,905 adding 'deepspeed/ops/op_builder/fused_lion.py' 2026-03-13T21:21:54,907 adding 'deepspeed/ops/op_builder/gds.py' 2026-03-13T21:21:54,908 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2026-03-13T21:21:54,909 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2026-03-13T21:21:54,910 adding 'deepspeed/ops/op_builder/quantizer.py' 2026-03-13T21:21:54,912 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2026-03-13T21:21:54,913 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2026-03-13T21:21:54,914 adding 'deepspeed/ops/op_builder/random_ltd.py' 2026-03-13T21:21:54,915 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2026-03-13T21:21:54,917 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2026-03-13T21:21:54,918 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2026-03-13T21:21:54,919 adding 'deepspeed/ops/op_builder/transformer.py' 2026-03-13T21:21:54,920 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2026-03-13T21:21:54,921 adding 'deepspeed/ops/op_builder/utils.py' 2026-03-13T21:21:54,923 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2026-03-13T21:21:54,925 adding 'deepspeed/ops/op_builder/cpu/async_io.py' 2026-03-13T21:21:54,926 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2026-03-13T21:21:54,927 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2026-03-13T21:21:54,928 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2026-03-13T21:21:54,929 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2026-03-13T21:21:54,930 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2026-03-13T21:21:54,932 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2026-03-13T21:21:54,933 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2026-03-13T21:21:54,935 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2026-03-13T21:21:54,936 adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py' 2026-03-13T21:21:54,937 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2026-03-13T21:21:54,938 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2026-03-13T21:21:54,939 adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py' 2026-03-13T21:21:54,941 adding 'deepspeed/ops/op_builder/mlu/__init__.py' 2026-03-13T21:21:54,942 adding 'deepspeed/ops/op_builder/mlu/builder.py' 2026-03-13T21:21:54,944 adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py' 2026-03-13T21:21:54,945 adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py' 2026-03-13T21:21:54,946 adding 'deepspeed/ops/op_builder/mlu/fused_adam.py' 2026-03-13T21:21:54,947 adding 'deepspeed/ops/op_builder/mlu/no_impl.py' 2026-03-13T21:21:54,949 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2026-03-13T21:21:54,950 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2026-03-13T21:21:54,952 adding 'deepspeed/ops/op_builder/npu/builder.py' 2026-03-13T21:21:54,953 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2026-03-13T21:21:54,954 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2026-03-13T21:21:54,955 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2026-03-13T21:21:54,956 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2026-03-13T21:21:54,958 adding 'deepspeed/ops/op_builder/npu/inference.py' 2026-03-13T21:21:54,960 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2026-03-13T21:21:54,961 adding 'deepspeed/ops/op_builder/sdaa/__init__.py' 2026-03-13T21:21:54,963 adding 'deepspeed/ops/op_builder/sdaa/builder.py' 2026-03-13T21:21:54,965 adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py' 2026-03-13T21:21:54,966 adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py' 2026-03-13T21:21:54,967 adding 'deepspeed/ops/op_builder/sdaa/no_impl.py' 2026-03-13T21:21:54,969 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2026-03-13T21:21:54,970 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2026-03-13T21:21:54,972 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2026-03-13T21:21:54,973 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2026-03-13T21:21:54,975 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2026-03-13T21:21:54,976 adding 'deepspeed/ops/op_builder/xpu/flash_attn.py' 2026-03-13T21:21:54,977 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2026-03-13T21:21:54,978 adding 'deepspeed/ops/op_builder/xpu/no_impl.py' 2026-03-13T21:21:54,979 adding 'deepspeed/ops/op_builder/xpu/packbits.py' 2026-03-13T21:21:54,981 adding 'deepspeed/ops/quantizer/__init__.py' 2026-03-13T21:21:54,982 adding 'deepspeed/ops/quantizer/quantizer.py' 2026-03-13T21:21:54,984 adding 'deepspeed/ops/random_ltd/__init__.py' 2026-03-13T21:21:54,985 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2026-03-13T21:21:54,986 adding 'deepspeed/ops/sparse_attention/__init__.py' 2026-03-13T21:21:54,988 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2026-03-13T21:21:54,991 adding 'deepspeed/ops/sparse_attention/matmul.py' 2026-03-13T21:21:54,993 adding 'deepspeed/ops/sparse_attention/softmax.py' 2026-03-13T21:21:54,995 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2026-03-13T21:21:54,997 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2026-03-13T21:21:55,000 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2026-03-13T21:21:55,002 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2026-03-13T21:21:55,004 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2026-03-13T21:21:55,005 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2026-03-13T21:21:55,006 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2026-03-13T21:21:55,008 adding 'deepspeed/ops/transformer/__init__.py' 2026-03-13T21:21:55,010 adding 'deepspeed/ops/transformer/transformer.py' 2026-03-13T21:21:55,012 adding 'deepspeed/ops/transformer/inference/__init__.py' 2026-03-13T21:21:55,013 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2026-03-13T21:21:55,015 adding 'deepspeed/ops/transformer/inference/config.py' 2026-03-13T21:21:55,016 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2026-03-13T21:21:55,018 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2026-03-13T21:21:55,019 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2026-03-13T21:21:55,021 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2026-03-13T21:21:55,023 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2026-03-13T21:21:55,025 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2026-03-13T21:21:55,026 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2026-03-13T21:21:55,028 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2026-03-13T21:21:55,030 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2026-03-13T21:21:55,031 adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py' 2026-03-13T21:21:55,032 adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py' 2026-03-13T21:21:55,033 adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py' 2026-03-13T21:21:55,035 adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py' 2026-03-13T21:21:55,036 adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py' 2026-03-13T21:21:55,037 adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py' 2026-03-13T21:21:55,039 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2026-03-13T21:21:55,040 adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py' 2026-03-13T21:21:55,041 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2026-03-13T21:21:55,043 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2026-03-13T21:21:55,044 adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py' 2026-03-13T21:21:55,045 adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py' 2026-03-13T21:21:55,046 adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py' 2026-03-13T21:21:55,048 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2026-03-13T21:21:55,049 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2026-03-13T21:21:55,050 adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py' 2026-03-13T21:21:55,051 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2026-03-13T21:21:55,053 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2026-03-13T21:21:55,054 adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py' 2026-03-13T21:21:55,055 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2026-03-13T21:21:55,057 adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py' 2026-03-13T21:21:55,059 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2026-03-13T21:21:55,061 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2026-03-13T21:21:55,062 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2026-03-13T21:21:55,063 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2026-03-13T21:21:55,065 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2026-03-13T21:21:55,067 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2026-03-13T21:21:55,068 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2026-03-13T21:21:55,069 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2026-03-13T21:21:55,071 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2026-03-13T21:21:55,072 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2026-03-13T21:21:55,074 adding 'deepspeed/pipe/__init__.py' 2026-03-13T21:21:55,076 adding 'deepspeed/profiling/__init__.py' 2026-03-13T21:21:55,077 adding 'deepspeed/profiling/config.py' 2026-03-13T21:21:55,078 adding 'deepspeed/profiling/constants.py' 2026-03-13T21:21:55,080 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2026-03-13T21:21:55,085 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2026-03-13T21:21:55,088 adding 'deepspeed/runtime/__init__.py' 2026-03-13T21:21:55,090 adding 'deepspeed/runtime/base_optimizer.py' 2026-03-13T21:21:55,093 adding 'deepspeed/runtime/bf16_optimizer.py' 2026-03-13T21:21:55,095 adding 'deepspeed/runtime/compiler.py' 2026-03-13T21:21:55,099 adding 'deepspeed/runtime/config.py' 2026-03-13T21:21:55,101 adding 'deepspeed/runtime/config_utils.py' 2026-03-13T21:21:55,103 adding 'deepspeed/runtime/constants.py' 2026-03-13T21:21:55,105 adding 'deepspeed/runtime/dataloader.py' 2026-03-13T21:21:55,106 adding 'deepspeed/runtime/eigenvalue.py' 2026-03-13T21:21:55,129 adding 'deepspeed/runtime/engine.py' 2026-03-13T21:21:55,133 adding 'deepspeed/runtime/hybrid_engine.py' 2026-03-13T21:21:55,137 adding 'deepspeed/runtime/lr_schedules.py' 2026-03-13T21:21:55,138 adding 'deepspeed/runtime/precision_config.py' 2026-03-13T21:21:55,140 adding 'deepspeed/runtime/progressive_layer_drop.py' 2026-03-13T21:21:55,141 adding 'deepspeed/runtime/quantize.py' 2026-03-13T21:21:55,143 adding 'deepspeed/runtime/sparse_tensor.py' 2026-03-13T21:21:55,145 adding 'deepspeed/runtime/state_dict_factory.py' 2026-03-13T21:21:55,147 adding 'deepspeed/runtime/torch_autocast.py' 2026-03-13T21:21:55,153 adding 'deepspeed/runtime/utils.py' 2026-03-13T21:21:55,155 adding 'deepspeed/runtime/weight_quantizer.py' 2026-03-13T21:21:55,157 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2026-03-13T21:21:55,162 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2026-03-13T21:21:55,163 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2026-03-13T21:21:55,165 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2026-03-13T21:21:55,166 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2026-03-13T21:21:55,168 adding 'deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py' 2026-03-13T21:21:55,169 adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py' 2026-03-13T21:21:55,171 adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py' 2026-03-13T21:21:55,172 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2026-03-13T21:21:55,174 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2026-03-13T21:21:55,175 adding 'deepspeed/runtime/checkpoint_engine/utils.py' 2026-03-13T21:21:55,176 adding 'deepspeed/runtime/comm/__init__.py' 2026-03-13T21:21:55,178 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2026-03-13T21:21:55,179 adding 'deepspeed/runtime/comm/compressed.py' 2026-03-13T21:21:55,181 adding 'deepspeed/runtime/comm/hccl.py' 2026-03-13T21:21:55,182 adding 'deepspeed/runtime/comm/mpi.py' 2026-03-13T21:21:55,184 adding 'deepspeed/runtime/comm/nccl.py' 2026-03-13T21:21:55,185 adding 'deepspeed/runtime/comm/utils.py' 2026-03-13T21:21:55,187 adding 'deepspeed/runtime/compression/__init__.py' 2026-03-13T21:21:55,188 adding 'deepspeed/runtime/compression/cupy.py' 2026-03-13T21:21:55,190 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2026-03-13T21:21:55,191 adding 'deepspeed/runtime/data_pipeline/config.py' 2026-03-13T21:21:55,193 adding 'deepspeed/runtime/data_pipeline/constants.py' 2026-03-13T21:21:55,194 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2026-03-13T21:21:55,196 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2026-03-13T21:21:55,197 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2026-03-13T21:21:55,199 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2026-03-13T21:21:55,200 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2026-03-13T21:21:55,201 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2026-03-13T21:21:55,203 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2026-03-13T21:21:55,208 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2026-03-13T21:21:55,210 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2026-03-13T21:21:55,213 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2026-03-13T21:21:55,215 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2026-03-13T21:21:55,218 adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py' 2026-03-13T21:21:55,220 adding 'deepspeed/runtime/domino/__init__.py' 2026-03-13T21:21:55,221 adding 'deepspeed/runtime/domino/async_linear.py' 2026-03-13T21:21:55,224 adding 'deepspeed/runtime/domino/transformer.py' 2026-03-13T21:21:55,225 adding 'deepspeed/runtime/fp16/__init__.py' 2026-03-13T21:21:55,228 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2026-03-13T21:21:55,231 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2026-03-13T21:21:55,233 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2026-03-13T21:21:55,235 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2026-03-13T21:21:55,237 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2026-03-13T21:21:55,240 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2026-03-13T21:21:55,243 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2026-03-13T21:21:55,244 adding 'deepspeed/runtime/model_checkpointing/__init__.py' 2026-03-13T21:21:55,246 adding 'deepspeed/runtime/model_checkpointing/config.py' 2026-03-13T21:21:55,247 adding 'deepspeed/runtime/model_checkpointing/constants.py' 2026-03-13T21:21:55,249 adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py' 2026-03-13T21:21:55,250 adding 'deepspeed/runtime/model_checkpointing/utils.py' 2026-03-13T21:21:55,252 adding 'deepspeed/runtime/model_checkpointing/writer_factory.py' 2026-03-13T21:21:55,253 adding 'deepspeed/runtime/pipe/__init__.py' 2026-03-13T21:21:55,260 adding 'deepspeed/runtime/pipe/engine.py' 2026-03-13T21:21:55,264 adding 'deepspeed/runtime/pipe/module.py' 2026-03-13T21:21:55,266 adding 'deepspeed/runtime/pipe/p2p.py' 2026-03-13T21:21:55,268 adding 'deepspeed/runtime/pipe/schedule.py' 2026-03-13T21:21:55,270 adding 'deepspeed/runtime/pipe/topology.py' 2026-03-13T21:21:55,272 adding 'deepspeed/runtime/sequence_parallel/__init__.py' 2026-03-13T21:21:55,273 adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py' 2026-03-13T21:21:55,281 adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py' 2026-03-13T21:21:55,284 adding 'deepspeed/runtime/superoffload/__init__.py' 2026-03-13T21:21:55,286 adding 'deepspeed/runtime/superoffload/superoffload_stage3.py' 2026-03-13T21:21:55,287 adding 'deepspeed/runtime/superoffload/superoffload_utils.py' 2026-03-13T21:21:55,289 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2026-03-13T21:21:55,290 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2026-03-13T21:21:55,292 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2026-03-13T21:21:55,293 adding 'deepspeed/runtime/swap_tensor/constants.py' 2026-03-13T21:21:55,296 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2026-03-13T21:21:55,297 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2026-03-13T21:21:55,300 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2026-03-13T21:21:55,301 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2026-03-13T21:21:55,303 adding 'deepspeed/runtime/swap_tensor/utils.py' 2026-03-13T21:21:55,305 adding 'deepspeed/runtime/tensor_parallel/__init__.py' 2026-03-13T21:21:55,306 adding 'deepspeed/runtime/tensor_parallel/config.py' 2026-03-13T21:21:55,308 adding 'deepspeed/runtime/tensor_parallel/init_utils.py' 2026-03-13T21:21:55,309 adding 'deepspeed/runtime/tensor_parallel/tp_manager.py' 2026-03-13T21:21:55,311 adding 'deepspeed/runtime/zenflow/__init__.py' 2026-03-13T21:21:55,312 adding 'deepspeed/runtime/zenflow/engine.py' 2026-03-13T21:21:55,315 adding 'deepspeed/runtime/zenflow/engine_stage3.py' 2026-03-13T21:21:55,317 adding 'deepspeed/runtime/zenflow/zenflow_config.py' 2026-03-13T21:21:55,320 adding 'deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py' 2026-03-13T21:21:55,322 adding 'deepspeed/runtime/zenflow/zenflow_utils.py' 2026-03-13T21:21:55,324 adding 'deepspeed/runtime/zero/__init__.py' 2026-03-13T21:21:55,326 adding 'deepspeed/runtime/zero/config.py' 2026-03-13T21:21:55,328 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2026-03-13T21:21:55,330 adding 'deepspeed/runtime/zero/leaf_module_config.py' 2026-03-13T21:21:55,331 adding 'deepspeed/runtime/zero/linear.py' 2026-03-13T21:21:55,334 adding 'deepspeed/runtime/zero/mics.py' 2026-03-13T21:21:55,336 adding 'deepspeed/runtime/zero/mics_utils.py' 2026-03-13T21:21:55,337 adding 'deepspeed/runtime/zero/offload_config.py' 2026-03-13T21:21:55,339 adding 'deepspeed/runtime/zero/offload_states.py' 2026-03-13T21:21:55,342 adding 'deepspeed/runtime/zero/parameter_offload.py' 2026-03-13T21:21:55,354 adding 'deepspeed/runtime/zero/partition_parameters.py' 2026-03-13T21:21:55,358 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2026-03-13T21:21:55,360 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2026-03-13T21:21:55,377 adding 'deepspeed/runtime/zero/stage3.py' 2026-03-13T21:21:55,394 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2026-03-13T21:21:55,396 adding 'deepspeed/runtime/zero/test.py' 2026-03-13T21:21:55,398 adding 'deepspeed/runtime/zero/tiling.py' 2026-03-13T21:21:55,400 adding 'deepspeed/runtime/zero/utils.py' 2026-03-13T21:21:55,401 adding 'deepspeed/runtime/zero/muon/__init__.py' 2026-03-13T21:21:55,403 adding 'deepspeed/runtime/zero/muon/muon_optimizer.py' 2026-03-13T21:21:55,405 adding 'deepspeed/runtime/zero/muon/original_muon.py' 2026-03-13T21:21:55,406 adding 'deepspeed/sequence/__init__.py' 2026-03-13T21:21:55,408 adding 'deepspeed/sequence/cross_entropy.py' 2026-03-13T21:21:55,412 adding 'deepspeed/sequence/fpdt_layer.py' 2026-03-13T21:21:55,415 adding 'deepspeed/sequence/layer.py' 2026-03-13T21:21:55,417 adding 'deepspeed/utils/__init__.py' 2026-03-13T21:21:55,418 adding 'deepspeed/utils/bwc.py' 2026-03-13T21:21:55,420 adding 'deepspeed/utils/comms_logging.py' 2026-03-13T21:21:55,422 adding 'deepspeed/utils/config.py' 2026-03-13T21:21:55,423 adding 'deepspeed/utils/debug.py' 2026-03-13T21:21:55,425 adding 'deepspeed/utils/exceptions.py' 2026-03-13T21:21:55,428 adding 'deepspeed/utils/groups.py' 2026-03-13T21:21:55,430 adding 'deepspeed/utils/init_on_device.py' 2026-03-13T21:21:55,464 adding 'deepspeed/utils/logging.py' 2026-03-13T21:21:55,466 adding 'deepspeed/utils/mixed_precision_linkage.py' 2026-03-13T21:21:55,469 adding 'deepspeed/utils/numa.py' 2026-03-13T21:21:55,470 adding 'deepspeed/utils/nvtx.py' 2026-03-13T21:21:55,472 adding 'deepspeed/utils/tensor_fragment.py' 2026-03-13T21:21:55,474 adding 'deepspeed/utils/timer.py' 2026-03-13T21:21:55,475 adding 'deepspeed/utils/torch.py' 2026-03-13T21:21:55,476 adding 'deepspeed/utils/types.py' 2026-03-13T21:21:55,478 adding 'deepspeed/utils/z3_leaf_module.py' 2026-03-13T21:21:55,482 adding 'deepspeed/utils/zero_to_fp32.py' 2026-03-13T21:21:55,485 adding 'deepspeed-0.18.8.data/scripts/deepspeed' 2026-03-13T21:21:55,486 adding 'deepspeed-0.18.8.data/scripts/deepspeed.pt' 2026-03-13T21:21:55,487 adding 'deepspeed-0.18.8.data/scripts/ds' 2026-03-13T21:21:55,488 adding 'deepspeed-0.18.8.data/scripts/ds_bench' 2026-03-13T21:21:55,490 adding 'deepspeed-0.18.8.data/scripts/ds_elastic' 2026-03-13T21:21:55,491 adding 'deepspeed-0.18.8.data/scripts/ds_io' 2026-03-13T21:21:55,492 adding 'deepspeed-0.18.8.data/scripts/ds_nvme_tune' 2026-03-13T21:21:55,493 adding 'deepspeed-0.18.8.data/scripts/ds_report' 2026-03-13T21:21:55,494 adding 'deepspeed-0.18.8.data/scripts/ds_ssh' 2026-03-13T21:21:55,495 adding 'deepspeed-0.18.8.data/scripts/dsr' 2026-03-13T21:21:55,498 adding 'deepspeed-0.18.8.dist-info/licenses/LICENSE' 2026-03-13T21:21:55,503 adding 'deepspeed-0.18.8.dist-info/METADATA' 2026-03-13T21:21:55,504 adding 'deepspeed-0.18.8.dist-info/WHEEL' 2026-03-13T21:21:55,505 adding 'deepspeed-0.18.8.dist-info/entry_points.txt' 2026-03-13T21:21:55,506 adding 'deepspeed-0.18.8.dist-info/top_level.txt' 2026-03-13T21:21:55,522 adding 'deepspeed-0.18.8.dist-info/RECORD' 2026-03-13T21:21:55,555 removing build/bdist.linux-armv7l/wheel 2026-03-13T21:21:55,835 deepspeed build time = 13.53994870185852 secs 2026-03-13T21:21:55,960 Building wheel for deepspeed (setup.py): finished with status 'done' 2026-03-13T21:21:55,981 Created wheel for deepspeed: filename=deepspeed-0.18.8-py3-none-any.whl size=1801355 sha256=868221f9da4c8dfec43c7ddca85fcdb1b7891c74789b21ff832ae45cc988071b 2026-03-13T21:21:55,982 Stored in directory: /tmp/pip-ephem-wheel-cache-rikeiq1k/wheels/93/03/04/e02cf3d57ccb15a3116873132f69742703146c84b364b05605 2026-03-13T21:21:56,029 Successfully built deepspeed 2026-03-13T21:21:56,170 Removed build tracker: '/tmp/pip-build-tracker-_pzamlnb'