2026-03-05T21:46:15,821 Created temporary directory: /tmp/pip-ephem-wheel-cache-jwwy4kqs
2026-03-05T21:46:15,823 Created temporary directory: /tmp/pip-build-tracker-v4ot7po8
2026-03-05T21:46:15,824 Initialized build tracking at /tmp/pip-build-tracker-v4ot7po8
2026-03-05T21:46:15,825 Created build tracker: /tmp/pip-build-tracker-v4ot7po8
2026-03-05T21:46:15,825 Entered build tracker: /tmp/pip-build-tracker-v4ot7po8
2026-03-05T21:46:15,826 Created temporary directory: /tmp/pip-wheel-dp5x59vt
2026-03-05T21:46:15,829 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453
2026-03-05T21:46:15,831 Created temporary directory: /tmp/pip-ephem-wheel-cache-ngxr77qy
2026-03-05T21:46:15,853 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2026-03-05T21:46:15,857 2 location(s) to search for versions of deepspeed:
2026-03-05T21:46:15,857 * https://pypi.org/simple/deepspeed/
2026-03-05T21:46:15,857 * https://www.piwheels.org/simple/deepspeed/
2026-03-05T21:46:15,858 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2026-03-05T21:46:15,858 Getting page https://pypi.org/simple/deepspeed/
2026-03-05T21:46:15,860 Found index url https://pypi.org/simple
2026-03-05T21:46:15,998 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2026-03-05T21:46:16,022   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,022   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2026-03-05T21:46:16,023   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,024   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2026-03-05T21:46:16,025   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,025   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2026-03-05T21:46:16,026   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,027   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2026-03-05T21:46:16,028   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,028   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2026-03-05T21:46:16,029   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2026-03-05T21:46:16,030   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2026-03-05T21:46:16,031   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2026-03-05T21:46:16,031   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2026-03-05T21:46:16,032   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2026-03-05T21:46:16,033   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2026-03-05T21:46:16,033   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2026-03-05T21:46:16,034   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2026-03-05T21:46:16,034   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2026-03-05T21:46:16,035   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2026-03-05T21:46:16,036   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2026-03-05T21:46:16,037   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2026-03-05T21:46:16,037   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2026-03-05T21:46:16,038   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2026-03-05T21:46:16,039   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2026-03-05T21:46:16,040   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2026-03-05T21:46:16,040   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2026-03-05T21:46:16,041   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2026-03-05T21:46:16,042   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2026-03-05T21:46:16,043   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2026-03-05T21:46:16,043   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2026-03-05T21:46:16,044   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2026-03-05T21:46:16,045   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2026-03-05T21:46:16,045   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2026-03-05T21:46:16,046   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2026-03-05T21:46:16,046   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2026-03-05T21:46:16,047   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2026-03-05T21:46:16,048   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2026-03-05T21:46:16,048   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2026-03-05T21:46:16,049   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2026-03-05T21:46:16,050   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2026-03-05T21:46:16,051   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2026-03-05T21:46:16,051   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2026-03-05T21:46:16,052   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2026-03-05T21:46:16,053   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2026-03-05T21:46:16,053   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2026-03-05T21:46:16,054   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2026-03-05T21:46:16,055   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2026-03-05T21:46:16,056   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2026-03-05T21:46:16,056   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2026-03-05T21:46:16,057   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2026-03-05T21:46:16,058   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2026-03-05T21:46:16,058   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2026-03-05T21:46:16,059   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2026-03-05T21:46:16,059   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2026-03-05T21:46:16,060   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2026-03-05T21:46:16,061   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2026-03-05T21:46:16,062   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2026-03-05T21:46:16,062   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2026-03-05T21:46:16,063   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2026-03-05T21:46:16,064   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2026-03-05T21:46:16,065   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2026-03-05T21:46:16,065   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2026-03-05T21:46:16,066   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2026-03-05T21:46:16,067   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2026-03-05T21:46:16,068   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2026-03-05T21:46:16,069   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2026-03-05T21:46:16,069   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2026-03-05T21:46:16,070   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2026-03-05T21:46:16,070   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2026-03-05T21:46:16,071   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2026-03-05T21:46:16,072   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2026-03-05T21:46:16,072   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2026-03-05T21:46:16,073   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2026-03-05T21:46:16,074   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2026-03-05T21:46:16,074   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2026-03-05T21:46:16,075   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2026-03-05T21:46:16,076   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2026-03-05T21:46:16,077   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2026-03-05T21:46:16,078   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2026-03-05T21:46:16,078   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2026-03-05T21:46:16,079   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2026-03-05T21:46:16,080   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2026-03-05T21:46:16,080   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2026-03-05T21:46:16,082   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2026-03-05T21:46:16,082   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2026-03-05T21:46:16,083   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2026-03-05T21:46:16,083   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2026-03-05T21:46:16,084   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2026-03-05T21:46:16,085   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2026-03-05T21:46:16,085   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2026-03-05T21:46:16,086   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2026-03-05T21:46:16,087   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2026-03-05T21:46:16,087   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2026-03-05T21:46:16,088   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2026-03-05T21:46:16,089   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2026-03-05T21:46:16,090   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,090   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2026-03-05T21:46:16,091   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,091   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2026-03-05T21:46:16,092   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2026-03-05T21:46:16,093   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2026-03-05T21:46:16,094   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2026-03-05T21:46:16,094   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2026-03-05T21:46:16,095   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2026-03-05T21:46:16,095   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2026-03-05T21:46:16,096   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2026-03-05T21:46:16,097   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,097   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,098   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,098   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2026-03-05T21:46:16,099   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,100   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,101   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,101   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2026-03-05T21:46:16,102   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,103   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,103   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2026-03-05T21:46:16,104   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2026-03-05T21:46:16,105   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2026-03-05T21:46:16,105   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2026-03-05T21:46:16,106   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2026-03-05T21:46:16,106   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2026-03-05T21:46:16,107   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2026-03-05T21:46:16,108   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2026-03-05T21:46:16,108   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2026-03-05T21:46:16,109   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2026-03-05T21:46:16,110   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2026-03-05T21:46:16,111   Found link https://files.pythonhosted.org/packages/46/e7/bc1e5868d85cb8e21c43915023e462b9a147f739f26d8584e3c46771ec67/deepspeed-0.17.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.5
2026-03-05T21:46:16,111   Found link https://files.pythonhosted.org/packages/d4/a9/6130c78d84980ed636092be1a262d6429d539105724e675b6f65ef74a05e/deepspeed-0.17.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.6
2026-03-05T21:46:16,112   Found link https://files.pythonhosted.org/packages/95/e8/77fbbbb0fa0549f0fec68bfef7ba835ccd80d5001a9dde69f6ede9211d7b/deepspeed-0.18.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.0
2026-03-05T21:46:16,113   Found link https://files.pythonhosted.org/packages/2a/d7/79f3e4b1316891299152e29b2a905b3fbb0e4efa24f0e848ff9c28a9343a/deepspeed-0.18.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.1
2026-03-05T21:46:16,113   Found link https://files.pythonhosted.org/packages/74/cd/c4cdcc947db3d1f103223b2067e455710c5674acdff249289bc3c0501ecf/deepspeed-0.18.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.2
2026-03-05T21:46:16,114   Found link https://files.pythonhosted.org/packages/1b/88/989a2346b7fd618695ad468f4e29a98656a053143fae5587c2924ddb34f8/deepspeed-0.18.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.3
2026-03-05T21:46:16,115   Found link https://files.pythonhosted.org/packages/1d/06/b07729962ab914bd72c320fa54bea1c6d8e74cc652b05e3770eec05cd469/deepspeed-0.18.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.4
2026-03-05T21:46:16,116   Found link https://files.pythonhosted.org/packages/ca/0a/97f1896665690fb6199342284a6afb96cdfe10603f5edf83d1386ecfd081/deepspeed-0.18.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.5
2026-03-05T21:46:16,117   Found link https://files.pythonhosted.org/packages/fc/45/861baf605f6388c81109b1228ea211da62fb59b7a5b2606f90bd98f4b99e/deepspeed-0.18.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.6
2026-03-05T21:46:16,117   Found link https://files.pythonhosted.org/packages/30/00/ad310cf94e0e397c416087e6c4dc782429292206b2b1a3ffbd388ac95a67/deepspeed-0.18.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.18.7
2026-03-05T21:46:16,118 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2026-03-05T21:46:16,119 Getting page https://www.piwheels.org/simple/deepspeed/
2026-03-05T21:46:16,120 Found index url https://www.piwheels.org/simple
2026-03-05T21:46:16,274 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2026-03-05T21:46:16,299   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.6-py3-none-any.whl#sha256=8bab8d6e72582f7f2b2ffed41b2b17ecef4f48753dc5eec289aa3e431f57e9cf (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,299   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.5-py3-none-any.whl#sha256=8438d14528feaab46ad81e3bd4bd58fdfa76d5f173d0ab1caae6b432b86bd2f3 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,300   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.4-py3-none-any.whl#sha256=b19c1be796079c1ffd173425030e11139d10b6bd020b4f0d441ac41788578a99 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,300   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.3-py3-none-any.whl#sha256=1617db36397c415e4c08da013fe2c749dc8d48022760dd469ebaf8af8b41f7d0 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,301   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.2-py3-none-any.whl#sha256=5dba331b1bed4f81b2efcdebf44168cc0b4bd0aa818c07b73c6299918439c570 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,302   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.18.1-py3-none-any.whl#sha256=5b86199df0324c59913dc827c8771d0942a2b1804f8c9d92e08358308adb31f7 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,303   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.18.0-py3-none-any.whl#sha256=3806dbea5c2f5799704a24d865cc115c4144608ad04994b8096a3cfd085e52d3 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,303   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.6-py3-none-any.whl#sha256=6142b8dbad6e01ce0890830a65ca1c102f2bf8216edcca0ba86b7c81febd2754 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,304   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.17.5-py3-none-any.whl#sha256=2fcd7e824802bae8190b39577b346f58a20cba5bd72a63f4fd6a8d9b7ef8e498 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,304   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.4-py3-none-any.whl#sha256=b1edf8e83c0a6ebc2db69bde686b7a07864f60f5960b31b794b4a1676f3cea11 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,305   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.3-py3-none-any.whl#sha256=3a1f3c5148ccffdb4f7b2663159aa9f4b400b1705731ae98b26ae9469875a138 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,306   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.2-py3-none-any.whl#sha256=009db2687461691ee6dd5edfc2ed43c0196c6413460b1975e27cba0386a9057e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,307   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.1-py3-none-any.whl#sha256=317c4287d7bc03d677f5153dbc7225b5f6920c800dbbf1714eb61e2a5495b2b1 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,307   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.17.0-py3-none-any.whl#sha256=f7797218bb80761d1f3b1827d0ab50254edb3eeb189f8823bd9d02421c965acb (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,307   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.9-py3-none-any.whl#sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,308   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.8-py3-none-any.whl#sha256=a9a578ecf810f68bb8113342e3cfd5cfddaeadb101f9c1241dae35ed1078f6b3 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,308   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.7-py3-none-any.whl#sha256=390b2019766f00b87f17ec77236c987f6852ba1ee233be5b1a2a330f50fcf246 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,309   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.6-py3-none-any.whl#sha256=af190f747f3e6a5537f0bbfb35b97d076f3d15e240e1800404dd193133843e1d (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,310   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.16.5-py3-none-any.whl#sha256=b65b62a7d371ef56c8cd0c38c09ad930ab3a2441eb27d9e7636dfea16d4bf6fc (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,310   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.4-py3-none-any.whl#sha256=f7e7f46731a9413aa0993e9ee9416b6a9855dffe584e16f0bbd4194a018748b2 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,311   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.3-py3-none-any.whl#sha256=054c0fa6b98d59faf0968749e9d119504df57dd8334791a44ecb60427ea29b4a (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,312   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.2-py3-none-any.whl#sha256=6cabfff7c8a552345ac3b9fbcc500f4465315c7650be5b5f7e3009539cbabd73 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,312   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.1-py3-none-any.whl#sha256=45cadca45ee75892b02c00b75da09cd965b62e17a660bca28dcb1bcbc400fc7f (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,313   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.16.0-py3-none-any.whl#sha256=21568f469c01b32303030bf470a2d8bc65df4f428bf96f73c9d85be6b0b9fac4 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,313   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.4-py3-none-any.whl#sha256=d01cb59961fa1b3eb47d6b5035f4a925d418b537f005094898ad48678170a378 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,314   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.3-py3-none-any.whl#sha256=ac1d6ef48f043e3e1858cf241195baf309d54215928b0322ca299679e7794bc8 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,315   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.2-py3-none-any.whl#sha256=16ea51d88f40735af0a091c9c35469be928a90803f396d6fd6dc0ff8a49add7e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,315   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.1-py3-none-any.whl#sha256=8bca1a074d792f19189c2b1b8b8c9962858ce647bc47f35bff3d87b5ee95a598 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,316   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.15.0-py3-none-any.whl#sha256=e2d59c9f87cb64d1319e530f7b1098888cd22efd72cbc53a63869967507e2cda (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,316   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.5-py3-none-any.whl#sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,317   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,317   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,318   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,318   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,319   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,320   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,320   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,321   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,322   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,322   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,323   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,324   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,324   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,325   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,325   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,326   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,327   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,327   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,328   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,328   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,329   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,330   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,330   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,331   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,331   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,332   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,333   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,333   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,334   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,334   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,335   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,335   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,336   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,337   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,337   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,338   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,338   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,339   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,339   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,340   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,341   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,341   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,342   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,342   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,343   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,343   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,344   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,345   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,345   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,346   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,347   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,347   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,348   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,348   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,349   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,350   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,350   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,351   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,351   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,351   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,352   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,352   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,353   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,354   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,354   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,355   Skipping link: No binaries permitted for deepspeed: https://archive1.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2026-03-05T21:46:16,356 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2026-03-05T21:46:16,356 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2026-03-05T21:46:16,389 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2026-03-05T21:46:16,407 Collecting deepspeed==0.18.7
2026-03-05T21:46:16,410   Created temporary directory: /tmp/pip-unpack-lnxbk61m
2026-03-05T21:46:16,543   Downloading deepspeed-0.18.7.tar.gz (1.6 MB)
2026-03-05T21:46:19,773   Added deepspeed==0.18.7 from https://files.pythonhosted.org/packages/30/00/ad310cf94e0e397c416087e6c4dc782429292206b2b1a3ffbd388ac95a67/deepspeed-0.18.7.tar.gz to build tracker '/tmp/pip-build-tracker-v4ot7po8'
2026-03-05T21:46:19,775   Running setup.py (path:/tmp/pip-wheel-dp5x59vt/deepspeed_1f534b364d8c4f70af27d5765e6fd321/setup.py) egg_info for package deepspeed
2026-03-05T21:46:19,776   Created temporary directory: /tmp/pip-pip-egg-info-skwc3llj
2026-03-05T21:46:19,777   Preparing metadata (setup.py): started
2026-03-05T21:46:19,778   Running command python setup.py egg_info
2026-03-05T21:46:20,823   fatal: not a git repository (or any of the parent directories): .git
2026-03-05T21:46:21,336   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2026-03-05T21:46:21,336    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2026-03-05T21:46:21,337   DS_BUILD_OPS=0
2026-03-05T21:46:21,337   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2026-03-05T21:46:21,338   version=0.18.7, git_hash=unknown, git_branch=unknown
2026-03-05T21:46:21,338   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2026-03-05T21:46:21,339   ext_modules=[]
2026-03-05T21:46:21,339   running egg_info
2026-03-05T21:46:21,364   creating /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info
2026-03-05T21:46:21,365   writing /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/PKG-INFO
2026-03-05T21:46:21,389   writing dependency_links to /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/dependency_links.txt
2026-03-05T21:46:21,390   writing entry points to /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/entry_points.txt
2026-03-05T21:46:21,403   writing requirements to /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/requires.txt
2026-03-05T21:46:21,405   writing top-level names to /tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/top_level.txt
2026-03-05T21:46:21,406   writing manifest file '/tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/SOURCES.txt'
2026-03-05T21:46:21,660   reading manifest file '/tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/SOURCES.txt'
2026-03-05T21:46:21,661   reading manifest template 'MANIFEST.in'
2026-03-05T21:46:21,663   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2026-03-05T21:46:21,664   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2026-03-05T21:46:23,403   warning: no files found matching '*.hip' under directory 'deepspeed'
2026-03-05T21:46:24,455   warning: no files found matching '*.cc' under directory 'deepspeed'
2026-03-05T21:46:25,170   warning: no files found matching '*.tr' under directory 'csrc'
2026-03-05T21:46:25,307   warning: no files found matching '*.cc' under directory 'csrc'
2026-03-05T21:46:25,360   warning: no files found matching '*.py' under directory 'benchmarks'
2026-03-05T21:46:25,367   adding license file 'LICENSE'
2026-03-05T21:46:25,408   writing manifest file '/tmp/pip-pip-egg-info-skwc3llj/deepspeed.egg-info/SOURCES.txt'
2026-03-05T21:46:25,411   deepspeed build time = 4.584850311279297 secs
2026-03-05T21:46:25,527   Preparing metadata (setup.py): finished with status 'done'
2026-03-05T21:46:25,533   Source in /tmp/pip-wheel-dp5x59vt/deepspeed_1f534b364d8c4f70af27d5765e6fd321 has version 0.18.7, which satisfies requirement deepspeed==0.18.7 from https://files.pythonhosted.org/packages/30/00/ad310cf94e0e397c416087e6c4dc782429292206b2b1a3ffbd388ac95a67/deepspeed-0.18.7.tar.gz
2026-03-05T21:46:25,534   Removed deepspeed==0.18.7 from https://files.pythonhosted.org/packages/30/00/ad310cf94e0e397c416087e6c4dc782429292206b2b1a3ffbd388ac95a67/deepspeed-0.18.7.tar.gz from build tracker '/tmp/pip-build-tracker-v4ot7po8'
2026-03-05T21:46:25,543 Created temporary directory: /tmp/pip-unpack-fhjm4rwg
2026-03-05T21:46:25,544 Building wheels for collected packages: deepspeed
2026-03-05T21:46:25,549   Created temporary directory: /tmp/pip-wheel-dqq986g_
2026-03-05T21:46:25,549   Building wheel for deepspeed (setup.py): started
2026-03-05T21:46:25,550   Destination directory: /tmp/pip-wheel-dqq986g_
2026-03-05T21:46:25,551   Running command python setup.py bdist_wheel
2026-03-05T21:46:26,073   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2026-03-05T21:46:26,076    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2026-03-05T21:46:26,207   DS_BUILD_OPS=0
2026-03-05T21:46:26,320   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2026-03-05T21:46:26,339   fatal: not a git repository (or any of the parent directories): .git
2026-03-05T21:46:26,340   version=0.18.7, git_hash=unknown, git_branch=unknown
2026-03-05T21:46:26,341   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2026-03-05T21:46:26,341   ext_modules=[]
2026-03-05T21:46:26,728   running bdist_wheel
2026-03-05T21:46:26,860   running build
2026-03-05T21:46:26,860   running build_py
2026-03-05T21:46:26,890   creating build/lib/deepspeed
2026-03-05T21:46:26,892   copying deepspeed/constants.py -> build/lib/deepspeed
2026-03-05T21:46:26,894   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2026-03-05T21:46:26,896   copying deepspeed/compat.py -> build/lib/deepspeed
2026-03-05T21:46:26,898   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2026-03-05T21:46:26,900   copying deepspeed/__init__.py -> build/lib/deepspeed
2026-03-05T21:46:26,902   copying deepspeed/env_report.py -> build/lib/deepspeed
2026-03-05T21:46:26,905   creating build/lib/deepspeed/linear
2026-03-05T21:46:26,906   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2026-03-05T21:46:26,908   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2026-03-05T21:46:26,910   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2026-03-05T21:46:26,912   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2026-03-05T21:46:26,914   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2026-03-05T21:46:26,917   creating build/lib/deepspeed/ops
2026-03-05T21:46:26,918   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2026-03-05T21:46:26,920   creating build/lib/deepspeed/autotuning
2026-03-05T21:46:26,921   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,924   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,926   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,929   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,930   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,934   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2026-03-05T21:46:26,937   creating build/lib/deepspeed/pipe
2026-03-05T21:46:26,938   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2026-03-05T21:46:26,940   creating build/lib/deepspeed/compile
2026-03-05T21:46:26,941   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,944   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,945   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,947   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,950   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,952   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,954   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,956   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,958   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,960   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,962   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,964   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,967   copying deepspeed/compile/input_storage.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,968   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2026-03-05T21:46:26,971   creating build/lib/deepspeed/elasticity
2026-03-05T21:46:26,972   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,974   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,976   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,977   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,979   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,982   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2026-03-05T21:46:26,984   creating build/lib/deepspeed/nvme
2026-03-05T21:46:26,985   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,987   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,989   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,991   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,992   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,994   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,996   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:26,998   copying deepspeed/nvme/torch_io.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,000   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,002   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,004   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,006   copying deepspeed/nvme/torch_fastio_engine.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,008   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,010   copying deepspeed/nvme/io_engine.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,012   copying deepspeed/nvme/ds_aio_constants.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,014   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2026-03-05T21:46:27,016   creating build/lib/deepspeed/inference
2026-03-05T21:46:27,017   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2026-03-05T21:46:27,019   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2026-03-05T21:46:27,021   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2026-03-05T21:46:27,024   creating build/lib/deepspeed/profiling
2026-03-05T21:46:27,025   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2026-03-05T21:46:27,027   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2026-03-05T21:46:27,029   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2026-03-05T21:46:27,031   creating build/lib/deepspeed/accelerator
2026-03-05T21:46:27,032   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,035   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,037   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,040   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,042   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,044   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,046   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,048   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,050   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,052   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,054   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2026-03-05T21:46:27,056   creating build/lib/deepspeed/model_implementations
2026-03-05T21:46:27,057   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2026-03-05T21:46:27,060   creating build/lib/deepspeed/sequence
2026-03-05T21:46:27,061   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2026-03-05T21:46:27,063   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2026-03-05T21:46:27,065   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2026-03-05T21:46:27,067   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2026-03-05T21:46:27,071   creating build/lib/deepspeed/utils
2026-03-05T21:46:27,072   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,074   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,076   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,078   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,080   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,081   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,084   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,086   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,089   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,091   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,093   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,095   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,097   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,099   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,101   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,103   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,106   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,108   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2026-03-05T21:46:27,110   creating build/lib/deepspeed/comm
2026-03-05T21:46:27,111   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,113   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,115   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,117   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,118   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,121   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,123   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,125   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,127   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2026-03-05T21:46:27,130   creating build/lib/deepspeed/moe
2026-03-05T21:46:27,131   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,133   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,135   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,137   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,139   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,140   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2026-03-05T21:46:27,143   creating build/lib/deepspeed/monitor
2026-03-05T21:46:27,144   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,146   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,148   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,150   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,151   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,153   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,155   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,157   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2026-03-05T21:46:27,160   creating build/lib/deepspeed/runtime
2026-03-05T21:46:27,161   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,163   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,167   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,169   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,171   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,173   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,175   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,177   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,180   copying deepspeed/runtime/precision_config.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,182   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,185   copying deepspeed/runtime/torch_autocast.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,187   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,189   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,191   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,193   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,195   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,198   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,204   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,207   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,209   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2026-03-05T21:46:27,212   creating build/lib/deepspeed/nebula
2026-03-05T21:46:27,213   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2026-03-05T21:46:27,215   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2026-03-05T21:46:27,216   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2026-03-05T21:46:27,219   creating build/lib/deepspeed/io
2026-03-05T21:46:27,220   copying deepspeed/io/utils.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,222   copying deepspeed/io/single_io_buffer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,224   copying deepspeed/io/constants.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,226   copying deepspeed/io/py_file_writer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,228   copying deepspeed/io/fast_file_writer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,230   copying deepspeed/io/__init__.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,232   copying deepspeed/io/base_io_buffer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,233   copying deepspeed/io/base_file_writer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,235   copying deepspeed/io/mock_file_writer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,237   copying deepspeed/io/double_io_buffer.py -> build/lib/deepspeed/io
2026-03-05T21:46:27,239   creating build/lib/deepspeed/compression
2026-03-05T21:46:27,240   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,242   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,245   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,247   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,249   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,251   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,254   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,257   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2026-03-05T21:46:27,260   creating build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,261   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,263   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,265   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,267   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,269   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,271   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,274   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,275   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,278   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,280   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2026-03-05T21:46:27,283   creating build/lib/deepspeed/launcher
2026-03-05T21:46:27,284   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,286   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,288   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,290   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,292   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,295   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2026-03-05T21:46:27,298   creating build/lib/deepspeed/module_inject
2026-03-05T21:46:27,299   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,301   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,303   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,305   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,308   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,310   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,313   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,316   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,318   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,321   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,323   copying deepspeed/module_inject/autotp_config.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,326   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,328   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,330   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2026-03-05T21:46:27,332   creating build/lib/deepspeed/datastates
2026-03-05T21:46:27,333   copying deepspeed/datastates/__init__.py -> build/lib/deepspeed/datastates
2026-03-05T21:46:27,335   copying deepspeed/datastates/config.py -> build/lib/deepspeed/datastates
2026-03-05T21:46:27,337   creating build/lib/deepspeed/ops/gds
2026-03-05T21:46:27,338   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2026-03-05T21:46:27,340   creating build/lib/deepspeed/ops/quantizer
2026-03-05T21:46:27,341   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2026-03-05T21:46:27,343   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2026-03-05T21:46:27,345   creating build/lib/deepspeed/ops/compile
2026-03-05T21:46:27,346   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2026-03-05T21:46:27,349   creating build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,350   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,352   copying deepspeed/ops/adam/zenflow_torch_adam.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,355   copying deepspeed/ops/adam/zenflow_cpu_adam.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,357   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,359   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,361   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2026-03-05T21:46:27,363   creating build/lib/deepspeed/ops/adagrad
2026-03-05T21:46:27,364   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2026-03-05T21:46:27,366   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2026-03-05T21:46:27,369   creating build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,370   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,372   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,374   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,375   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,377   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,379   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,381   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,383   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,385   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,387   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,389   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,390   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,392   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,394   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,396   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,398   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,400   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,401   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,403   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,405   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,406   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,408   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,411   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,413   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,415   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,417   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2026-03-05T21:46:27,420   creating build/lib/deepspeed/ops/aio
2026-03-05T21:46:27,421   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2026-03-05T21:46:27,423   creating build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,424   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,426   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,428   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,431   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,433   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,435   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,438   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2026-03-05T21:46:27,441   creating build/lib/deepspeed/ops/lamb
2026-03-05T21:46:27,442   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2026-03-05T21:46:27,444   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2026-03-05T21:46:27,446   creating build/lib/deepspeed/ops/transformer
2026-03-05T21:46:27,447   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2026-03-05T21:46:27,450   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2026-03-05T21:46:27,452   creating build/lib/deepspeed/ops/lion
2026-03-05T21:46:27,453   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2026-03-05T21:46:27,456   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2026-03-05T21:46:27,458   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2026-03-05T21:46:27,460   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2026-03-05T21:46:27,463   creating build/lib/deepspeed/ops/random_ltd
2026-03-05T21:46:27,464   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2026-03-05T21:46:27,466   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2026-03-05T21:46:27,469   creating build/lib/deepspeed/ops/fp_quantizer
2026-03-05T21:46:27,470   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2026-03-05T21:46:27,472   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2026-03-05T21:46:27,473   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2026-03-05T21:46:27,476   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2026-03-05T21:46:27,478   creating build/lib/deepspeed/ops/deepspeed4science
2026-03-05T21:46:27,479   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2026-03-05T21:46:27,481   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2026-03-05T21:46:27,484   creating build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,484   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,486   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,488   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,490   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,492   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,493   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,495   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:27,498   creating build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,499   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,501   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,503   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,505   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,507   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,509   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,511   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,513   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,515   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2026-03-05T21:46:27,517   creating build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,518   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,520   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,522   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,524   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,526   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:27,528   creating build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,530   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,532   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,534   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,536   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,538   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,540   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,542   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,544   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,546   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:27,548   creating build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,549   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,552   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,553   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,555   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,557   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,559   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:27,561   creating build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,563   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,565   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,566   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,568   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,570   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,572   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,575   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:27,577   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:27,578   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:27,581   creating build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,582   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,584   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,587   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,589   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,591   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,593   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,595   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,597   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,600   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,602   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2026-03-05T21:46:27,605   creating build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,607   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,609   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,612   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,614   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,616   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,617   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,619   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,622   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,624   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,626   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:27,629   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,631   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,633   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,635   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,637   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,639   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,641   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,643   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,645   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,647   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,649   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,651   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,653   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,655   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,657   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,659   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,662   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,664   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,666   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,668   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,671   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,672   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,674   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,676   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:27,679   creating build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,680   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,682   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,683   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,685   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,687   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,689   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2026-03-05T21:46:27,691   creating build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,692   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,694   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,697   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,699   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,701   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,703   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,705   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,707   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2026-03-05T21:46:27,709   creating build/lib/deepspeed/compile/profilers
2026-03-05T21:46:27,710   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2026-03-05T21:46:27,713   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2026-03-05T21:46:27,715   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2026-03-05T21:46:27,718   creating build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,719   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,721   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,723   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,725   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,727   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,729   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,731   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,733   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,735   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2026-03-05T21:46:27,738   creating build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,739   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,741   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,743   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,745   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,747   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2026-03-05T21:46:27,749   creating build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,751   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,753   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,755   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,757   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,760   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,762   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,764   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2026-03-05T21:46:27,767   creating build/lib/deepspeed/inference/v2/modules
2026-03-05T21:46:27,768   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2026-03-05T21:46:27,770   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2026-03-05T21:46:27,772   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2026-03-05T21:46:27,774   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2026-03-05T21:46:27,776   creating build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,778   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,780   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,783   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,785   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,788   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,790   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,792   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:27,795   creating build/lib/deepspeed/inference/v2/kernels
2026-03-05T21:46:27,796   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2026-03-05T21:46:27,798   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2026-03-05T21:46:27,800   creating build/lib/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:27,801   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:27,803   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:27,805   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:27,807   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:27,809   creating build/lib/deepspeed/inference/v2/modules/implementations
2026-03-05T21:46:27,810   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2026-03-05T21:46:27,813   creating build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,814   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,816   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,818   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,819   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,821   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,823   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,825   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:27,827   creating build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,828   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,830   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,833   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,835   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,837   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,838   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,840   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,842   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:27,845   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:27,846   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:27,848   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:27,850   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:27,853   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:27,854   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:27,856   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:27,858   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:27,859   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:27,862   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:27,864   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:27,865   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:27,867   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:27,869   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:27,870   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:27,872   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:27,875   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:27,876   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:27,878   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:27,880   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:27,881   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:27,883   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:27,886   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:27,888   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:27,889   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:27,891   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:27,894   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:27,896   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:27,898   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,899   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,901   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,904   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,906   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,908   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,910   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,912   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,914   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,916   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:27,918   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,920   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,922   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,923   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,925   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,927   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,929   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,931   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,933   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,935   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:27,937   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:27,938   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:27,940   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:27,943   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:27,945   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:27,947   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:27,948   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:27,950   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:27,953   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:27,954   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:27,957   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:27,958   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:27,960   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:27,962   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:27,964   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:27,966   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:27,967   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:27,970   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:27,972   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:27,974   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:27,976   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:27,977   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:27,979   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:27,981   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:27,983   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:27,986   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:27,987   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:27,989   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:27,991   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:27,993   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:27,995   creating build/lib/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:27,997   copying deepspeed/inference/v2/model_implementations/exaone4/container.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:27,999   copying deepspeed/inference/v2/model_implementations/exaone4/model.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:28,001   copying deepspeed/inference/v2/model_implementations/exaone4/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:28,003   copying deepspeed/inference/v2/model_implementations/exaone4/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:28,005   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:28,007   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:28,009   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:28,011   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:28,013   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:28,015   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:28,016   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:28,018   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:28,020   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:28,023   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:28,026   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:28,027   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:28,029   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:28,031   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:28,033   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:28,035   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:28,036   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:28,038   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:28,039   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:28,041   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:28,042   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:28,045   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:28,046   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:28,048   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:28,050   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:28,051   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:28,053   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:28,055   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:28,057   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:28,058   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:28,060   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:28,062   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:28,064   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:28,067   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:28,068   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:28,070   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:28,072   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:28,073   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:28,075   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:28,078   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:28,079   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:28,081   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:28,083   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:28,084   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:28,086   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:28,088   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:28,089   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:28,091   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:28,094   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:28,095   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:28,097   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:28,099   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:28,100   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:28,102   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:28,104   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:28,105   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:28,107   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:28,109   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:28,111   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:28,113   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:28,114   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:28,117   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:28,119   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,120   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,122   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,124   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,126   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,127   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:28,130   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:28,131   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:28,132   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:28,135   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:28,136   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:28,138   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:28,140   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:28,141   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:28,143   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:28,145   creating build/lib/deepspeed/profiling/flops_profiler
2026-03-05T21:46:28,146   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2026-03-05T21:46:28,149   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2026-03-05T21:46:28,151   creating build/lib/deepspeed/model_implementations/features
2026-03-05T21:46:28,152   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2026-03-05T21:46:28,154   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2026-03-05T21:46:28,157   creating build/lib/deepspeed/model_implementations/diffusers
2026-03-05T21:46:28,158   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2026-03-05T21:46:28,160   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2026-03-05T21:46:28,162   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2026-03-05T21:46:28,164   creating build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,165   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,168   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,170   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,171   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,173   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,175   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,177   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,179   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,181   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,183   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2026-03-05T21:46:28,186   creating build/lib/deepspeed/runtime/fp16
2026-03-05T21:46:28,187   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2026-03-05T21:46:28,190   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2026-03-05T21:46:28,192   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2026-03-05T21:46:28,195   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2026-03-05T21:46:28,197   creating build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,199   copying deepspeed/runtime/model_checkpointing/utils.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,201   copying deepspeed/runtime/model_checkpointing/constants.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,203   copying deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,205   copying deepspeed/runtime/model_checkpointing/__init__.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,207   copying deepspeed/runtime/model_checkpointing/config.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,210   copying deepspeed/runtime/model_checkpointing/writer_factory.py -> build/lib/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:28,212   creating build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,214   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,216   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,219   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,221   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,223   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,227   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2026-03-05T21:46:28,230   creating build/lib/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:28,231   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:28,232   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:28,235   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:28,237   copying deepspeed/runtime/tensor_parallel/init_utils.py -> build/lib/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:28,240   creating build/lib/deepspeed/runtime/superoffload
2026-03-05T21:46:28,241   copying deepspeed/runtime/superoffload/superoffload_stage3.py -> build/lib/deepspeed/runtime/superoffload
2026-03-05T21:46:28,243   copying deepspeed/runtime/superoffload/__init__.py -> build/lib/deepspeed/runtime/superoffload
2026-03-05T21:46:28,245   copying deepspeed/runtime/superoffload/superoffload_utils.py -> build/lib/deepspeed/runtime/superoffload
2026-03-05T21:46:28,248   creating build/lib/deepspeed/runtime/data_pipeline
2026-03-05T21:46:28,249   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2026-03-05T21:46:28,251   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2026-03-05T21:46:28,253   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2026-03-05T21:46:28,255   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2026-03-05T21:46:28,257   creating build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,258   copying deepspeed/runtime/zenflow/zenflow_config.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,260   copying deepspeed/runtime/zenflow/zenflow_utils.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,263   copying deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,265   copying deepspeed/runtime/zenflow/__init__.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,267   copying deepspeed/runtime/zenflow/engine_stage3.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,270   copying deepspeed/runtime/zenflow/engine.py -> build/lib/deepspeed/runtime/zenflow
2026-03-05T21:46:28,273   creating build/lib/deepspeed/runtime/sequence_parallel
2026-03-05T21:46:28,274   copying deepspeed/runtime/sequence_parallel/__init__.py -> build/lib/deepspeed/runtime/sequence_parallel
2026-03-05T21:46:28,276   copying deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2026-03-05T21:46:28,278   copying deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/lib/deepspeed/runtime/sequence_parallel
2026-03-05T21:46:28,281   creating build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,282   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,284   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,286   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,289   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,291   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,293   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,295   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,297   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,300   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2026-03-05T21:46:28,303   creating build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,304   copying deepspeed/runtime/comm/utils.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,306   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,309   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,312   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,314   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,316   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,319   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2026-03-05T21:46:28,321   creating build/lib/deepspeed/runtime/domino
2026-03-05T21:46:28,322   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2026-03-05T21:46:28,326   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2026-03-05T21:46:28,329   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2026-03-05T21:46:28,331   creating build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,332   copying deepspeed/runtime/checkpoint_engine/utils.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,334   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,336   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,337   copying deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,340   copying deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,341   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,343   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,345   copying deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:28,348   creating build/lib/deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:28,349   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:28,352   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:28,354   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:28,357   creating build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,358   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,360   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,363   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,366   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,372   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,375   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,377   copying deepspeed/runtime/zero/leaf_module_config.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,379   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,381   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,383   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,386   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,388   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,391   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,393   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,397   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,399   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,406   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,408   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2026-03-05T21:46:28,410   creating build/lib/deepspeed/runtime/compression
2026-03-05T21:46:28,411   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2026-03-05T21:46:28,413   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2026-03-05T21:46:28,415   creating build/lib/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:28,416   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:28,419   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:28,421   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:28,423   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:28,426   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,427   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,429   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,431   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,433   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,436   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:28,438   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,439   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,441   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,444   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,445   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,448   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,450   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:28,454   creating build/lib/deepspeed/runtime/zero/muon
2026-03-05T21:46:28,455   copying deepspeed/runtime/zero/muon/__init__.py -> build/lib/deepspeed/runtime/zero/muon
2026-03-05T21:46:28,457   copying deepspeed/runtime/zero/muon/muon_optimizer.py -> build/lib/deepspeed/runtime/zero/muon
2026-03-05T21:46:28,459   copying deepspeed/runtime/zero/muon/original_muon.py -> build/lib/deepspeed/runtime/zero/muon
2026-03-05T21:46:28,462   creating build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,463   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,466   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,469   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,470   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,472   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,475   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,477   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,479   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,482   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,483   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,485   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,487   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,489   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,491   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,494   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,496   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,498   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,500   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,502   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2026-03-05T21:46:28,505   creating build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,506   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,509   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,510   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,512   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,515   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,517   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,519   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2026-03-05T21:46:28,522   running egg_info
2026-03-05T21:46:28,549   writing deepspeed.egg-info/PKG-INFO
2026-03-05T21:46:28,573   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2026-03-05T21:46:28,575   writing entry points to deepspeed.egg-info/entry_points.txt
2026-03-05T21:46:28,589   writing requirements to deepspeed.egg-info/requires.txt
2026-03-05T21:46:28,590   writing top-level names to deepspeed.egg-info/top_level.txt
2026-03-05T21:46:28,734   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2026-03-05T21:46:28,800   reading manifest template 'MANIFEST.in'
2026-03-05T21:46:28,802   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2026-03-05T21:46:28,803   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2026-03-05T21:46:30,532   warning: no files found matching '*.hip' under directory 'deepspeed'
2026-03-05T21:46:31,587   warning: no files found matching '*.cc' under directory 'deepspeed'
2026-03-05T21:46:32,331   warning: no files found matching '*.tr' under directory 'csrc'
2026-03-05T21:46:32,467   warning: no files found matching '*.cc' under directory 'csrc'
2026-03-05T21:46:32,515   warning: no files found matching '*.py' under directory 'benchmarks'
2026-03-05T21:46:32,521   adding license file 'LICENSE'
2026-03-05T21:46:32,575   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2026-03-05T21:46:32,584   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2026-03-05T21:46:32,584   !!

2026-03-05T21:46:32,585           ********************************************************************************
2026-03-05T21:46:32,586           ############################
2026-03-05T21:46:32,586           # Package would be ignored #
2026-03-05T21:46:32,587           ############################
2026-03-05T21:46:32,587           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2026-03-05T21:46:32,588           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,589           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,589           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2026-03-05T21:46:32,590           to the `packages` configuration field.

2026-03-05T21:46:32,591           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,591           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,591           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,592           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,593           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,595           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2026-03-05T21:46:32,595           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2026-03-05T21:46:32,596           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,597           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,597           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,599           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,600           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,602           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,602                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,603                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,603                 directory, all directories are treated like packages.
2026-03-05T21:46:32,604           ********************************************************************************

2026-03-05T21:46:32,605   !!
2026-03-05T21:46:32,605     check.warn(importable)
2026-03-05T21:46:32,606   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2026-03-05T21:46:32,606   !!

2026-03-05T21:46:32,608           ********************************************************************************
2026-03-05T21:46:32,608           ############################
2026-03-05T21:46:32,609           # Package would be ignored #
2026-03-05T21:46:32,609           ############################
2026-03-05T21:46:32,610           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2026-03-05T21:46:32,610           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,611           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,612           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2026-03-05T21:46:32,613           to the `packages` configuration field.

2026-03-05T21:46:32,613           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,614           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,614           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,615           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,616           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,616           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2026-03-05T21:46:32,617           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2026-03-05T21:46:32,617           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,617           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,618           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,619           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,619           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,620           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,621                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,621                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,622                 directory, all directories are treated like packages.
2026-03-05T21:46:32,622           ********************************************************************************

2026-03-05T21:46:32,623   !!
2026-03-05T21:46:32,624     check.warn(importable)
2026-03-05T21:46:32,624   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2026-03-05T21:46:32,625   !!

2026-03-05T21:46:32,626           ********************************************************************************
2026-03-05T21:46:32,627           ############################
2026-03-05T21:46:32,627           # Package would be ignored #
2026-03-05T21:46:32,628           ############################
2026-03-05T21:46:32,628           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2026-03-05T21:46:32,629           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,630           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,631           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2026-03-05T21:46:32,631           to the `packages` configuration field.

2026-03-05T21:46:32,632           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,633           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,633           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,634           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,635           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,636           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2026-03-05T21:46:32,637           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2026-03-05T21:46:32,637           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,638           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,639           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,639           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,640           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,641           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,642                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,642                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,642                 directory, all directories are treated like packages.
2026-03-05T21:46:32,643           ********************************************************************************

2026-03-05T21:46:32,644   !!
2026-03-05T21:46:32,644     check.warn(importable)
2026-03-05T21:46:32,644   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2026-03-05T21:46:32,645   !!

2026-03-05T21:46:32,645           ********************************************************************************
2026-03-05T21:46:32,646           ############################
2026-03-05T21:46:32,646           # Package would be ignored #
2026-03-05T21:46:32,647           ############################
2026-03-05T21:46:32,647           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2026-03-05T21:46:32,648           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,648           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,649           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2026-03-05T21:46:32,650           to the `packages` configuration field.

2026-03-05T21:46:32,651           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,651           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,652           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,653           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,654           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,655           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2026-03-05T21:46:32,656           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2026-03-05T21:46:32,656           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,657           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,657           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,658           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,659           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,661           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,661                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,661                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,662                 directory, all directories are treated like packages.
2026-03-05T21:46:32,663           ********************************************************************************

2026-03-05T21:46:32,664   !!
2026-03-05T21:46:32,664     check.warn(importable)
2026-03-05T21:46:32,665   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2026-03-05T21:46:32,665   !!

2026-03-05T21:46:32,667           ********************************************************************************
2026-03-05T21:46:32,667           ############################
2026-03-05T21:46:32,667           # Package would be ignored #
2026-03-05T21:46:32,668           ############################
2026-03-05T21:46:32,668           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2026-03-05T21:46:32,668           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,669           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,669           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2026-03-05T21:46:32,670           to the `packages` configuration field.

2026-03-05T21:46:32,670           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,671           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,671           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,672           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,673           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,673           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2026-03-05T21:46:32,674           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2026-03-05T21:46:32,674           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,675           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,675           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,677           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,678           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,679           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,680                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,681                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,681                 directory, all directories are treated like packages.
2026-03-05T21:46:32,682           ********************************************************************************

2026-03-05T21:46:32,683   !!
2026-03-05T21:46:32,683     check.warn(importable)
2026-03-05T21:46:32,684   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2026-03-05T21:46:32,684   !!

2026-03-05T21:46:32,685           ********************************************************************************
2026-03-05T21:46:32,686           ############################
2026-03-05T21:46:32,686           # Package would be ignored #
2026-03-05T21:46:32,687           ############################
2026-03-05T21:46:32,687           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2026-03-05T21:46:32,687           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,689           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,689           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2026-03-05T21:46:32,690           to the `packages` configuration field.

2026-03-05T21:46:32,691           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,691           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,692           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,693           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,693           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,694           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2026-03-05T21:46:32,694           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2026-03-05T21:46:32,695           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,695           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,696           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,696           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,697           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,698           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,699                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,699                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,700                 directory, all directories are treated like packages.
2026-03-05T21:46:32,700           ********************************************************************************

2026-03-05T21:46:32,701   !!
2026-03-05T21:46:32,701     check.warn(importable)
2026-03-05T21:46:32,702   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2026-03-05T21:46:32,702   !!

2026-03-05T21:46:32,703           ********************************************************************************
2026-03-05T21:46:32,704           ############################
2026-03-05T21:46:32,704           # Package would be ignored #
2026-03-05T21:46:32,705           ############################
2026-03-05T21:46:32,706           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2026-03-05T21:46:32,706           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,707           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,708           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2026-03-05T21:46:32,708           to the `packages` configuration field.

2026-03-05T21:46:32,709           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,710           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,710           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,711           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,712           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,713           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2026-03-05T21:46:32,714           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2026-03-05T21:46:32,714           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,715           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,715           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,716           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,718           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,719           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,720                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,720                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,720                 directory, all directories are treated like packages.
2026-03-05T21:46:32,721           ********************************************************************************

2026-03-05T21:46:32,721   !!
2026-03-05T21:46:32,722     check.warn(importable)
2026-03-05T21:46:32,722   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2026-03-05T21:46:32,722   !!

2026-03-05T21:46:32,723           ********************************************************************************
2026-03-05T21:46:32,723           ############################
2026-03-05T21:46:32,724           # Package would be ignored #
2026-03-05T21:46:32,724           ############################
2026-03-05T21:46:32,724           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2026-03-05T21:46:32,725           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,726           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,726           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2026-03-05T21:46:32,726           to the `packages` configuration field.

2026-03-05T21:46:32,727           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,728           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,728           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,729           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,731           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,732           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2026-03-05T21:46:32,732           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2026-03-05T21:46:32,733           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,734           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,735           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,736           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,737           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,737                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,738                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,738                 directory, all directories are treated like packages.
2026-03-05T21:46:32,739           ********************************************************************************

2026-03-05T21:46:32,740   !!
2026-03-05T21:46:32,740     check.warn(importable)
2026-03-05T21:46:32,741   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2026-03-05T21:46:32,741   !!

2026-03-05T21:46:32,742           ********************************************************************************
2026-03-05T21:46:32,743           ############################
2026-03-05T21:46:32,743           # Package would be ignored #
2026-03-05T21:46:32,744           ############################
2026-03-05T21:46:32,744           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2026-03-05T21:46:32,745           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,746           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,746           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2026-03-05T21:46:32,746           to the `packages` configuration field.

2026-03-05T21:46:32,747           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,747           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,748           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,749           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,750           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,751           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2026-03-05T21:46:32,751           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2026-03-05T21:46:32,752           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,752           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,752           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,753           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,754           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,755           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,756                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,756                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,757                 directory, all directories are treated like packages.
2026-03-05T21:46:32,758           ********************************************************************************

2026-03-05T21:46:32,759   !!
2026-03-05T21:46:32,759     check.warn(importable)
2026-03-05T21:46:32,760   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2026-03-05T21:46:32,760   !!

2026-03-05T21:46:32,761           ********************************************************************************
2026-03-05T21:46:32,762           ############################
2026-03-05T21:46:32,763           # Package would be ignored #
2026-03-05T21:46:32,763           ############################
2026-03-05T21:46:32,764           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2026-03-05T21:46:32,764           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,765           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,766           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2026-03-05T21:46:32,766           to the `packages` configuration field.

2026-03-05T21:46:32,767           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,767           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,768           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,769           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,770           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,771           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2026-03-05T21:46:32,772           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2026-03-05T21:46:32,772           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,773           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,774           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,775           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,775           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,776           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,777                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,777                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,777                 directory, all directories are treated like packages.
2026-03-05T21:46:32,778           ********************************************************************************

2026-03-05T21:46:32,779   !!
2026-03-05T21:46:32,779     check.warn(importable)
2026-03-05T21:46:32,779   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2026-03-05T21:46:32,780   !!

2026-03-05T21:46:32,781           ********************************************************************************
2026-03-05T21:46:32,781           ############################
2026-03-05T21:46:32,781           # Package would be ignored #
2026-03-05T21:46:32,782           ############################
2026-03-05T21:46:32,782           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2026-03-05T21:46:32,783           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,783           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,784           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2026-03-05T21:46:32,785           to the `packages` configuration field.

2026-03-05T21:46:32,786           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,786           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,787           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,788           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,789           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,790           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2026-03-05T21:46:32,790           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2026-03-05T21:46:32,791           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,791           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,792           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,793           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,793           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,795           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,795                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,796                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,796                 directory, all directories are treated like packages.
2026-03-05T21:46:32,797           ********************************************************************************

2026-03-05T21:46:32,798   !!
2026-03-05T21:46:32,798     check.warn(importable)
2026-03-05T21:46:32,799   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2026-03-05T21:46:32,800   !!

2026-03-05T21:46:32,801           ********************************************************************************
2026-03-05T21:46:32,801           ############################
2026-03-05T21:46:32,801           # Package would be ignored #
2026-03-05T21:46:32,802           ############################
2026-03-05T21:46:32,802           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2026-03-05T21:46:32,802           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,803           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,803           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2026-03-05T21:46:32,804           to the `packages` configuration field.

2026-03-05T21:46:32,804           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,805           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,805           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,806           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,807           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,808           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2026-03-05T21:46:32,808           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2026-03-05T21:46:32,808           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,809           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,809           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,810           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,811           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,813           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,814                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,814                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,815                 directory, all directories are treated like packages.
2026-03-05T21:46:32,815           ********************************************************************************

2026-03-05T21:46:32,816   !!
2026-03-05T21:46:32,817     check.warn(importable)
2026-03-05T21:46:32,818   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2026-03-05T21:46:32,818   !!

2026-03-05T21:46:32,819           ********************************************************************************
2026-03-05T21:46:32,819           ############################
2026-03-05T21:46:32,820           # Package would be ignored #
2026-03-05T21:46:32,820           ############################
2026-03-05T21:46:32,821           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2026-03-05T21:46:32,821           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,822           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,823           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2026-03-05T21:46:32,823           to the `packages` configuration field.

2026-03-05T21:46:32,824           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,825           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,826           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,827           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,828           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,829           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2026-03-05T21:46:32,829           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2026-03-05T21:46:32,830           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,830           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,830           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,831           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,832           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,833           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,833                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,834                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,834                 directory, all directories are treated like packages.
2026-03-05T21:46:32,834           ********************************************************************************

2026-03-05T21:46:32,835   !!
2026-03-05T21:46:32,836     check.warn(importable)
2026-03-05T21:46:32,836   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2026-03-05T21:46:32,836   !!

2026-03-05T21:46:32,837           ********************************************************************************
2026-03-05T21:46:32,838           ############################
2026-03-05T21:46:32,838           # Package would be ignored #
2026-03-05T21:46:32,839           ############################
2026-03-05T21:46:32,839           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2026-03-05T21:46:32,840           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,841           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,841           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2026-03-05T21:46:32,842           to the `packages` configuration field.

2026-03-05T21:46:32,843           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,844           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,844           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,845           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,846           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,847           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2026-03-05T21:46:32,848           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2026-03-05T21:46:32,848           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,848           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,849           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,850           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,851           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,853           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,853                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,854                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,854                 directory, all directories are treated like packages.
2026-03-05T21:46:32,855           ********************************************************************************

2026-03-05T21:46:32,856   !!
2026-03-05T21:46:32,856     check.warn(importable)
2026-03-05T21:46:32,856   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2026-03-05T21:46:32,857   !!

2026-03-05T21:46:32,857           ********************************************************************************
2026-03-05T21:46:32,858           ############################
2026-03-05T21:46:32,858           # Package would be ignored #
2026-03-05T21:46:32,858           ############################
2026-03-05T21:46:32,859           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2026-03-05T21:46:32,859           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,860           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,860           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2026-03-05T21:46:32,860           to the `packages` configuration field.

2026-03-05T21:46:32,861           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,861           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,862           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,863           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,864           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,865           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2026-03-05T21:46:32,865           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2026-03-05T21:46:32,866           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,867           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,868           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,869           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,870           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,871                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,871                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,872                 directory, all directories are treated like packages.
2026-03-05T21:46:32,872           ********************************************************************************

2026-03-05T21:46:32,873   !!
2026-03-05T21:46:32,873     check.warn(importable)
2026-03-05T21:46:32,874   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2026-03-05T21:46:32,874   !!

2026-03-05T21:46:32,875           ********************************************************************************
2026-03-05T21:46:32,876           ############################
2026-03-05T21:46:32,876           # Package would be ignored #
2026-03-05T21:46:32,877           ############################
2026-03-05T21:46:32,877           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2026-03-05T21:46:32,878           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,879           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,880           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2026-03-05T21:46:32,880           to the `packages` configuration field.

2026-03-05T21:46:32,882           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,882           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,882           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,883           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,884           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,885           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2026-03-05T21:46:32,885           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2026-03-05T21:46:32,885           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,886           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,886           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,887           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,888           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,889           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,889                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,890                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,890                 directory, all directories are treated like packages.
2026-03-05T21:46:32,891           ********************************************************************************

2026-03-05T21:46:32,892   !!
2026-03-05T21:46:32,892     check.warn(importable)
2026-03-05T21:46:32,893   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.arm64' is absent from the `packages` configuration.
2026-03-05T21:46:32,893   !!

2026-03-05T21:46:32,895           ********************************************************************************
2026-03-05T21:46:32,895           ############################
2026-03-05T21:46:32,896           # Package would be ignored #
2026-03-05T21:46:32,896           ############################
2026-03-05T21:46:32,897           Python recognizes 'deepspeed.ops.csrc.cpu.comm.arm64' as an importable package[^1],
2026-03-05T21:46:32,897           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,898           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,899           package, please make sure that 'deepspeed.ops.csrc.cpu.comm.arm64' is explicitly added
2026-03-05T21:46:32,900           to the `packages` configuration field.

2026-03-05T21:46:32,901           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,901           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,902           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,903           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,904           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,905           If you don't want 'deepspeed.ops.csrc.cpu.comm.arm64' to be distributed and are
2026-03-05T21:46:32,906           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.arm64' via
2026-03-05T21:46:32,906           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,907           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,907           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,908           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,910           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,911           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,911                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,912                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,912                 directory, all directories are treated like packages.
2026-03-05T21:46:32,912           ********************************************************************************

2026-03-05T21:46:32,913   !!
2026-03-05T21:46:32,913     check.warn(importable)
2026-03-05T21:46:32,914   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.riscv64' is absent from the `packages` configuration.
2026-03-05T21:46:32,914   !!

2026-03-05T21:46:32,915           ********************************************************************************
2026-03-05T21:46:32,915           ############################
2026-03-05T21:46:32,916           # Package would be ignored #
2026-03-05T21:46:32,916           ############################
2026-03-05T21:46:32,916           Python recognizes 'deepspeed.ops.csrc.cpu.comm.riscv64' as an importable package[^1],
2026-03-05T21:46:32,917           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,918           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,918           package, please make sure that 'deepspeed.ops.csrc.cpu.comm.riscv64' is explicitly added
2026-03-05T21:46:32,918           to the `packages` configuration field.

2026-03-05T21:46:32,919           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,920           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,920           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,921           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,923           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,924           If you don't want 'deepspeed.ops.csrc.cpu.comm.riscv64' to be distributed and are
2026-03-05T21:46:32,924           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.riscv64' via
2026-03-05T21:46:32,925           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,926           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,927           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,928           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,929           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,930                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,930                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,931                 directory, all directories are treated like packages.
2026-03-05T21:46:32,931           ********************************************************************************

2026-03-05T21:46:32,932   !!
2026-03-05T21:46:32,933     check.warn(importable)
2026-03-05T21:46:32,934   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm.x86_64' is absent from the `packages` configuration.
2026-03-05T21:46:32,934   !!

2026-03-05T21:46:32,935           ********************************************************************************
2026-03-05T21:46:32,936           ############################
2026-03-05T21:46:32,936           # Package would be ignored #
2026-03-05T21:46:32,937           ############################
2026-03-05T21:46:32,938           Python recognizes 'deepspeed.ops.csrc.cpu.comm.x86_64' as an importable package[^1],
2026-03-05T21:46:32,938           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,939           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,939           package, please make sure that 'deepspeed.ops.csrc.cpu.comm.x86_64' is explicitly added
2026-03-05T21:46:32,939           to the `packages` configuration field.

2026-03-05T21:46:32,940           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,940           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,941           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,942           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,942           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,943           If you don't want 'deepspeed.ops.csrc.cpu.comm.x86_64' to be distributed and are
2026-03-05T21:46:32,943           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm.x86_64' via
2026-03-05T21:46:32,944           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,944           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,945           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,945           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,947           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,948           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,948                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,949                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,949                 directory, all directories are treated like packages.
2026-03-05T21:46:32,950           ********************************************************************************

2026-03-05T21:46:32,951   !!
2026-03-05T21:46:32,951     check.warn(importable)
2026-03-05T21:46:32,952   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2026-03-05T21:46:32,952   !!

2026-03-05T21:46:32,953           ********************************************************************************
2026-03-05T21:46:32,954           ############################
2026-03-05T21:46:32,955           # Package would be ignored #
2026-03-05T21:46:32,955           ############################
2026-03-05T21:46:32,956           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2026-03-05T21:46:32,956           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,957           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,957           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2026-03-05T21:46:32,958           to the `packages` configuration field.

2026-03-05T21:46:32,959           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,959           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,960           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,961           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,962           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,963           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2026-03-05T21:46:32,963           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2026-03-05T21:46:32,964           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,964           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,965           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,965           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,966           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,967           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,967                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,968                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,968                 directory, all directories are treated like packages.
2026-03-05T21:46:32,968           ********************************************************************************

2026-03-05T21:46:32,969   !!
2026-03-05T21:46:32,969     check.warn(importable)
2026-03-05T21:46:32,970   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2026-03-05T21:46:32,970   !!

2026-03-05T21:46:32,971           ********************************************************************************
2026-03-05T21:46:32,971           ############################
2026-03-05T21:46:32,972           # Package would be ignored #
2026-03-05T21:46:32,972           ############################
2026-03-05T21:46:32,973           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2026-03-05T21:46:32,973           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,975           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,975           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2026-03-05T21:46:32,976           to the `packages` configuration field.

2026-03-05T21:46:32,977           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,978           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,978           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,979           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,980           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,981           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2026-03-05T21:46:32,982           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2026-03-05T21:46:32,982           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:32,982           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:32,983           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:32,984           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:32,985           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:32,986           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:32,987                 even if it does not contain any `.py` files.
2026-03-05T21:46:32,987                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:32,988                 directory, all directories are treated like packages.
2026-03-05T21:46:32,988           ********************************************************************************

2026-03-05T21:46:32,990   !!
2026-03-05T21:46:32,990     check.warn(importable)
2026-03-05T21:46:32,990   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2026-03-05T21:46:32,991   !!

2026-03-05T21:46:32,991           ********************************************************************************
2026-03-05T21:46:32,991           ############################
2026-03-05T21:46:32,992           # Package would be ignored #
2026-03-05T21:46:32,992           ############################
2026-03-05T21:46:32,992           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2026-03-05T21:46:32,993           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:32,993           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:32,994           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2026-03-05T21:46:32,994           to the `packages` configuration field.

2026-03-05T21:46:32,995           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:32,995           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:32,996           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:32,996           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:32,997           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:32,998           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2026-03-05T21:46:32,999           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2026-03-05T21:46:32,999           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,000           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,000           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,001           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,003           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,004           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,005                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,005                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,006                 directory, all directories are treated like packages.
2026-03-05T21:46:33,006           ********************************************************************************

2026-03-05T21:46:33,007   !!
2026-03-05T21:46:33,007     check.warn(importable)
2026-03-05T21:46:33,008   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2026-03-05T21:46:33,008   !!

2026-03-05T21:46:33,009           ********************************************************************************
2026-03-05T21:46:33,010           ############################
2026-03-05T21:46:33,010           # Package would be ignored #
2026-03-05T21:46:33,011           ############################
2026-03-05T21:46:33,011           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2026-03-05T21:46:33,012           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,013           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,013           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2026-03-05T21:46:33,014           to the `packages` configuration field.

2026-03-05T21:46:33,015           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,015           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,015           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,016           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,017           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,017           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2026-03-05T21:46:33,018           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2026-03-05T21:46:33,018           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,018           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,019           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,019           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,020           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,021           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,022                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,022                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,023                 directory, all directories are treated like packages.
2026-03-05T21:46:33,023           ********************************************************************************

2026-03-05T21:46:33,024   !!
2026-03-05T21:46:33,024     check.warn(importable)
2026-03-05T21:46:33,025   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2026-03-05T21:46:33,026   !!

2026-03-05T21:46:33,027           ********************************************************************************
2026-03-05T21:46:33,027           ############################
2026-03-05T21:46:33,028           # Package would be ignored #
2026-03-05T21:46:33,028           ############################
2026-03-05T21:46:33,029           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2026-03-05T21:46:33,029           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,030           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,031           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2026-03-05T21:46:33,031           to the `packages` configuration field.

2026-03-05T21:46:33,032           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,032           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,033           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,034           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,035           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,036           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2026-03-05T21:46:33,036           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2026-03-05T21:46:33,037           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,037           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,038           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,039           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,040           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,041           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,041                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,042                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,042                 directory, all directories are treated like packages.
2026-03-05T21:46:33,043           ********************************************************************************

2026-03-05T21:46:33,043   !!
2026-03-05T21:46:33,044     check.warn(importable)
2026-03-05T21:46:33,044   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2026-03-05T21:46:33,045   !!

2026-03-05T21:46:33,045           ********************************************************************************
2026-03-05T21:46:33,046           ############################
2026-03-05T21:46:33,046           # Package would be ignored #
2026-03-05T21:46:33,046           ############################
2026-03-05T21:46:33,047           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2026-03-05T21:46:33,047           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,048           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,049           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2026-03-05T21:46:33,050           to the `packages` configuration field.

2026-03-05T21:46:33,051           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,051           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,052           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,053           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,054           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,055           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2026-03-05T21:46:33,056           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2026-03-05T21:46:33,056           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,057           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,057           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,058           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,059           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,060           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,061                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,061                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,062                 directory, all directories are treated like packages.
2026-03-05T21:46:33,062           ********************************************************************************

2026-03-05T21:46:33,064   !!
2026-03-05T21:46:33,064     check.warn(importable)
2026-03-05T21:46:33,065   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2026-03-05T21:46:33,065   !!

2026-03-05T21:46:33,066           ********************************************************************************
2026-03-05T21:46:33,066           ############################
2026-03-05T21:46:33,067           # Package would be ignored #
2026-03-05T21:46:33,067           ############################
2026-03-05T21:46:33,067           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2026-03-05T21:46:33,068           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,068           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,069           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2026-03-05T21:46:33,069           to the `packages` configuration field.

2026-03-05T21:46:33,070           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,070           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,070           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,071           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,072           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,073           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2026-03-05T21:46:33,073           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2026-03-05T21:46:33,073           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,074           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,074           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,075           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,077           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,078           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,079                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,079                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,080                 directory, all directories are treated like packages.
2026-03-05T21:46:33,080           ********************************************************************************

2026-03-05T21:46:33,081   !!
2026-03-05T21:46:33,082     check.warn(importable)
2026-03-05T21:46:33,082   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2026-03-05T21:46:33,083   !!

2026-03-05T21:46:33,083           ********************************************************************************
2026-03-05T21:46:33,084           ############################
2026-03-05T21:46:33,084           # Package would be ignored #
2026-03-05T21:46:33,085           ############################
2026-03-05T21:46:33,085           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2026-03-05T21:46:33,086           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,087           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,087           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2026-03-05T21:46:33,088           to the `packages` configuration field.

2026-03-05T21:46:33,089           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,089           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,090           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,091           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,091           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,092           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2026-03-05T21:46:33,092           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2026-03-05T21:46:33,093           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,093           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,093           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,094           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,095           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,096           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,096                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,096                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,097                 directory, all directories are treated like packages.
2026-03-05T21:46:33,097           ********************************************************************************

2026-03-05T21:46:33,098   !!
2026-03-05T21:46:33,099     check.warn(importable)
2026-03-05T21:46:33,099   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2026-03-05T21:46:33,099   !!

2026-03-05T21:46:33,100           ********************************************************************************
2026-03-05T21:46:33,101           ############################
2026-03-05T21:46:33,102           # Package would be ignored #
2026-03-05T21:46:33,102           ############################
2026-03-05T21:46:33,103           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2026-03-05T21:46:33,103           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,104           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,105           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2026-03-05T21:46:33,105           to the `packages` configuration field.

2026-03-05T21:46:33,107           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,107           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,107           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,108           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,109           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,110           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2026-03-05T21:46:33,111           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2026-03-05T21:46:33,111           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,112           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,112           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,113           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,114           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,116           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,117                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,118                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,118                 directory, all directories are treated like packages.
2026-03-05T21:46:33,118           ********************************************************************************

2026-03-05T21:46:33,119   !!
2026-03-05T21:46:33,120     check.warn(importable)
2026-03-05T21:46:33,120   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2026-03-05T21:46:33,121   !!

2026-03-05T21:46:33,121           ********************************************************************************
2026-03-05T21:46:33,122           ############################
2026-03-05T21:46:33,122           # Package would be ignored #
2026-03-05T21:46:33,122           ############################
2026-03-05T21:46:33,123           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2026-03-05T21:46:33,123           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,124           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,124           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2026-03-05T21:46:33,125           to the `packages` configuration field.

2026-03-05T21:46:33,126           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,126           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,127           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,128           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,129           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,130           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2026-03-05T21:46:33,131           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2026-03-05T21:46:33,131           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,132           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,132           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,133           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,135           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,136           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,137                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,137                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,138                 directory, all directories are treated like packages.
2026-03-05T21:46:33,138           ********************************************************************************

2026-03-05T21:46:33,140   !!
2026-03-05T21:46:33,140     check.warn(importable)
2026-03-05T21:46:33,141   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2026-03-05T21:46:33,141   !!

2026-03-05T21:46:33,142           ********************************************************************************
2026-03-05T21:46:33,143           ############################
2026-03-05T21:46:33,144           # Package would be ignored #
2026-03-05T21:46:33,144           ############################
2026-03-05T21:46:33,145           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2026-03-05T21:46:33,145           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,147           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,147           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2026-03-05T21:46:33,148           to the `packages` configuration field.

2026-03-05T21:46:33,149           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,149           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,149           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,150           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,151           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,152           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2026-03-05T21:46:33,152           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2026-03-05T21:46:33,153           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,153           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,154           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,154           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,155           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,157           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,157                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,158                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,158                 directory, all directories are treated like packages.
2026-03-05T21:46:33,159           ********************************************************************************

2026-03-05T21:46:33,160   !!
2026-03-05T21:46:33,160     check.warn(importable)
2026-03-05T21:46:33,161   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2026-03-05T21:46:33,161   !!

2026-03-05T21:46:33,162           ********************************************************************************
2026-03-05T21:46:33,163           ############################
2026-03-05T21:46:33,163           # Package would be ignored #
2026-03-05T21:46:33,164           ############################
2026-03-05T21:46:33,165           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2026-03-05T21:46:33,165           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,166           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,167           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2026-03-05T21:46:33,167           to the `packages` configuration field.

2026-03-05T21:46:33,168           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,169           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,169           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,170           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,171           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,172           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2026-03-05T21:46:33,173           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2026-03-05T21:46:33,174           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,174           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,175           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,176           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,177           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,178           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,179                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,179                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,179                 directory, all directories are treated like packages.
2026-03-05T21:46:33,180           ********************************************************************************

2026-03-05T21:46:33,181   !!
2026-03-05T21:46:33,181     check.warn(importable)
2026-03-05T21:46:33,182   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2026-03-05T21:46:33,182   !!

2026-03-05T21:46:33,183           ********************************************************************************
2026-03-05T21:46:33,183           ############################
2026-03-05T21:46:33,184           # Package would be ignored #
2026-03-05T21:46:33,185           ############################
2026-03-05T21:46:33,185           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2026-03-05T21:46:33,186           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,187           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,187           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2026-03-05T21:46:33,188           to the `packages` configuration field.

2026-03-05T21:46:33,189           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,190           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,190           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,191           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,192           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,193           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2026-03-05T21:46:33,194           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2026-03-05T21:46:33,194           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,195           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,196           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,197           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,198           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,199           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,200                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,201                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,201                 directory, all directories are treated like packages.
2026-03-05T21:46:33,202           ********************************************************************************

2026-03-05T21:46:33,203   !!
2026-03-05T21:46:33,203     check.warn(importable)
2026-03-05T21:46:33,204   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2026-03-05T21:46:33,205   !!

2026-03-05T21:46:33,206           ********************************************************************************
2026-03-05T21:46:33,206           ############################
2026-03-05T21:46:33,207           # Package would be ignored #
2026-03-05T21:46:33,207           ############################
2026-03-05T21:46:33,208           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2026-03-05T21:46:33,208           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,209           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,210           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2026-03-05T21:46:33,210           to the `packages` configuration field.

2026-03-05T21:46:33,211           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,211           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,212           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,212           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,213           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,214           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2026-03-05T21:46:33,215           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2026-03-05T21:46:33,215           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,216           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,216           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,217           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,218           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,219           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,220                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,220                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,221                 directory, all directories are treated like packages.
2026-03-05T21:46:33,221           ********************************************************************************

2026-03-05T21:46:33,222   !!
2026-03-05T21:46:33,222     check.warn(importable)
2026-03-05T21:46:33,223   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2026-03-05T21:46:33,223   !!

2026-03-05T21:46:33,224           ********************************************************************************
2026-03-05T21:46:33,225           ############################
2026-03-05T21:46:33,225           # Package would be ignored #
2026-03-05T21:46:33,226           ############################
2026-03-05T21:46:33,226           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2026-03-05T21:46:33,227           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,228           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,228           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2026-03-05T21:46:33,229           to the `packages` configuration field.

2026-03-05T21:46:33,230           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,231           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,231           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,232           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,233           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,235           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2026-03-05T21:46:33,235           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2026-03-05T21:46:33,235           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,236           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,236           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,237           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,238           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,239           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,240                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,241                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,241                 directory, all directories are treated like packages.
2026-03-05T21:46:33,242           ********************************************************************************

2026-03-05T21:46:33,243   !!
2026-03-05T21:46:33,243     check.warn(importable)
2026-03-05T21:46:33,244   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2026-03-05T21:46:33,245   !!

2026-03-05T21:46:33,246           ********************************************************************************
2026-03-05T21:46:33,246           ############################
2026-03-05T21:46:33,247           # Package would be ignored #
2026-03-05T21:46:33,247           ############################
2026-03-05T21:46:33,248           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2026-03-05T21:46:33,249           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,250           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,250           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2026-03-05T21:46:33,251           to the `packages` configuration field.

2026-03-05T21:46:33,252           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,253           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,253           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,255           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,256           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,257           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2026-03-05T21:46:33,258           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2026-03-05T21:46:33,258           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,259           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,259           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,261           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,262           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,264           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,264                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,265                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,266                 directory, all directories are treated like packages.
2026-03-05T21:46:33,266           ********************************************************************************

2026-03-05T21:46:33,268   !!
2026-03-05T21:46:33,268     check.warn(importable)
2026-03-05T21:46:33,269   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2026-03-05T21:46:33,269   !!

2026-03-05T21:46:33,270           ********************************************************************************
2026-03-05T21:46:33,271           ############################
2026-03-05T21:46:33,271           # Package would be ignored #
2026-03-05T21:46:33,272           ############################
2026-03-05T21:46:33,272           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2026-03-05T21:46:33,273           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,274           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,274           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2026-03-05T21:46:33,275           to the `packages` configuration field.

2026-03-05T21:46:33,276           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,277           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,277           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,279           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,280           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,281           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2026-03-05T21:46:33,282           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2026-03-05T21:46:33,282           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,283           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,283           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,284           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,286           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,288           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,289                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,290                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,290                 directory, all directories are treated like packages.
2026-03-05T21:46:33,291           ********************************************************************************

2026-03-05T21:46:33,292   !!
2026-03-05T21:46:33,293     check.warn(importable)
2026-03-05T21:46:33,293   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2026-03-05T21:46:33,294   !!

2026-03-05T21:46:33,295           ********************************************************************************
2026-03-05T21:46:33,296           ############################
2026-03-05T21:46:33,297           # Package would be ignored #
2026-03-05T21:46:33,297           ############################
2026-03-05T21:46:33,298           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2026-03-05T21:46:33,298           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,300           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,300           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2026-03-05T21:46:33,301           to the `packages` configuration field.

2026-03-05T21:46:33,302           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,303           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,303           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,304           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,306           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,306           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2026-03-05T21:46:33,307           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2026-03-05T21:46:33,307           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,309           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,310           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,311           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,312           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,313                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,314                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,314                 directory, all directories are treated like packages.
2026-03-05T21:46:33,315           ********************************************************************************

2026-03-05T21:46:33,316   !!
2026-03-05T21:46:33,316     check.warn(importable)
2026-03-05T21:46:33,317   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2026-03-05T21:46:33,317   !!

2026-03-05T21:46:33,319           ********************************************************************************
2026-03-05T21:46:33,319           ############################
2026-03-05T21:46:33,320           # Package would be ignored #
2026-03-05T21:46:33,320           ############################
2026-03-05T21:46:33,321           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2026-03-05T21:46:33,321           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,323           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,323           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2026-03-05T21:46:33,324           to the `packages` configuration field.

2026-03-05T21:46:33,325           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,326           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,326           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,328           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,329           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,330           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2026-03-05T21:46:33,331           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2026-03-05T21:46:33,331           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,333           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,334           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,336           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,339           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,340                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,340                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,340                 directory, all directories are treated like packages.
2026-03-05T21:46:33,341           ********************************************************************************

2026-03-05T21:46:33,342   !!
2026-03-05T21:46:33,342     check.warn(importable)
2026-03-05T21:46:33,343   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2026-03-05T21:46:33,344   !!

2026-03-05T21:46:33,345           ********************************************************************************
2026-03-05T21:46:33,346           ############################
2026-03-05T21:46:33,346           # Package would be ignored #
2026-03-05T21:46:33,347           ############################
2026-03-05T21:46:33,347           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2026-03-05T21:46:33,348           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,349           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,350           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2026-03-05T21:46:33,350           to the `packages` configuration field.

2026-03-05T21:46:33,351           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,352           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,352           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,353           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,354           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,355           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2026-03-05T21:46:33,356           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2026-03-05T21:46:33,356           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,357           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,357           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,358           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,359           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,361           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,361                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,362                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,362                 directory, all directories are treated like packages.
2026-03-05T21:46:33,363           ********************************************************************************

2026-03-05T21:46:33,364   !!
2026-03-05T21:46:33,364     check.warn(importable)
2026-03-05T21:46:33,365   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2026-03-05T21:46:33,365   !!

2026-03-05T21:46:33,367           ********************************************************************************
2026-03-05T21:46:33,367           ############################
2026-03-05T21:46:33,368           # Package would be ignored #
2026-03-05T21:46:33,368           ############################
2026-03-05T21:46:33,369           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2026-03-05T21:46:33,369           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,370           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,370           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2026-03-05T21:46:33,371           to the `packages` configuration field.

2026-03-05T21:46:33,372           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,372           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,372           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,373           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,374           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,375           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2026-03-05T21:46:33,376           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2026-03-05T21:46:33,376           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,377           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,377           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,378           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,380           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,381                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,381                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,382                 directory, all directories are treated like packages.
2026-03-05T21:46:33,382           ********************************************************************************

2026-03-05T21:46:33,383   !!
2026-03-05T21:46:33,384     check.warn(importable)
2026-03-05T21:46:33,385   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2026-03-05T21:46:33,386   !!

2026-03-05T21:46:33,386           ********************************************************************************
2026-03-05T21:46:33,387           ############################
2026-03-05T21:46:33,388           # Package would be ignored #
2026-03-05T21:46:33,388           ############################
2026-03-05T21:46:33,389           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2026-03-05T21:46:33,389           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,390           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,391           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2026-03-05T21:46:33,391           to the `packages` configuration field.

2026-03-05T21:46:33,392           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,393           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,393           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,395           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,396           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,397           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2026-03-05T21:46:33,398           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2026-03-05T21:46:33,398           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,399           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,399           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,400           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,401           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,402           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,402                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,403                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,403                 directory, all directories are treated like packages.
2026-03-05T21:46:33,404           ********************************************************************************

2026-03-05T21:46:33,405   !!
2026-03-05T21:46:33,405     check.warn(importable)
2026-03-05T21:46:33,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2026-03-05T21:46:33,406   !!

2026-03-05T21:46:33,407           ********************************************************************************
2026-03-05T21:46:33,407           ############################
2026-03-05T21:46:33,408           # Package would be ignored #
2026-03-05T21:46:33,408           ############################
2026-03-05T21:46:33,409           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2026-03-05T21:46:33,409           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,410           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,411           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2026-03-05T21:46:33,411           to the `packages` configuration field.

2026-03-05T21:46:33,412           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,413           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,413           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,414           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,415           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,416           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2026-03-05T21:46:33,417           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2026-03-05T21:46:33,417           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,418           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,419           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,420           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,421           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,422           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,423                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,423                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,424                 directory, all directories are treated like packages.
2026-03-05T21:46:33,424           ********************************************************************************

2026-03-05T21:46:33,426   !!
2026-03-05T21:46:33,426     check.warn(importable)
2026-03-05T21:46:33,427   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2026-03-05T21:46:33,428   !!

2026-03-05T21:46:33,428           ********************************************************************************
2026-03-05T21:46:33,429           ############################
2026-03-05T21:46:33,429           # Package would be ignored #
2026-03-05T21:46:33,430           ############################
2026-03-05T21:46:33,430           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2026-03-05T21:46:33,430           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,432           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,432           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2026-03-05T21:46:33,432           to the `packages` configuration field.

2026-03-05T21:46:33,433           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,434           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,434           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,435           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,436           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,437           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2026-03-05T21:46:33,438           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2026-03-05T21:46:33,439           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,439           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,440           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,441           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,442           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,443           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,444                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,444                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,445                 directory, all directories are treated like packages.
2026-03-05T21:46:33,446           ********************************************************************************

2026-03-05T21:46:33,447   !!
2026-03-05T21:46:33,448     check.warn(importable)
2026-03-05T21:46:33,448   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2026-03-05T21:46:33,449   !!

2026-03-05T21:46:33,450           ********************************************************************************
2026-03-05T21:46:33,450           ############################
2026-03-05T21:46:33,451           # Package would be ignored #
2026-03-05T21:46:33,451           ############################
2026-03-05T21:46:33,452           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2026-03-05T21:46:33,452           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,453           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,454           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2026-03-05T21:46:33,454           to the `packages` configuration field.

2026-03-05T21:46:33,455           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,456           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,456           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,457           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,458           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,459           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2026-03-05T21:46:33,459           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2026-03-05T21:46:33,460           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,460           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,461           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,461           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,462           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,464           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,464                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,465                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,465                 directory, all directories are treated like packages.
2026-03-05T21:46:33,466           ********************************************************************************

2026-03-05T21:46:33,467   !!
2026-03-05T21:46:33,467     check.warn(importable)
2026-03-05T21:46:33,468   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2026-03-05T21:46:33,468   !!

2026-03-05T21:46:33,469           ********************************************************************************
2026-03-05T21:46:33,470           ############################
2026-03-05T21:46:33,470           # Package would be ignored #
2026-03-05T21:46:33,471           ############################
2026-03-05T21:46:33,471           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2026-03-05T21:46:33,472           but it is absent from setuptools' `packages` configuration.

2026-03-05T21:46:33,473           This leads to an ambiguous overall configuration. If you want to distribute this
2026-03-05T21:46:33,473           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2026-03-05T21:46:33,473           to the `packages` configuration field.

2026-03-05T21:46:33,474           Alternatively, you can also rely on setuptools' discovery methods
2026-03-05T21:46:33,475           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2026-03-05T21:46:33,475           instead of `find_packages(...)`/`find:`).

2026-03-05T21:46:33,476           You can read more about "package discovery" on setuptools documentation page:

2026-03-05T21:46:33,477           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2026-03-05T21:46:33,478           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2026-03-05T21:46:33,479           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2026-03-05T21:46:33,479           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2026-03-05T21:46:33,480           you can try to use `exclude_package_data`, or `include-package-data=False` in
2026-03-05T21:46:33,480           combination with a more fine grained `package-data` configuration.

2026-03-05T21:46:33,481           You can read more about "package data files" on setuptools documentation page:

2026-03-05T21:46:33,482           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2026-03-05T21:46:33,484           [^1]: For Python, any directory (with suitable naming) can be imported,
2026-03-05T21:46:33,484                 even if it does not contain any `.py` files.
2026-03-05T21:46:33,485                 On the other hand, currently there is no concept of package data
2026-03-05T21:46:33,485                 directory, all directories are treated like packages.
2026-03-05T21:46:33,486           ********************************************************************************

2026-03-05T21:46:33,486   !!
2026-03-05T21:46:33,487     check.warn(importable)
2026-03-05T21:46:33,487   creating build/lib/deepspeed/ops/csrc/adagrad
2026-03-05T21:46:33,488   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2026-03-05T21:46:33,488   creating build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,488   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,489   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,489   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,490   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,490   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2026-03-05T21:46:33,491   creating build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,491   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,491   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,492   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,492   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,493   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,493   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:33,494   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,494   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,494   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,495   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,495   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,496   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,496   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,497   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,497   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,498   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,498   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,499   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,499   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,500   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,500   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,501   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,502   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,502   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:33,502   creating build/lib/deepspeed/ops/csrc/aio/py_test
2026-03-05T21:46:33,503   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2026-03-05T21:46:33,503   creating build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,504   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,504   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,504   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,505   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,505   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,506   copying deepspeed/ops/csrc/compile/z2.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,506   copying deepspeed/ops/csrc/compile/z2.h -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,507   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,507   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2026-03-05T21:46:33,507   creating build/lib/deepspeed/ops/csrc/cpu/adam
2026-03-05T21:46:33,508   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2026-03-05T21:46:33,508   creating build/lib/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:33,509   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:33,510   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:33,510   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:33,510   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:33,511   creating build/lib/deepspeed/ops/csrc/cpu/comm/arm64
2026-03-05T21:46:33,511   copying deepspeed/ops/csrc/cpu/comm/arm64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/arm64
2026-03-05T21:46:33,512   creating build/lib/deepspeed/ops/csrc/cpu/comm/riscv64
2026-03-05T21:46:33,512   copying deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/riscv64
2026-03-05T21:46:33,513   creating build/lib/deepspeed/ops/csrc/cpu/comm/x86_64
2026-03-05T21:46:33,513   copying deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm/x86_64
2026-03-05T21:46:33,514   creating build/lib/deepspeed/ops/csrc/cpu/lion
2026-03-05T21:46:33,514   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2026-03-05T21:46:33,515   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,515   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,516   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,516   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,517   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,518   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,518   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:33,519   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:33,519   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:33,519   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:33,520   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:33,520   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:33,521   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,521   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,522   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,522   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,522   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,523   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,523   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,524   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:33,524   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,525   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,525   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,526   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,526   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,527   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,527   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,528   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:33,528   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:33,529   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:33,529   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:33,530   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:33,530   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:33,531   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:33,531   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:33,532   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:33,532   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:33,533   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,533   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,534   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,534   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,534   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,535   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,535   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:33,536   creating build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,536   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,537   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,537   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,538   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,538   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,539   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,540   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,540   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,540   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,541   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,541   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,542   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,543   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,543   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,544   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,544   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,545   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,546   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,548   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,551   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,553   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,556   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,558   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,561   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,564   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,566   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,569   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,571   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,573   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,576   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2026-03-05T21:46:33,578   creating build/lib/deepspeed/ops/csrc/lamb
2026-03-05T21:46:33,579   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2026-03-05T21:46:33,582   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2026-03-05T21:46:33,584   creating build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,585   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,588   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,590   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,592   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,595   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2026-03-05T21:46:33,598   creating build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,599   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,601   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,604   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,607   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,610   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,612   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,614   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2026-03-05T21:46:33,617   creating build/lib/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:33,618   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:33,621   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:33,623   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:33,626   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:33,628   creating build/lib/deepspeed/ops/csrc/sparse_attention
2026-03-05T21:46:33,629   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2026-03-05T21:46:33,632   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:33,633   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:33,636   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:33,638   creating build/lib/deepspeed/ops/csrc/spatial/includes
2026-03-05T21:46:33,639   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2026-03-05T21:46:33,641   creating build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,642   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,645   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,648   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,651   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,653   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,656   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,660   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,662   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2026-03-05T21:46:33,665   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,667   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,669   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,672   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,675   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,678   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,680   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,684   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,686   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,689   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,692   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:33,695   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:33,696   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:33,698   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:33,701   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:33,704   creating build/lib/deepspeed/ops/csrc/utils
2026-03-05T21:46:33,705   copying deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/lib/deepspeed/ops/csrc/utils
2026-03-05T21:46:33,707   copying deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/lib/deepspeed/ops/csrc/utils
2026-03-05T21:46:33,709   copying deepspeed/ops/csrc/utils/tensor_cast.h -> build/lib/deepspeed/ops/csrc/utils
2026-03-05T21:46:33,711   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2026-03-05T21:46:33,713   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2026-03-05T21:46:33,716   creating build/lib/deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:33,717   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:33,719   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:33,721   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:33,724   creating build/lib/deepspeed/ops/csrc/xpu/common
2026-03-05T21:46:33,725   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2026-03-05T21:46:33,727   creating build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,728   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,731   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,733   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,735   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,738   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:33,740   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2026-03-05T21:46:33,741   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2026-03-05T21:46:33,744   creating build/lib/deepspeed/autotuning/config_templates
2026-03-05T21:46:33,745   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2026-03-05T21:46:33,747   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2026-03-05T21:46:33,749   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2026-03-05T21:46:33,751   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2026-03-05T21:46:33,753   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:33,756   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:33,758   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:33,760   creating build/lib/deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:33,761   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:33,763   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:33,766   creating build/lib/deepspeed/inference/v2/ragged/includes
2026-03-05T21:46:33,766   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2026-03-05T21:46:33,769   creating build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,770   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,772   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,775   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,777   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,780   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:33,783   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:33,785   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2026-03-05T21:46:33,786   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2026-03-05T21:46:33,788   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:33,790   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2026-03-05T21:46:33,791   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2026-03-05T21:46:33,793   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:33,794   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:33,796   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:33,798   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:33,800   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:33,802   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:33,804   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:33,806   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:33,809   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:33,811   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:33,813   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:33,815   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:33,818   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:33,820   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:33,822   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:33,825   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:33,828   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:33,830   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:33,832   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:33,834   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:33,837   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:33,839   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:33,841   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:33,843   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:33,845   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:33,847   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:33,849   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:33,852   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:33,854   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:33,856   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:33,858   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:33,861   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:33,863   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:33,865   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:33,867   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:33,870   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:33,872   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:33,874   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:33,876   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:33,878   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:33,881   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:33,883   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:33,886   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:33,888   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:33,890   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:33,893   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:33,895   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:33,898   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:33,900   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,901   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,904   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,906   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,908   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,911   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,913   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,916   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,918   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,920   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:33,923   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:33,926   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:33,928   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:33,931   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:33,933   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:33,935   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:33,938   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:33,941   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:33,943   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:33,945   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:33,947   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:34,008   running build_scripts
2026-03-05T21:46:34,009   creating build/scripts-3.11
2026-03-05T21:46:34,010   copying and adjusting bin/deepspeed -> build/scripts-3.11
2026-03-05T21:46:34,011   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2026-03-05T21:46:34,013   copying and adjusting bin/ds -> build/scripts-3.11
2026-03-05T21:46:34,014   copying bin/ds_ssh -> build/scripts-3.11
2026-03-05T21:46:34,016   copying and adjusting bin/ds_report -> build/scripts-3.11
2026-03-05T21:46:34,018   copying and adjusting bin/ds_bench -> build/scripts-3.11
2026-03-05T21:46:34,019   copying and adjusting bin/dsr -> build/scripts-3.11
2026-03-05T21:46:34,021   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2026-03-05T21:46:34,022   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2026-03-05T21:46:34,024   copying and adjusting bin/ds_io -> build/scripts-3.11
2026-03-05T21:46:34,024   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2026-03-05T21:46:34,025   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2026-03-05T21:46:34,026   changing mode of build/scripts-3.11/ds from 644 to 755
2026-03-05T21:46:34,026   changing mode of build/scripts-3.11/ds_report from 644 to 755
2026-03-05T21:46:34,027   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2026-03-05T21:46:34,027   changing mode of build/scripts-3.11/dsr from 644 to 755
2026-03-05T21:46:34,028   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2026-03-05T21:46:34,028   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2026-03-05T21:46:34,029   changing mode of build/scripts-3.11/ds_io from 644 to 755
2026-03-05T21:46:34,056   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2026-03-05T21:46:34,057   !!

2026-03-05T21:46:34,058           ********************************************************************************
2026-03-05T21:46:34,059           Please avoid running ``setup.py`` directly.
2026-03-05T21:46:34,059           Instead, use pypa/build, pypa/installer or other
2026-03-05T21:46:34,060           standards-based tools.

2026-03-05T21:46:34,061           This deprecation is overdue, please update your project and remove deprecated
2026-03-05T21:46:34,061           calls to avoid build errors in the future.

2026-03-05T21:46:34,062           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2026-03-05T21:46:34,063           ********************************************************************************

2026-03-05T21:46:34,064   !!
2026-03-05T21:46:34,065     self.initialize_options()
2026-03-05T21:46:34,087   installing to build/bdist.linux-armv7l/wheel
2026-03-05T21:46:34,087   running install
2026-03-05T21:46:34,111   running install_lib
2026-03-05T21:46:34,140   creating build/bdist.linux-armv7l/wheel
2026-03-05T21:46:34,143   creating build/bdist.linux-armv7l/wheel/deepspeed
2026-03-05T21:46:34,144   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2026-03-05T21:46:34,146   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2026-03-05T21:46:34,148   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2026-03-05T21:46:34,150   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2026-03-05T21:46:34,152   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2026-03-05T21:46:34,154   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2026-03-05T21:46:34,156   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2026-03-05T21:46:34,158   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2026-03-05T21:46:34,159   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2026-03-05T21:46:34,161   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2026-03-05T21:46:34,162   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2026-03-05T21:46:34,163   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2026-03-05T21:46:34,166   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2026-03-05T21:46:34,167   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2026-03-05T21:46:34,169   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2026-03-05T21:46:34,170   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,172   copying build/lib/deepspeed/ops/adam/zenflow_torch_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,174   copying build/lib/deepspeed/ops/adam/zenflow_cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,177   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,179   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,181   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2026-03-05T21:46:34,184   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2026-03-05T21:46:34,185   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2026-03-05T21:46:34,188   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2026-03-05T21:46:34,190   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2026-03-05T21:46:34,192   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2026-03-05T21:46:34,194   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,195   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,197   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,199   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,201   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,203   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,205   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2026-03-05T21:46:34,208   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2026-03-05T21:46:34,209   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2026-03-05T21:46:34,210   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2026-03-05T21:46:34,213   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:34,214   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:34,215   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:34,218   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:34,221   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/x86_64
2026-03-05T21:46:34,222   copying build/lib/deepspeed/ops/csrc/cpu/comm/x86_64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/x86_64
2026-03-05T21:46:34,224   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/riscv64
2026-03-05T21:46:34,225   copying build/lib/deepspeed/ops/csrc/cpu/comm/riscv64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/riscv64
2026-03-05T21:46:34,227   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm/arm64
2026-03-05T21:46:34,229   copying build/lib/deepspeed/ops/csrc/cpu/comm/arm64/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm/arm64
2026-03-05T21:46:34,230   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2026-03-05T21:46:34,233   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2026-03-05T21:46:34,234   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2026-03-05T21:46:34,237   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2026-03-05T21:46:34,238   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,240   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,244   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,249   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,251   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,252   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,254   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,256   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,258   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,260   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,263   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,265   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,267   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,269   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,271   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,274   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,276   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,278   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,280   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,282   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,283   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,285   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,288   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,289   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,291   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,293   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,295   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,297   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,299   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,301   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2026-03-05T21:46:34,304   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2026-03-05T21:46:34,305   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2026-03-05T21:46:34,306   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2026-03-05T21:46:34,309   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:34,310   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:34,312   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2026-03-05T21:46:34,315   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2026-03-05T21:46:34,316   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,317   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,320   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,322   copying build/lib/deepspeed/ops/csrc/compile/z2.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,323   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,326   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,328   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,330   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,332   copying build/lib/deepspeed/ops/csrc/compile/z2.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2026-03-05T21:46:34,334   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2026-03-05T21:46:34,336   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2026-03-05T21:46:34,338   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2026-03-05T21:46:34,339   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2026-03-05T21:46:34,342   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2026-03-05T21:46:34,343   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2026-03-05T21:46:34,346   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2026-03-05T21:46:34,347   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2026-03-05T21:46:34,350   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2026-03-05T21:46:34,352   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,353   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,356   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,357   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,360   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,362   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2026-03-05T21:46:34,364   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:34,365   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:34,367   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:34,369   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2026-03-05T21:46:34,372   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2026-03-05T21:46:34,373   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2026-03-05T21:46:34,376   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2026-03-05T21:46:34,377   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2026-03-05T21:46:34,379   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2026-03-05T21:46:34,380   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2026-03-05T21:46:34,383   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2026-03-05T21:46:34,385   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,386   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,388   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,390   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,392   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,393   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,395   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,397   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,398   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,400   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,402   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,404   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,406   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,407   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,410   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,411   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,413   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,416   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2026-03-05T21:46:34,419   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,420   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,422   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,424   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,427   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,428   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,430   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2026-03-05T21:46:34,433   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2026-03-05T21:46:34,434   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2026-03-05T21:46:34,437   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2026-03-05T21:46:34,438   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2026-03-05T21:46:34,441   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2026-03-05T21:46:34,442   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2026-03-05T21:46:34,444   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2026-03-05T21:46:34,447   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2026-03-05T21:46:34,448   copying build/lib/deepspeed/ops/csrc/utils/py_ds_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2026-03-05T21:46:34,450   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2026-03-05T21:46:34,451   copying build/lib/deepspeed/ops/csrc/utils/tensor_cast.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2026-03-05T21:46:34,454   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,456   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,459   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2026-03-05T21:46:34,461   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:34,462   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:34,464   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:34,467   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2026-03-05T21:46:34,470   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,471   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,473   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,476   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,478   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,480   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,482   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,485   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,487   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,490   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,493   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2026-03-05T21:46:34,496   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,500   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,502   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,505   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,507   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,510   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,512   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2026-03-05T21:46:34,516   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,517   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,520   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,522   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,524   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,527   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,529   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,532   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2026-03-05T21:46:34,535   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2026-03-05T21:46:34,536   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2026-03-05T21:46:34,538   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2026-03-05T21:46:34,540   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2026-03-05T21:46:34,542   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2026-03-05T21:46:34,544   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2026-03-05T21:46:34,547   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:34,548   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:34,550   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:34,552   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:34,554   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2026-03-05T21:46:34,557   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:34,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:34,560   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:34,562   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2026-03-05T21:46:34,564   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:34,567   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2026-03-05T21:46:34,570   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2026-03-05T21:46:34,571   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,572   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,574   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,577   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:34,578   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:34,581   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2026-03-05T21:46:34,584   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:34,585   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:34,588   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:34,590   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:34,593   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2026-03-05T21:46:34,596   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,597   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,600   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,602   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,604   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,607   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,609   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,616   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2026-03-05T21:46:34,620   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,624   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,627   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,628   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,632   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,636   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,638   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,641   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,643   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,647   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2026-03-05T21:46:34,649   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,652   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2026-03-05T21:46:34,655   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2026-03-05T21:46:34,656   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,658   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,660   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,662   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,664   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,665   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,667   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,669   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,671   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,672   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,674   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,676   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2026-03-05T21:46:34,677   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,680   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,680   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,683   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,685   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,686   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,688   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,690   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,692   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,694   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,695   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2026-03-05T21:46:34,697   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,699   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,701   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,704   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,705   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,707   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,709   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,711   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,713   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2026-03-05T21:46:34,715   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,717   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,719   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,721   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,722   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,724   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,726   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,728   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,729   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,731   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,733   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,734   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,736   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2026-03-05T21:46:34,738   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,740   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,742   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,744   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,746   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,747   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,749   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,751   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,753   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,755   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,756   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,758   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,760   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,761   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,763   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,765   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2026-03-05T21:46:34,767   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,769   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,771   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,774   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,775   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,777   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,778   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,780   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,782   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,783   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,785   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2026-03-05T21:46:34,787   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,789   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,791   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2026-03-05T21:46:34,793   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2026-03-05T21:46:34,794   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2026-03-05T21:46:34,797   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2026-03-05T21:46:34,798   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,800   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,803   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:34,804   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:34,806   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:34,808   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:34,810   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2026-03-05T21:46:34,812   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,815   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,817   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,819   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,822   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2026-03-05T21:46:34,825   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2026-03-05T21:46:34,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2026-03-05T21:46:34,828   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2026-03-05T21:46:34,830   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2026-03-05T21:46:34,833   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2026-03-05T21:46:34,834   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2026-03-05T21:46:34,837   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2026-03-05T21:46:34,838   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,840   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,842   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,844   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,848   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,849   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,851   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,853   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,855   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,857   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,859   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,861   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,863   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,866   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,868   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2026-03-05T21:46:34,871   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,872   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,874   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,876   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,879   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,882   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,883   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,885   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,887   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,889   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,891   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,892   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,894   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,896   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,898   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,899   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,901   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,903   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,905   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,907   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,909   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,911   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,913   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,915   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,917   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,919   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,921   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,923   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,925   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2026-03-05T21:46:34,927   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2026-03-05T21:46:34,929   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2026-03-05T21:46:34,932   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2026-03-05T21:46:34,933   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2026-03-05T21:46:34,934   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2026-03-05T21:46:34,936   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2026-03-05T21:46:34,938   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2026-03-05T21:46:34,941   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2026-03-05T21:46:34,942   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2026-03-05T21:46:34,945   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2026-03-05T21:46:34,947   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2026-03-05T21:46:34,948   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2026-03-05T21:46:34,950   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2026-03-05T21:46:34,952   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2026-03-05T21:46:34,954   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2026-03-05T21:46:34,957   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2026-03-05T21:46:34,958   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2026-03-05T21:46:34,960   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2026-03-05T21:46:34,962   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:34,965   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2026-03-05T21:46:34,966   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2026-03-05T21:46:34,967   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,969   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,971   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,973   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,975   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,977   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2026-03-05T21:46:34,979   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:34,981   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:34,983   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:34,986   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2026-03-05T21:46:34,988   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2026-03-05T21:46:34,989   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2026-03-05T21:46:34,991   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2026-03-05T21:46:34,993   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2026-03-05T21:46:34,994   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:34,996   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:35,000   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2026-03-05T21:46:35,002   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:35,004   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2026-03-05T21:46:35,005   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2026-03-05T21:46:35,007   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2026-03-05T21:46:35,008   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,011   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,012   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,015   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2026-03-05T21:46:35,016   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,018   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,020   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,022   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,025   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,027   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,029   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,031   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2026-03-05T21:46:35,033   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,036   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,038   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,040   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,042   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,044   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2026-03-05T21:46:35,045   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2026-03-05T21:46:35,047   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2026-03-05T21:46:35,050   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2026-03-05T21:46:35,051   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,053   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,055   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,058   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,060   copying build/lib/deepspeed/compile/input_storage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,062   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2026-03-05T21:46:35,065   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2026-03-05T21:46:35,066   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,068   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,070   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,072   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,074   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,076   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2026-03-05T21:46:35,079   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2026-03-05T21:46:35,080   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,082   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,084   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,086   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,088   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,090   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,092   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,094   copying build/lib/deepspeed/nvme/torch_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,096   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,098   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,100   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,102   copying build/lib/deepspeed/nvme/torch_fastio_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,103   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,106   copying build/lib/deepspeed/nvme/io_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,107   copying build/lib/deepspeed/nvme/ds_aio_constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,109   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2026-03-05T21:46:35,112   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2026-03-05T21:46:35,113   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2026-03-05T21:46:35,115   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2026-03-05T21:46:35,116   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,119   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2026-03-05T21:46:35,120   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2026-03-05T21:46:35,122   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,124   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:35,125   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:35,127   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2026-03-05T21:46:35,129   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,131   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,133   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,135   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,138   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2026-03-05T21:46:35,140   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,142   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,144   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2026-03-05T21:46:35,145   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2026-03-05T21:46:35,148   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2026-03-05T21:46:35,149   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:35,151   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:35,153   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:35,155   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2026-03-05T21:46:35,157   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:35,158   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:35,160   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2026-03-05T21:46:35,162   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2026-03-05T21:46:35,165   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:35,166   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:35,168   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2026-03-05T21:46:35,170   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:35,171   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:35,173   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2026-03-05T21:46:35,176   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:35,177   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:35,179   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2026-03-05T21:46:35,182   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:35,183   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:35,185   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2026-03-05T21:46:35,187   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:35,188   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:35,190   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:35,192   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2026-03-05T21:46:35,195   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,196   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,198   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,200   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,202   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,204   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,206   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,208   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2026-03-05T21:46:35,210   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2026-03-05T21:46:35,212   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2026-03-05T21:46:35,213   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2026-03-05T21:46:35,216   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,217   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,219   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,221   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,223   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,225   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,227   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,229   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,230   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2026-03-05T21:46:35,232   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,234   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,237   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,239   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:35,240   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:35,243   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:35,245   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:35,247   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2026-03-05T21:46:35,249   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,251   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,254   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,255   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,257   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,259   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,261   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,263   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,265   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,267   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,269   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,271   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2026-03-05T21:46:35,273   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,274   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,276   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,278   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,280   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,282   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,284   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,286   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,288   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,290   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2026-03-05T21:46:35,292   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:35,293   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:35,295   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:35,298   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:35,299   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2026-03-05T21:46:35,301   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,303   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,307   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,309   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:35,310   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:35,312   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:35,314   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:35,316   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2026-03-05T21:46:35,318   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:35,320   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:35,322   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:35,324   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:35,326   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2026-03-05T21:46:35,328   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:35,329   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:35,332   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:35,334   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:35,336   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2026-03-05T21:46:35,338   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:35,339   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:35,341   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:35,344   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:35,345   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2026-03-05T21:46:35,347   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,349   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:35,350   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:35,352   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:35,354   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:35,356   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2026-03-05T21:46:35,358   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:35,359   copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:35,361   copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:35,364   copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:35,365   copying build/lib/deepspeed/inference/v2/model_implementations/exaone4/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/exaone4
2026-03-05T21:46:35,368   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:35,369   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:35,371   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:35,373   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:35,375   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2026-03-05T21:46:35,377   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:35,378   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:35,380   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:35,382   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:35,383   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2026-03-05T21:46:35,385   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2026-03-05T21:46:35,388   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:35,389   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:35,391   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:35,393   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:35,395   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2026-03-05T21:46:35,396   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,398   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,400   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,402   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2026-03-05T21:46:35,404   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,405   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,408   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,410   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,413   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,415   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2026-03-05T21:46:35,417   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:35,418   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:35,420   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2026-03-05T21:46:35,422   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2026-03-05T21:46:35,425   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,426   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,428   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,430   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,432   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,434   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2026-03-05T21:46:35,436   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2026-03-05T21:46:35,438   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,440   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,443   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,445   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,447   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,449   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,451   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2026-03-05T21:46:35,454   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:35,455   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,457   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,459   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,461   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,463   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,465   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,467   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,469   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,471   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2026-03-05T21:46:35,473   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2026-03-05T21:46:35,474   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2026-03-05T21:46:35,476   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,477   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,479   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,482   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,485   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2026-03-05T21:46:35,489   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:35,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:35,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:35,494   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2026-03-05T21:46:35,496   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,497   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,500   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,501   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,505   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,508   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2026-03-05T21:46:35,510   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,511   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,513   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,515   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,517   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,519   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,520   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2026-03-05T21:46:35,522   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:35,524   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,525   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,527   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,529   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,531   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,533   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,536   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2026-03-05T21:46:35,538   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2026-03-05T21:46:35,540   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,541   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,543   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,545   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,547   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,549   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,551   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2026-03-05T21:46:35,553   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:35,554   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:35,556   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:35,558   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:35,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2026-03-05T21:46:35,562   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,563   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,565   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,566   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,568   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,570   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2026-03-05T21:46:35,575   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2026-03-05T21:46:35,576   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2026-03-05T21:46:35,579   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:35,580   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,582   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,584   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,587   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,589   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,590   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,592   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,594   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2026-03-05T21:46:35,596   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,597   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,601   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,602   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,604   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,606   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,608   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,610   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,613   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,617   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,836   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,839   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2026-03-05T21:46:35,842   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,844   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,846   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,848   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,850   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2026-03-05T21:46:35,852   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,853   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,855   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,857   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,859   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,861   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,863   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,865   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,866   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2026-03-05T21:46:35,869   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,870   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,872   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,874   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,876   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,878   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2026-03-05T21:46:35,880   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:35,882   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:35,883   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:35,885   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:35,888   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:35,889   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2026-03-05T21:46:35,892   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,893   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,895   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,897   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,898   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,900   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2026-03-05T21:46:35,902   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2026-03-05T21:46:35,904   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,906   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2026-03-05T21:46:35,909   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2026-03-05T21:46:35,910   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2026-03-05T21:46:35,912   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2026-03-05T21:46:35,913   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2026-03-05T21:46:35,916   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2026-03-05T21:46:35,918   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2026-03-05T21:46:35,919   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2026-03-05T21:46:35,922   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2026-03-05T21:46:35,926   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2026-03-05T21:46:35,927   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2026-03-05T21:46:35,929   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2026-03-05T21:46:35,931   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2026-03-05T21:46:35,933   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2026-03-05T21:46:35,935   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2026-03-05T21:46:35,938   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2026-03-05T21:46:35,939   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2026-03-05T21:46:35,941   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2026-03-05T21:46:35,943   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2026-03-05T21:46:35,946   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2026-03-05T21:46:35,948   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2026-03-05T21:46:35,949   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2026-03-05T21:46:35,951   copying build/lib/deepspeed/compat.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:35,953   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2026-03-05T21:46:35,954   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:35,957   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:35,959   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,395   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,399   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,403   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,407   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,411   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,414   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,418   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,421   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2026-03-05T21:46:36,426   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:36,429   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:36,434   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2026-03-05T21:46:36,440   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2026-03-05T21:46:36,443   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2026-03-05T21:46:36,445   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2026-03-05T21:46:36,448   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2026-03-05T21:46:36,452   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2026-03-05T21:46:36,456   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2026-03-05T21:46:36,457   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2026-03-05T21:46:36,461   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2026-03-05T21:46:36,464   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2026-03-05T21:46:36,468   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2026-03-05T21:46:36,470   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,473   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,477   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,480   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,483   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,486   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,488   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,489   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,491   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,493   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2026-03-05T21:46:36,496   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2026-03-05T21:46:36,497   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2026-03-05T21:46:36,500   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2026-03-05T21:46:36,502   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2026-03-05T21:46:36,504   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2026-03-05T21:46:36,507   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2026-03-05T21:46:36,508   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,511   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,513   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,514   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,516   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,518   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,520   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,522   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,525   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,527   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,530   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,532   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,534   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,536   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,538   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,540   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,543   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,545   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2026-03-05T21:46:36,547   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2026-03-05T21:46:36,548   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,550   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,551   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,553   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,554   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,557   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,558   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,561   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,562   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2026-03-05T21:46:36,565   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2026-03-05T21:46:36,566   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,568   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,570   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,572   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,574   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,576   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2026-03-05T21:46:36,579   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2026-03-05T21:46:36,580   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,582   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,583   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,585   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,587   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,589   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,591   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,593   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2026-03-05T21:46:36,596   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2026-03-05T21:46:36,597   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,599   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,603   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2026-03-05T21:46:36,605   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2026-03-05T21:46:36,608   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2026-03-05T21:46:36,610   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2026-03-05T21:46:36,613   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2026-03-05T21:46:36,615   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2026-03-05T21:46:36,616   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2026-03-05T21:46:36,618   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2026-03-05T21:46:36,621   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2026-03-05T21:46:36,623   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2026-03-05T21:46:36,625   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,628   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,629   copying build/lib/deepspeed/runtime/model_checkpointing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,631   copying build/lib/deepspeed/runtime/model_checkpointing/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,633   copying build/lib/deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,635   copying build/lib/deepspeed/runtime/model_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,637   copying build/lib/deepspeed/runtime/model_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,639   copying build/lib/deepspeed/runtime/model_checkpointing/writer_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/model_checkpointing
2026-03-05T21:46:36,641   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,643   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,646   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2026-03-05T21:46:36,647   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,650   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,652   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,654   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,657   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,661   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2026-03-05T21:46:36,663   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,665   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,667   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,670   copying build/lib/deepspeed/runtime/precision_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,672   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,675   copying build/lib/deepspeed/runtime/torch_autocast.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,677   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2026-03-05T21:46:36,678   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2026-03-05T21:46:36,680   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2026-03-05T21:46:36,682   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2026-03-05T21:46:36,684   copying build/lib/deepspeed/runtime/tensor_parallel/init_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2026-03-05T21:46:36,687   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/superoffload
2026-03-05T21:46:36,688   copying build/lib/deepspeed/runtime/superoffload/superoffload_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload
2026-03-05T21:46:36,691   copying build/lib/deepspeed/runtime/superoffload/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload
2026-03-05T21:46:36,693   copying build/lib/deepspeed/runtime/superoffload/superoffload_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/superoffload
2026-03-05T21:46:36,695   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,698   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2026-03-05T21:46:36,699   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2026-03-05T21:46:36,701   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2026-03-05T21:46:36,704   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,705   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,707   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,709   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,711   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,713   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2026-03-05T21:46:36,715   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2026-03-05T21:46:36,717   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2026-03-05T21:46:36,719   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,721   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,723   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,726   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,727   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,730   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,732   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2026-03-05T21:46:36,736   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,737   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,740   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,743   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zenflow
2026-03-05T21:46:36,744   copying build/lib/deepspeed/runtime/zenflow/zenflow_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,746   copying build/lib/deepspeed/runtime/zenflow/zenflow_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,749   copying build/lib/deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,752   copying build/lib/deepspeed/runtime/zenflow/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,753   copying build/lib/deepspeed/runtime/zenflow/engine_stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,756   copying build/lib/deepspeed/runtime/zenflow/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zenflow
2026-03-05T21:46:36,759   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/sequence_parallel
2026-03-05T21:46:36,760   copying build/lib/deepspeed/runtime/sequence_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2026-03-05T21:46:36,762   copying build/lib/deepspeed/runtime/sequence_parallel/parallel_state_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2026-03-05T21:46:36,764   copying build/lib/deepspeed/runtime/sequence_parallel/ulysses_sp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/sequence_parallel
2026-03-05T21:46:36,767   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,771   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,772   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,774   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,776   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,779   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,781   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,783   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,785   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,787   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,789   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2026-03-05T21:46:36,792   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,798   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2026-03-05T21:46:36,799   copying build/lib/deepspeed/runtime/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,801   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,803   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,806   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,808   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,810   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,813   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2026-03-05T21:46:36,816   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2026-03-05T21:46:36,817   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2026-03-05T21:46:36,820   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2026-03-05T21:46:36,823   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2026-03-05T21:46:36,825   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,828   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,830   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2026-03-05T21:46:36,833   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,834   copying build/lib/deepspeed/runtime/checkpoint_engine/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,837   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,839   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,841   copying build/lib/deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,843   copying build/lib/deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,846   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,848   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,850   copying build/lib/deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2026-03-05T21:46:36,853   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:36,854   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:36,858   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:36,860   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2026-03-05T21:46:36,862   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2026-03-05T21:46:36,864   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,866   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,869   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,871   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,876   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,878   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,880   copying build/lib/deepspeed/runtime/zero/leaf_module_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,883   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero/muon
2026-03-05T21:46:36,884   copying build/lib/deepspeed/runtime/zero/muon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon
2026-03-05T21:46:36,887   copying build/lib/deepspeed/runtime/zero/muon/muon_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon
2026-03-05T21:46:36,889   copying build/lib/deepspeed/runtime/zero/muon/original_muon.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero/muon
2026-03-05T21:46:36,892   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,894   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,896   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,899   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,902   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,904   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,906   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,911   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,913   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,918   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,921   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2026-03-05T21:46:36,923   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2026-03-05T21:46:36,925   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2026-03-05T21:46:36,927   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2026-03-05T21:46:36,929   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2026-03-05T21:46:36,931   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2026-03-05T21:46:36,933   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2026-03-05T21:46:36,935   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2026-03-05T21:46:36,938   creating build/bdist.linux-armv7l/wheel/deepspeed/io
2026-03-05T21:46:36,939   copying build/lib/deepspeed/io/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,941   copying build/lib/deepspeed/io/single_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,943   copying build/lib/deepspeed/io/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,945   copying build/lib/deepspeed/io/py_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,947   copying build/lib/deepspeed/io/fast_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,949   copying build/lib/deepspeed/io/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,952   copying build/lib/deepspeed/io/base_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,954   copying build/lib/deepspeed/io/base_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,956   copying build/lib/deepspeed/io/mock_file_writer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,958   copying build/lib/deepspeed/io/double_io_buffer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/io
2026-03-05T21:46:36,961   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2026-03-05T21:46:36,963   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,965   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,968   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,970   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,973   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,975   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,978   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,981   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2026-03-05T21:46:36,984   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2026-03-05T21:46:36,985   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:36,988   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:36,990   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:36,992   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:36,994   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:36,997   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:37,000   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:37,002   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:37,004   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:37,007   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2026-03-05T21:46:37,010   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2026-03-05T21:46:37,011   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,014   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,016   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,018   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,020   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,023   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2026-03-05T21:46:37,026   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2026-03-05T21:46:37,028   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,030   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,032   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,034   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,037   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,039   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,042   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,044   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,047   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,050   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,052   copying build/lib/deepspeed/module_inject/autotp_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,056   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2026-03-05T21:46:37,057   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,059   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,062   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,064   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,066   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,069   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2026-03-05T21:46:37,071   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,073   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,075   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,078   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,080   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,083   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,085   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2026-03-05T21:46:37,087   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,089   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,091   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,094   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,096   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,098   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,100   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,102   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,104   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,107   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,110   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,112   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,114   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,116   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2026-03-05T21:46:37,119   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,121   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,123   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2026-03-05T21:46:37,126   creating build/bdist.linux-armv7l/wheel/deepspeed/datastates
2026-03-05T21:46:37,127   copying build/lib/deepspeed/datastates/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates
2026-03-05T21:46:37,129   copying build/lib/deepspeed/datastates/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/datastates
2026-03-05T21:46:37,131   running install_egg_info
2026-03-05T21:46:37,164   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.18.7-py3.11.egg-info
2026-03-05T21:46:37,178   running install_scripts
2026-03-05T21:46:37,179   creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,181   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,183   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,185   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,187   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,189   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,191   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,193   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,195   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,197   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,199   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts
2026-03-05T21:46:37,201   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_ssh to 755
2026-03-05T21:46:37,201   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds to 755
2026-03-05T21:46:37,202   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_report to 755
2026-03-05T21:46:37,203   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_io to 755
2026-03-05T21:46:37,203   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_elastic to 755
2026-03-05T21:46:37,204   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/dsr to 755
2026-03-05T21:46:37,205   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_bench to 755
2026-03-05T21:46:37,206   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/ds_nvme_tune to 755
2026-03-05T21:46:37,206   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/deepspeed to 755
2026-03-05T21:46:37,207   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.data/scripts/deepspeed.pt to 755
2026-03-05T21:46:37,221   creating build/bdist.linux-armv7l/wheel/deepspeed-0.18.7.dist-info/WHEEL
2026-03-05T21:46:37,223   creating '/tmp/pip-wheel-dqq986g_/deepspeed-0.18.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2026-03-05T21:46:37,228   adding 'deepspeed/__init__.py'
2026-03-05T21:46:37,230   adding 'deepspeed/compat.py'
2026-03-05T21:46:37,231   adding 'deepspeed/constants.py'
2026-03-05T21:46:37,233   adding 'deepspeed/env_report.py'
2026-03-05T21:46:37,235   adding 'deepspeed/git_version_info.py'
2026-03-05T21:46:37,236   adding 'deepspeed/git_version_info_installed.py'
2026-03-05T21:46:37,238   adding 'deepspeed/accelerator/__init__.py'
2026-03-05T21:46:37,240   adding 'deepspeed/accelerator/abstract_accelerator.py'
2026-03-05T21:46:37,242   adding 'deepspeed/accelerator/cpu_accelerator.py'
2026-03-05T21:46:37,244   adding 'deepspeed/accelerator/cuda_accelerator.py'
2026-03-05T21:46:37,247   adding 'deepspeed/accelerator/hpu_accelerator.py'
2026-03-05T21:46:37,249   adding 'deepspeed/accelerator/mlu_accelerator.py'
2026-03-05T21:46:37,251   adding 'deepspeed/accelerator/mps_accelerator.py'
2026-03-05T21:46:37,253   adding 'deepspeed/accelerator/npu_accelerator.py'
2026-03-05T21:46:37,255   adding 'deepspeed/accelerator/real_accelerator.py'
2026-03-05T21:46:37,257   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2026-03-05T21:46:37,259   adding 'deepspeed/accelerator/xpu_accelerator.py'
2026-03-05T21:46:37,262   adding 'deepspeed/autotuning/__init__.py'
2026-03-05T21:46:37,267   adding 'deepspeed/autotuning/autotuner.py'
2026-03-05T21:46:37,269   adding 'deepspeed/autotuning/config.py'
2026-03-05T21:46:37,271   adding 'deepspeed/autotuning/constants.py'
2026-03-05T21:46:37,274   adding 'deepspeed/autotuning/scheduler.py'
2026-03-05T21:46:37,276   adding 'deepspeed/autotuning/utils.py'
2026-03-05T21:46:37,278   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2026-03-05T21:46:37,280   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2026-03-05T21:46:37,281   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2026-03-05T21:46:37,283   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2026-03-05T21:46:37,285   adding 'deepspeed/autotuning/tuner/__init__.py'
2026-03-05T21:46:37,287   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2026-03-05T21:46:37,289   adding 'deepspeed/autotuning/tuner/cost_model.py'
2026-03-05T21:46:37,290   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2026-03-05T21:46:37,292   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2026-03-05T21:46:37,294   adding 'deepspeed/autotuning/tuner/utils.py'
2026-03-05T21:46:37,296   adding 'deepspeed/checkpoint/__init__.py'
2026-03-05T21:46:37,298   adding 'deepspeed/checkpoint/constants.py'
2026-03-05T21:46:37,300   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2026-03-05T21:46:37,304   adding 'deepspeed/checkpoint/ds_to_universal.py'
2026-03-05T21:46:37,306   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2026-03-05T21:46:37,308   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2026-03-05T21:46:37,310   adding 'deepspeed/checkpoint/reshape_utils.py'
2026-03-05T21:46:37,312   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2026-03-05T21:46:37,314   adding 'deepspeed/checkpoint/utils.py'
2026-03-05T21:46:37,316   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2026-03-05T21:46:37,318   adding 'deepspeed/comm/__init__.py'
2026-03-05T21:46:37,319   adding 'deepspeed/comm/backend.py'
2026-03-05T21:46:37,321   adding 'deepspeed/comm/ccl.py'
2026-03-05T21:46:37,326   adding 'deepspeed/comm/comm.py'
2026-03-05T21:46:37,327   adding 'deepspeed/comm/config.py'
2026-03-05T21:46:37,329   adding 'deepspeed/comm/constants.py'
2026-03-05T21:46:37,331   adding 'deepspeed/comm/reduce_op.py'
2026-03-05T21:46:37,333   adding 'deepspeed/comm/torch.py'
2026-03-05T21:46:37,335   adding 'deepspeed/comm/utils.py'
2026-03-05T21:46:37,338   adding 'deepspeed/compile/__init__.py'
2026-03-05T21:46:37,340   adding 'deepspeed/compile/backend.py'
2026-03-05T21:46:37,342   adding 'deepspeed/compile/config.py'
2026-03-05T21:46:37,344   adding 'deepspeed/compile/fx.py'
2026-03-05T21:46:37,346   adding 'deepspeed/compile/graph_param.py'
2026-03-05T21:46:37,348   adding 'deepspeed/compile/inductor.py'
2026-03-05T21:46:37,350   adding 'deepspeed/compile/init_z1.py'
2026-03-05T21:46:37,352   adding 'deepspeed/compile/init_z3.py'
2026-03-05T21:46:37,354   adding 'deepspeed/compile/input_storage.py'
2026-03-05T21:46:37,356   adding 'deepspeed/compile/list_schedule.py'
2026-03-05T21:46:37,358   adding 'deepspeed/compile/partitioner.py'
2026-03-05T21:46:37,360   adding 'deepspeed/compile/patch_compiled_func.py'
2026-03-05T21:46:37,362   adding 'deepspeed/compile/patch_fake_tensor.py'
2026-03-05T21:46:37,365   adding 'deepspeed/compile/util.py'
2026-03-05T21:46:37,367   adding 'deepspeed/compile/passes/__init__.py'
2026-03-05T21:46:37,369   adding 'deepspeed/compile/passes/offload_activation.py'
2026-03-05T21:46:37,372   adding 'deepspeed/compile/passes/offload_adam_states.py'
2026-03-05T21:46:37,373   adding 'deepspeed/compile/passes/offload_parameters.py'
2026-03-05T21:46:37,376   adding 'deepspeed/compile/passes/prefetch.py'
2026-03-05T21:46:37,377   adding 'deepspeed/compile/passes/selective_gather.py'
2026-03-05T21:46:37,379   adding 'deepspeed/compile/passes/zero1_compile.py'
2026-03-05T21:46:37,381   adding 'deepspeed/compile/passes/zero3_compile.py'
2026-03-05T21:46:37,384   adding 'deepspeed/compile/profilers/__init__.py'
2026-03-05T21:46:37,386   adding 'deepspeed/compile/profilers/comm_profile.py'
2026-03-05T21:46:37,388   adding 'deepspeed/compile/profilers/graph_profile.py'
2026-03-05T21:46:37,390   adding 'deepspeed/compression/__init__.py'
2026-03-05T21:46:37,394   adding 'deepspeed/compression/basic_layer.py'
2026-03-05T21:46:37,396   adding 'deepspeed/compression/compress.py'
2026-03-05T21:46:37,399   adding 'deepspeed/compression/config.py'
2026-03-05T21:46:37,401   adding 'deepspeed/compression/constants.py'
2026-03-05T21:46:37,403   adding 'deepspeed/compression/helper.py'
2026-03-05T21:46:37,405   adding 'deepspeed/compression/scheduler.py'
2026-03-05T21:46:37,407   adding 'deepspeed/compression/utils.py'
2026-03-05T21:46:37,409   adding 'deepspeed/datastates/__init__.py'
2026-03-05T21:46:37,411   adding 'deepspeed/datastates/config.py'
2026-03-05T21:46:37,413   adding 'deepspeed/elasticity/__init__.py'
2026-03-05T21:46:37,415   adding 'deepspeed/elasticity/config.py'
2026-03-05T21:46:37,417   adding 'deepspeed/elasticity/constants.py'
2026-03-05T21:46:37,419   adding 'deepspeed/elasticity/elastic_agent.py'
2026-03-05T21:46:37,421   adding 'deepspeed/elasticity/elasticity.py'
2026-03-05T21:46:37,423   adding 'deepspeed/elasticity/utils.py'
2026-03-05T21:46:37,425   adding 'deepspeed/inference/__init__.py'
2026-03-05T21:46:37,427   adding 'deepspeed/inference/config.py'
2026-03-05T21:46:37,431   adding 'deepspeed/inference/engine.py'
2026-03-05T21:46:37,433   adding 'deepspeed/inference/quantization/__init__.py'
2026-03-05T21:46:37,435   adding 'deepspeed/inference/quantization/layers.py'
2026-03-05T21:46:37,437   adding 'deepspeed/inference/quantization/quantization.py'
2026-03-05T21:46:37,439   adding 'deepspeed/inference/quantization/quantization_context.py'
2026-03-05T21:46:37,441   adding 'deepspeed/inference/quantization/utils.py'
2026-03-05T21:46:37,443   adding 'deepspeed/inference/v2/__init__.py'
2026-03-05T21:46:37,445   adding 'deepspeed/inference/v2/allocator.py'
2026-03-05T21:46:37,447   adding 'deepspeed/inference/v2/config_v2.py'
2026-03-05T21:46:37,449   adding 'deepspeed/inference/v2/engine_factory.py'
2026-03-05T21:46:37,451   adding 'deepspeed/inference/v2/engine_v2.py'
2026-03-05T21:46:37,453   adding 'deepspeed/inference/v2/inference_parameter.py'
2026-03-05T21:46:37,455   adding 'deepspeed/inference/v2/inference_utils.py'
2026-03-05T21:46:37,456   adding 'deepspeed/inference/v2/logging.py'
2026-03-05T21:46:37,458   adding 'deepspeed/inference/v2/scheduling_utils.py'
2026-03-05T21:46:37,460   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2026-03-05T21:46:37,461   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2026-03-05T21:46:37,463   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2026-03-05T21:46:37,465   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2026-03-05T21:46:37,466   adding 'deepspeed/inference/v2/kernels/__init__.py'
2026-03-05T21:46:37,468   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2026-03-05T21:46:37,470   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2026-03-05T21:46:37,471   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2026-03-05T21:46:37,473   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2026-03-05T21:46:37,475   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2026-03-05T21:46:37,476   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2026-03-05T21:46:37,478   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2026-03-05T21:46:37,480   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2026-03-05T21:46:37,482   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2026-03-05T21:46:37,483   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2026-03-05T21:46:37,485   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2026-03-05T21:46:37,487   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2026-03-05T21:46:37,489   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2026-03-05T21:46:37,491   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2026-03-05T21:46:37,493   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2026-03-05T21:46:37,494   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2026-03-05T21:46:37,496   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2026-03-05T21:46:37,497   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2026-03-05T21:46:37,499   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2026-03-05T21:46:37,501   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2026-03-05T21:46:37,503   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2026-03-05T21:46:37,505   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2026-03-05T21:46:37,507   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2026-03-05T21:46:37,509   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2026-03-05T21:46:37,511   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2026-03-05T21:46:37,512   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2026-03-05T21:46:37,515   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2026-03-05T21:46:37,517   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2026-03-05T21:46:37,519   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2026-03-05T21:46:37,521   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2026-03-05T21:46:37,522   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2026-03-05T21:46:37,524   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2026-03-05T21:46:37,526   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2026-03-05T21:46:37,528   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2026-03-05T21:46:37,530   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2026-03-05T21:46:37,532   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2026-03-05T21:46:37,534   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2026-03-05T21:46:37,535   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2026-03-05T21:46:37,537   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2026-03-05T21:46:37,538   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2026-03-05T21:46:37,540   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2026-03-05T21:46:37,542   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2026-03-05T21:46:37,543   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2026-03-05T21:46:37,545   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2026-03-05T21:46:37,547   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2026-03-05T21:46:37,548   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2026-03-05T21:46:37,550   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2026-03-05T21:46:37,552   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2026-03-05T21:46:37,554   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2026-03-05T21:46:37,556   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2026-03-05T21:46:37,557   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2026-03-05T21:46:37,559   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2026-03-05T21:46:37,560   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2026-03-05T21:46:37,562   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2026-03-05T21:46:37,564   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2026-03-05T21:46:37,565   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2026-03-05T21:46:37,567   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2026-03-05T21:46:37,569   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2026-03-05T21:46:37,570   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2026-03-05T21:46:37,572   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2026-03-05T21:46:37,574   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2026-03-05T21:46:37,576   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2026-03-05T21:46:37,577   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2026-03-05T21:46:37,579   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2026-03-05T21:46:37,582   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2026-03-05T21:46:37,585   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2026-03-05T21:46:37,587   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2026-03-05T21:46:37,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2026-03-05T21:46:37,590   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2026-03-05T21:46:37,592   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2026-03-05T21:46:37,594   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2026-03-05T21:46:37,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2026-03-05T21:46:37,597   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2026-03-05T21:46:37,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2026-03-05T21:46:37,600   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2026-03-05T21:46:37,602   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2026-03-05T21:46:37,603   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2026-03-05T21:46:37,605   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2026-03-05T21:46:37,607   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2026-03-05T21:46:37,608   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2026-03-05T21:46:37,610   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2026-03-05T21:46:37,611   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2026-03-05T21:46:37,613   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2026-03-05T21:46:37,615   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2026-03-05T21:46:37,617   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2026-03-05T21:46:37,618   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2026-03-05T21:46:37,620   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2026-03-05T21:46:37,621   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2026-03-05T21:46:37,622   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2026-03-05T21:46:37,624   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2026-03-05T21:46:37,626   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2026-03-05T21:46:37,627   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2026-03-05T21:46:37,629   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2026-03-05T21:46:37,630   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2026-03-05T21:46:37,631   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2026-03-05T21:46:37,632   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2026-03-05T21:46:37,634   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2026-03-05T21:46:37,635   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2026-03-05T21:46:37,636   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2026-03-05T21:46:37,638   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2026-03-05T21:46:37,639   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2026-03-05T21:46:37,640   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2026-03-05T21:46:37,641   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2026-03-05T21:46:37,643   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2026-03-05T21:46:37,644   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2026-03-05T21:46:37,646   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2026-03-05T21:46:37,647   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2026-03-05T21:46:37,648   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2026-03-05T21:46:37,649   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2026-03-05T21:46:37,651   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2026-03-05T21:46:37,652   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2026-03-05T21:46:37,654   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2026-03-05T21:46:37,655   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2026-03-05T21:46:37,657   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2026-03-05T21:46:37,658   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2026-03-05T21:46:37,660   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2026-03-05T21:46:37,661   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2026-03-05T21:46:37,662   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2026-03-05T21:46:37,663   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2026-03-05T21:46:37,665   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2026-03-05T21:46:37,667   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2026-03-05T21:46:37,669   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2026-03-05T21:46:37,670   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2026-03-05T21:46:37,672   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2026-03-05T21:46:37,675   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2026-03-05T21:46:37,677   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2026-03-05T21:46:37,679   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2026-03-05T21:46:37,681   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2026-03-05T21:46:37,682   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2026-03-05T21:46:37,685   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2026-03-05T21:46:37,687   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2026-03-05T21:46:37,690   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2026-03-05T21:46:37,691   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2026-03-05T21:46:37,692   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2026-03-05T21:46:37,693   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2026-03-05T21:46:37,695   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2026-03-05T21:46:37,696   adding 'deepspeed/inference/v2/model_implementations/exaone4/__init__.py'
2026-03-05T21:46:37,697   adding 'deepspeed/inference/v2/model_implementations/exaone4/container.py'
2026-03-05T21:46:37,699   adding 'deepspeed/inference/v2/model_implementations/exaone4/model.py'
2026-03-05T21:46:37,700   adding 'deepspeed/inference/v2/model_implementations/exaone4/policy.py'
2026-03-05T21:46:37,702   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2026-03-05T21:46:37,703   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2026-03-05T21:46:37,705   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2026-03-05T21:46:37,707   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2026-03-05T21:46:37,709   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2026-03-05T21:46:37,710   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2026-03-05T21:46:37,712   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2026-03-05T21:46:37,713   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2026-03-05T21:46:37,714   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2026-03-05T21:46:37,716   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2026-03-05T21:46:37,717   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2026-03-05T21:46:37,719   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2026-03-05T21:46:37,720   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2026-03-05T21:46:37,722   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2026-03-05T21:46:37,723   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2026-03-05T21:46:37,725   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2026-03-05T21:46:37,726   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2026-03-05T21:46:37,728   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2026-03-05T21:46:37,729   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2026-03-05T21:46:37,731   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2026-03-05T21:46:37,732   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2026-03-05T21:46:37,733   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2026-03-05T21:46:37,735   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2026-03-05T21:46:37,736   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2026-03-05T21:46:37,738   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2026-03-05T21:46:37,739   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2026-03-05T21:46:37,741   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2026-03-05T21:46:37,742   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2026-03-05T21:46:37,744   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2026-03-05T21:46:37,746   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2026-03-05T21:46:37,747   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2026-03-05T21:46:37,748   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2026-03-05T21:46:37,750   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2026-03-05T21:46:37,751   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2026-03-05T21:46:37,753   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2026-03-05T21:46:37,754   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2026-03-05T21:46:37,756   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2026-03-05T21:46:37,757   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2026-03-05T21:46:37,759   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2026-03-05T21:46:37,760   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2026-03-05T21:46:37,762   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2026-03-05T21:46:37,763   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2026-03-05T21:46:37,765   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2026-03-05T21:46:37,766   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2026-03-05T21:46:37,767   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2026-03-05T21:46:37,769   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2026-03-05T21:46:37,770   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2026-03-05T21:46:37,771   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2026-03-05T21:46:37,773   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2026-03-05T21:46:37,774   adding 'deepspeed/inference/v2/modules/__init__.py'
2026-03-05T21:46:37,776   adding 'deepspeed/inference/v2/modules/ds_module.py'
2026-03-05T21:46:37,777   adding 'deepspeed/inference/v2/modules/heuristics.py'
2026-03-05T21:46:37,778   adding 'deepspeed/inference/v2/modules/module_registry.py'
2026-03-05T21:46:37,780   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2026-03-05T21:46:37,782   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2026-03-05T21:46:37,783   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2026-03-05T21:46:37,784   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2026-03-05T21:46:37,785   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2026-03-05T21:46:37,787   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2026-03-05T21:46:37,788   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2026-03-05T21:46:37,790   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2026-03-05T21:46:37,791   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2026-03-05T21:46:37,793   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2026-03-05T21:46:37,795   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2026-03-05T21:46:37,796   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2026-03-05T21:46:37,798   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2026-03-05T21:46:37,799   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2026-03-05T21:46:37,801   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2026-03-05T21:46:37,803   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2026-03-05T21:46:37,804   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2026-03-05T21:46:37,806   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2026-03-05T21:46:37,807   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2026-03-05T21:46:37,809   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2026-03-05T21:46:37,810   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2026-03-05T21:46:37,812   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2026-03-05T21:46:37,814   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2026-03-05T21:46:37,815   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2026-03-05T21:46:37,817   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2026-03-05T21:46:37,818   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2026-03-05T21:46:37,819   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2026-03-05T21:46:37,821   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2026-03-05T21:46:37,822   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2026-03-05T21:46:37,823   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2026-03-05T21:46:37,825   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2026-03-05T21:46:37,826   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2026-03-05T21:46:37,828   adding 'deepspeed/inference/v2/ragged/__init__.py'
2026-03-05T21:46:37,829   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2026-03-05T21:46:37,831   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2026-03-05T21:46:37,832   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2026-03-05T21:46:37,834   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2026-03-05T21:46:37,836   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2026-03-05T21:46:37,838   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2026-03-05T21:46:37,839   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2026-03-05T21:46:37,841   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2026-03-05T21:46:37,842   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2026-03-05T21:46:37,844   adding 'deepspeed/io/__init__.py'
2026-03-05T21:46:37,845   adding 'deepspeed/io/base_file_writer.py'
2026-03-05T21:46:37,847   adding 'deepspeed/io/base_io_buffer.py'
2026-03-05T21:46:37,848   adding 'deepspeed/io/constants.py'
2026-03-05T21:46:37,849   adding 'deepspeed/io/double_io_buffer.py'
2026-03-05T21:46:37,851   adding 'deepspeed/io/fast_file_writer.py'
2026-03-05T21:46:37,852   adding 'deepspeed/io/mock_file_writer.py'
2026-03-05T21:46:37,853   adding 'deepspeed/io/py_file_writer.py'
2026-03-05T21:46:37,855   adding 'deepspeed/io/single_io_buffer.py'
2026-03-05T21:46:37,856   adding 'deepspeed/io/utils.py'
2026-03-05T21:46:37,858   adding 'deepspeed/launcher/__init__.py'
2026-03-05T21:46:37,859   adding 'deepspeed/launcher/constants.py'
2026-03-05T21:46:37,861   adding 'deepspeed/launcher/launch.py'
2026-03-05T21:46:37,862   adding 'deepspeed/launcher/launcher_helper.py'
2026-03-05T21:46:37,865   adding 'deepspeed/launcher/multinode_runner.py'
2026-03-05T21:46:37,868   adding 'deepspeed/launcher/runner.py'
2026-03-05T21:46:37,870   adding 'deepspeed/linear/__init__.py'
2026-03-05T21:46:37,871   adding 'deepspeed/linear/config.py'
2026-03-05T21:46:37,872   adding 'deepspeed/linear/context_manager.py'
2026-03-05T21:46:37,874   adding 'deepspeed/linear/optimized_linear.py'
2026-03-05T21:46:37,876   adding 'deepspeed/linear/quantization.py'
2026-03-05T21:46:37,877   adding 'deepspeed/model_implementations/__init__.py'
2026-03-05T21:46:37,879   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2026-03-05T21:46:37,881   adding 'deepspeed/model_implementations/diffusers/unet.py'
2026-03-05T21:46:37,882   adding 'deepspeed/model_implementations/diffusers/vae.py'
2026-03-05T21:46:37,884   adding 'deepspeed/model_implementations/features/__init__.py'
2026-03-05T21:46:37,885   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2026-03-05T21:46:37,887   adding 'deepspeed/model_implementations/transformers/__init__.py'
2026-03-05T21:46:37,888   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2026-03-05T21:46:37,889   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2026-03-05T21:46:37,890   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2026-03-05T21:46:37,891   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2026-03-05T21:46:37,892   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2026-03-05T21:46:37,894   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2026-03-05T21:46:37,895   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2026-03-05T21:46:37,896   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2026-03-05T21:46:37,898   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2026-03-05T21:46:37,899   adding 'deepspeed/module_inject/__init__.py'
2026-03-05T21:46:37,903   adding 'deepspeed/module_inject/auto_tp.py'
2026-03-05T21:46:37,904   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2026-03-05T21:46:37,907   adding 'deepspeed/module_inject/autotp_config.py'
2026-03-05T21:46:37,909   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2026-03-05T21:46:37,910   adding 'deepspeed/module_inject/inject.py'
2026-03-05T21:46:37,915   adding 'deepspeed/module_inject/layers.py'
2026-03-05T21:46:37,917   adding 'deepspeed/module_inject/load_checkpoint.py'
2026-03-05T21:46:37,919   adding 'deepspeed/module_inject/module_quantize.py'
2026-03-05T21:46:37,920   adding 'deepspeed/module_inject/policy.py'
2026-03-05T21:46:37,924   adding 'deepspeed/module_inject/replace_module.py'
2026-03-05T21:46:37,925   adding 'deepspeed/module_inject/replace_policy.py'
2026-03-05T21:46:37,927   adding 'deepspeed/module_inject/tp_shard.py'
2026-03-05T21:46:37,928   adding 'deepspeed/module_inject/utils.py'
2026-03-05T21:46:37,930   adding 'deepspeed/module_inject/containers/__init__.py'
2026-03-05T21:46:37,932   adding 'deepspeed/module_inject/containers/base.py'
2026-03-05T21:46:37,933   adding 'deepspeed/module_inject/containers/base_moe.py'
2026-03-05T21:46:37,935   adding 'deepspeed/module_inject/containers/bert.py'
2026-03-05T21:46:37,936   adding 'deepspeed/module_inject/containers/bloom.py'
2026-03-05T21:46:37,938   adding 'deepspeed/module_inject/containers/clip.py'
2026-03-05T21:46:37,939   adding 'deepspeed/module_inject/containers/distil_bert.py'
2026-03-05T21:46:37,940   adding 'deepspeed/module_inject/containers/gpt2.py'
2026-03-05T21:46:37,942   adding 'deepspeed/module_inject/containers/gptj.py'
2026-03-05T21:46:37,943   adding 'deepspeed/module_inject/containers/gptneo.py'
2026-03-05T21:46:37,944   adding 'deepspeed/module_inject/containers/gptneox.py'
2026-03-05T21:46:37,946   adding 'deepspeed/module_inject/containers/internlm.py'
2026-03-05T21:46:37,948   adding 'deepspeed/module_inject/containers/llama.py'
2026-03-05T21:46:37,949   adding 'deepspeed/module_inject/containers/llama2.py'
2026-03-05T21:46:37,950   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2026-03-05T21:46:37,952   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2026-03-05T21:46:37,953   adding 'deepspeed/module_inject/containers/opt.py'
2026-03-05T21:46:37,955   adding 'deepspeed/module_inject/containers/unet.py'
2026-03-05T21:46:37,956   adding 'deepspeed/module_inject/containers/vae.py'
2026-03-05T21:46:37,958   adding 'deepspeed/module_inject/containers/features/__init__.py'
2026-03-05T21:46:37,959   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2026-03-05T21:46:37,961   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2026-03-05T21:46:37,962   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2026-03-05T21:46:37,964   adding 'deepspeed/module_inject/containers/features/megatron.py'
2026-03-05T21:46:37,965   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2026-03-05T21:46:37,966   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2026-03-05T21:46:37,968   adding 'deepspeed/moe/__init__.py'
2026-03-05T21:46:37,969   adding 'deepspeed/moe/experts.py'
2026-03-05T21:46:37,971   adding 'deepspeed/moe/layer.py'
2026-03-05T21:46:37,972   adding 'deepspeed/moe/mappings.py'
2026-03-05T21:46:37,975   adding 'deepspeed/moe/sharded_moe.py'
2026-03-05T21:46:37,977   adding 'deepspeed/moe/utils.py'
2026-03-05T21:46:37,978   adding 'deepspeed/monitor/__init__.py'
2026-03-05T21:46:37,979   adding 'deepspeed/monitor/comet.py'
2026-03-05T21:46:37,981   adding 'deepspeed/monitor/config.py'
2026-03-05T21:46:37,982   adding 'deepspeed/monitor/csv_monitor.py'
2026-03-05T21:46:37,983   adding 'deepspeed/monitor/monitor.py'
2026-03-05T21:46:37,985   adding 'deepspeed/monitor/tensorboard.py'
2026-03-05T21:46:37,986   adding 'deepspeed/monitor/utils.py'
2026-03-05T21:46:37,987   adding 'deepspeed/monitor/wandb.py'
2026-03-05T21:46:37,989   adding 'deepspeed/nebula/__init__.py'
2026-03-05T21:46:37,990   adding 'deepspeed/nebula/config.py'
2026-03-05T21:46:37,991   adding 'deepspeed/nebula/constants.py'
2026-03-05T21:46:37,993   adding 'deepspeed/nvme/__init__.py'
2026-03-05T21:46:37,995   adding 'deepspeed/nvme/ds_aio_args.py'
2026-03-05T21:46:37,996   adding 'deepspeed/nvme/ds_aio_basic.py'
2026-03-05T21:46:37,997   adding 'deepspeed/nvme/ds_aio_constants.py'
2026-03-05T21:46:37,999   adding 'deepspeed/nvme/ds_aio_handle.py'
2026-03-05T21:46:38,000   adding 'deepspeed/nvme/ds_aio_job.py'
2026-03-05T21:46:38,001   adding 'deepspeed/nvme/io_engine.py'
2026-03-05T21:46:38,003   adding 'deepspeed/nvme/parse_nvme_stats.py'
2026-03-05T21:46:38,004   adding 'deepspeed/nvme/perf_generate_param.py'
2026-03-05T21:46:38,006   adding 'deepspeed/nvme/perf_run_sweep.py'
2026-03-05T21:46:38,007   adding 'deepspeed/nvme/perf_sweep_utils.py'
2026-03-05T21:46:38,008   adding 'deepspeed/nvme/test_ds_aio.py'
2026-03-05T21:46:38,010   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2026-03-05T21:46:38,011   adding 'deepspeed/nvme/torch_fastio_engine.py'
2026-03-05T21:46:38,013   adding 'deepspeed/nvme/torch_io.py'
2026-03-05T21:46:38,014   adding 'deepspeed/nvme/validate_async_io.py'
2026-03-05T21:46:38,016   adding 'deepspeed/ops/__init__.py'
2026-03-05T21:46:38,017   adding 'deepspeed/ops/adagrad/__init__.py'
2026-03-05T21:46:38,019   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2026-03-05T21:46:38,021   adding 'deepspeed/ops/adam/__init__.py'
2026-03-05T21:46:38,022   adding 'deepspeed/ops/adam/cpu_adam.py'
2026-03-05T21:46:38,024   adding 'deepspeed/ops/adam/fused_adam.py'
2026-03-05T21:46:38,025   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2026-03-05T21:46:38,027   adding 'deepspeed/ops/adam/zenflow_cpu_adam.py'
2026-03-05T21:46:38,031   adding 'deepspeed/ops/adam/zenflow_torch_adam.py'
2026-03-05T21:46:38,033   adding 'deepspeed/ops/aio/__init__.py'
2026-03-05T21:46:38,034   adding 'deepspeed/ops/compile/__init__.py'
2026-03-05T21:46:38,037   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2026-03-05T21:46:38,039   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2026-03-05T21:46:38,041   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2026-03-05T21:46:38,042   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2026-03-05T21:46:38,043   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2026-03-05T21:46:38,045   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2026-03-05T21:46:38,048   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2026-03-05T21:46:38,050   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2026-03-05T21:46:38,051   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2026-03-05T21:46:38,052   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2026-03-05T21:46:38,054   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2026-03-05T21:46:38,055   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2026-03-05T21:46:38,057   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2026-03-05T21:46:38,058   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2026-03-05T21:46:38,059   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2026-03-05T21:46:38,060   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2026-03-05T21:46:38,061   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2026-03-05T21:46:38,063   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2026-03-05T21:46:38,064   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2026-03-05T21:46:38,065   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2026-03-05T21:46:38,066   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2026-03-05T21:46:38,067   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2026-03-05T21:46:38,068   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2026-03-05T21:46:38,069   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2026-03-05T21:46:38,071   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2026-03-05T21:46:38,072   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2026-03-05T21:46:38,074   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2026-03-05T21:46:38,075   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2026-03-05T21:46:38,077   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2026-03-05T21:46:38,078   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2026-03-05T21:46:38,080   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2026-03-05T21:46:38,082   adding 'deepspeed/ops/csrc/compile/init.cpp'
2026-03-05T21:46:38,083   adding 'deepspeed/ops/csrc/compile/util.cpp'
2026-03-05T21:46:38,085   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2026-03-05T21:46:38,086   adding 'deepspeed/ops/csrc/compile/z1.h'
2026-03-05T21:46:38,087   adding 'deepspeed/ops/csrc/compile/z2.cpp'
2026-03-05T21:46:38,088   adding 'deepspeed/ops/csrc/compile/z2.h'
2026-03-05T21:46:38,091   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2026-03-05T21:46:38,093   adding 'deepspeed/ops/csrc/compile/z3.h'
2026-03-05T21:46:38,095   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2026-03-05T21:46:38,098   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2026-03-05T21:46:38,100   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2026-03-05T21:46:38,102   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2026-03-05T21:46:38,103   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2026-03-05T21:46:38,105   adding 'deepspeed/ops/csrc/cpu/comm/arm64/shm.h'
2026-03-05T21:46:38,107   adding 'deepspeed/ops/csrc/cpu/comm/riscv64/shm.h'
2026-03-05T21:46:38,109   adding 'deepspeed/ops/csrc/cpu/comm/x86_64/shm.h'
2026-03-05T21:46:38,111   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2026-03-05T21:46:38,113   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2026-03-05T21:46:38,115   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2026-03-05T21:46:38,116   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2026-03-05T21:46:38,118   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2026-03-05T21:46:38,126   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2026-03-05T21:46:38,131   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2026-03-05T21:46:38,133   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2026-03-05T21:46:38,137   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2026-03-05T21:46:38,138   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2026-03-05T21:46:38,140   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2026-03-05T21:46:38,142   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2026-03-05T21:46:38,144   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2026-03-05T21:46:38,147   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2026-03-05T21:46:38,149   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2026-03-05T21:46:38,151   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2026-03-05T21:46:38,153   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2026-03-05T21:46:38,160   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2026-03-05T21:46:38,164   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2026-03-05T21:46:38,166   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2026-03-05T21:46:38,170   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2026-03-05T21:46:38,173   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2026-03-05T21:46:38,177   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2026-03-05T21:46:38,179   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2026-03-05T21:46:38,181   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2026-03-05T21:46:38,183   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2026-03-05T21:46:38,184   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2026-03-05T21:46:38,186   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2026-03-05T21:46:38,189   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2026-03-05T21:46:38,191   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_context.h'
2026-03-05T21:46:38,192   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2026-03-05T21:46:38,194   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2026-03-05T21:46:38,196   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2026-03-05T21:46:38,197   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2026-03-05T21:46:38,199   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2026-03-05T21:46:38,200   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2026-03-05T21:46:38,201   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2026-03-05T21:46:38,203   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2026-03-05T21:46:38,205   adding 'deepspeed/ops/csrc/includes/Timer.h'
2026-03-05T21:46:38,206   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2026-03-05T21:46:38,207   adding 'deepspeed/ops/csrc/includes/compat.h'
2026-03-05T21:46:38,209   adding 'deepspeed/ops/csrc/includes/context.h'
2026-03-05T21:46:38,211   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2026-03-05T21:46:38,213   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2026-03-05T21:46:38,214   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2026-03-05T21:46:38,216   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2026-03-05T21:46:38,218   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2026-03-05T21:46:38,219   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2026-03-05T21:46:38,223   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2026-03-05T21:46:38,224   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2026-03-05T21:46:38,226   adding 'deepspeed/ops/csrc/includes/dropout.h'
2026-03-05T21:46:38,227   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2026-03-05T21:46:38,229   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2026-03-05T21:46:38,230   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2026-03-05T21:46:38,231   adding 'deepspeed/ops/csrc/includes/gelu.h'
2026-03-05T21:46:38,233   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2026-03-05T21:46:38,234   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2026-03-05T21:46:38,237   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2026-03-05T21:46:38,238   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2026-03-05T21:46:38,240   adding 'deepspeed/ops/csrc/includes/quantization.h'
2026-03-05T21:46:38,242   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2026-03-05T21:46:38,243   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2026-03-05T21:46:38,246   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2026-03-05T21:46:38,248   adding 'deepspeed/ops/csrc/includes/simd.h'
2026-03-05T21:46:38,249   adding 'deepspeed/ops/csrc/includes/softmax.h'
2026-03-05T21:46:38,250   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2026-03-05T21:46:38,252   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2026-03-05T21:46:38,254   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2026-03-05T21:46:38,256   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2026-03-05T21:46:38,258   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2026-03-05T21:46:38,259   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2026-03-05T21:46:38,260   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2026-03-05T21:46:38,262   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2026-03-05T21:46:38,263   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2026-03-05T21:46:38,265   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2026-03-05T21:46:38,268   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2026-03-05T21:46:38,270   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2026-03-05T21:46:38,272   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2026-03-05T21:46:38,274   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2026-03-05T21:46:38,275   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2026-03-05T21:46:38,278   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2026-03-05T21:46:38,280   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2026-03-05T21:46:38,281   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2026-03-05T21:46:38,282   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2026-03-05T21:46:38,284   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2026-03-05T21:46:38,286   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2026-03-05T21:46:38,288   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2026-03-05T21:46:38,290   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2026-03-05T21:46:38,291   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2026-03-05T21:46:38,294   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2026-03-05T21:46:38,296   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2026-03-05T21:46:38,300   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2026-03-05T21:46:38,302   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2026-03-05T21:46:38,304   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2026-03-05T21:46:38,308   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2026-03-05T21:46:38,311   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2026-03-05T21:46:38,314   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2026-03-05T21:46:38,316   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2026-03-05T21:46:38,318   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2026-03-05T21:46:38,321   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2026-03-05T21:46:38,323   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2026-03-05T21:46:38,325   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2026-03-05T21:46:38,331   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2026-03-05T21:46:38,333   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2026-03-05T21:46:38,335   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2026-03-05T21:46:38,337   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2026-03-05T21:46:38,340   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2026-03-05T21:46:38,342   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2026-03-05T21:46:38,344   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2026-03-05T21:46:38,345   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2026-03-05T21:46:38,347   adding 'deepspeed/ops/csrc/utils/py_ds_utils.cpp'
2026-03-05T21:46:38,348   adding 'deepspeed/ops/csrc/utils/tensor_cast.cpp'
2026-03-05T21:46:38,349   adding 'deepspeed/ops/csrc/utils/tensor_cast.h'
2026-03-05T21:46:38,352   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2026-03-05T21:46:38,353   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2026-03-05T21:46:38,355   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2026-03-05T21:46:38,357   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2026-03-05T21:46:38,359   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2026-03-05T21:46:38,360   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2026-03-05T21:46:38,362   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2026-03-05T21:46:38,363   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2026-03-05T21:46:38,365   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2026-03-05T21:46:38,366   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2026-03-05T21:46:38,368   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2026-03-05T21:46:38,370   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2026-03-05T21:46:38,371   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2026-03-05T21:46:38,373   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2026-03-05T21:46:38,374   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2026-03-05T21:46:38,376   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2026-03-05T21:46:38,377   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2026-03-05T21:46:38,379   adding 'deepspeed/ops/gds/__init__.py'
2026-03-05T21:46:38,380   adding 'deepspeed/ops/lamb/__init__.py'
2026-03-05T21:46:38,382   adding 'deepspeed/ops/lamb/fused_lamb.py'
2026-03-05T21:46:38,384   adding 'deepspeed/ops/lion/__init__.py'
2026-03-05T21:46:38,385   adding 'deepspeed/ops/lion/cpu_lion.py'
2026-03-05T21:46:38,387   adding 'deepspeed/ops/lion/fused_lion.py'
2026-03-05T21:46:38,388   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2026-03-05T21:46:38,391   adding 'deepspeed/ops/op_builder/__init__.py'
2026-03-05T21:46:38,392   adding 'deepspeed/ops/op_builder/all_ops.py'
2026-03-05T21:46:38,393   adding 'deepspeed/ops/op_builder/async_io.py'
2026-03-05T21:46:38,397   adding 'deepspeed/ops/op_builder/builder.py'
2026-03-05T21:46:38,399   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2026-03-05T21:46:38,400   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2026-03-05T21:46:38,401   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2026-03-05T21:46:38,402   adding 'deepspeed/ops/op_builder/dc.py'
2026-03-05T21:46:38,404   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2026-03-05T21:46:38,405   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2026-03-05T21:46:38,406   adding 'deepspeed/ops/op_builder/fused_adam.py'
2026-03-05T21:46:38,408   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2026-03-05T21:46:38,409   adding 'deepspeed/ops/op_builder/fused_lion.py'
2026-03-05T21:46:38,410   adding 'deepspeed/ops/op_builder/gds.py'
2026-03-05T21:46:38,412   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2026-03-05T21:46:38,413   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2026-03-05T21:46:38,414   adding 'deepspeed/ops/op_builder/quantizer.py'
2026-03-05T21:46:38,416   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2026-03-05T21:46:38,417   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2026-03-05T21:46:38,419   adding 'deepspeed/ops/op_builder/random_ltd.py'
2026-03-05T21:46:38,420   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2026-03-05T21:46:38,421   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2026-03-05T21:46:38,422   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2026-03-05T21:46:38,423   adding 'deepspeed/ops/op_builder/transformer.py'
2026-03-05T21:46:38,425   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2026-03-05T21:46:38,426   adding 'deepspeed/ops/op_builder/utils.py'
2026-03-05T21:46:38,428   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2026-03-05T21:46:38,429   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2026-03-05T21:46:38,430   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2026-03-05T21:46:38,431   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2026-03-05T21:46:38,433   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2026-03-05T21:46:38,434   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2026-03-05T21:46:38,435   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2026-03-05T21:46:38,437   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2026-03-05T21:46:38,438   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2026-03-05T21:46:38,439   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2026-03-05T21:46:38,440   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2026-03-05T21:46:38,442   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2026-03-05T21:46:38,443   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2026-03-05T21:46:38,444   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2026-03-05T21:46:38,446   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2026-03-05T21:46:38,447   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2026-03-05T21:46:38,448   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2026-03-05T21:46:38,449   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2026-03-05T21:46:38,450   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2026-03-05T21:46:38,452   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2026-03-05T21:46:38,454   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2026-03-05T21:46:38,455   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2026-03-05T21:46:38,457   adding 'deepspeed/ops/op_builder/npu/builder.py'
2026-03-05T21:46:38,458   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2026-03-05T21:46:38,459   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2026-03-05T21:46:38,460   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2026-03-05T21:46:38,461   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2026-03-05T21:46:38,463   adding 'deepspeed/ops/op_builder/npu/inference.py'
2026-03-05T21:46:38,464   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2026-03-05T21:46:38,466   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2026-03-05T21:46:38,468   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2026-03-05T21:46:38,469   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2026-03-05T21:46:38,470   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2026-03-05T21:46:38,472   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2026-03-05T21:46:38,473   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2026-03-05T21:46:38,475   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2026-03-05T21:46:38,477   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2026-03-05T21:46:38,479   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2026-03-05T21:46:38,480   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2026-03-05T21:46:38,481   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2026-03-05T21:46:38,482   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2026-03-05T21:46:38,484   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2026-03-05T21:46:38,485   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2026-03-05T21:46:38,487   adding 'deepspeed/ops/quantizer/__init__.py'
2026-03-05T21:46:38,488   adding 'deepspeed/ops/quantizer/quantizer.py'
2026-03-05T21:46:38,489   adding 'deepspeed/ops/random_ltd/__init__.py'
2026-03-05T21:46:38,491   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2026-03-05T21:46:38,493   adding 'deepspeed/ops/sparse_attention/__init__.py'
2026-03-05T21:46:38,494   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2026-03-05T21:46:38,498   adding 'deepspeed/ops/sparse_attention/matmul.py'
2026-03-05T21:46:38,500   adding 'deepspeed/ops/sparse_attention/softmax.py'
2026-03-05T21:46:38,502   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2026-03-05T21:46:38,503   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2026-03-05T21:46:38,506   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2026-03-05T21:46:38,508   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2026-03-05T21:46:38,510   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2026-03-05T21:46:38,511   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2026-03-05T21:46:38,512   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2026-03-05T21:46:38,514   adding 'deepspeed/ops/transformer/__init__.py'
2026-03-05T21:46:38,516   adding 'deepspeed/ops/transformer/transformer.py'
2026-03-05T21:46:38,518   adding 'deepspeed/ops/transformer/inference/__init__.py'
2026-03-05T21:46:38,519   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2026-03-05T21:46:38,521   adding 'deepspeed/ops/transformer/inference/config.py'
2026-03-05T21:46:38,522   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2026-03-05T21:46:38,524   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2026-03-05T21:46:38,525   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2026-03-05T21:46:38,527   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2026-03-05T21:46:38,529   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2026-03-05T21:46:38,531   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2026-03-05T21:46:38,532   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2026-03-05T21:46:38,534   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2026-03-05T21:46:38,535   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2026-03-05T21:46:38,537   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2026-03-05T21:46:38,538   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2026-03-05T21:46:38,539   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2026-03-05T21:46:38,540   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2026-03-05T21:46:38,542   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2026-03-05T21:46:38,543   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2026-03-05T21:46:38,544   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2026-03-05T21:46:38,545   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2026-03-05T21:46:38,547   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2026-03-05T21:46:38,548   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2026-03-05T21:46:38,550   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2026-03-05T21:46:38,551   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2026-03-05T21:46:38,552   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2026-03-05T21:46:38,553   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2026-03-05T21:46:38,555   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2026-03-05T21:46:38,556   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2026-03-05T21:46:38,557   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2026-03-05T21:46:38,559   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2026-03-05T21:46:38,560   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2026-03-05T21:46:38,562   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2026-03-05T21:46:38,563   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2026-03-05T21:46:38,565   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2026-03-05T21:46:38,567   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2026-03-05T21:46:38,568   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2026-03-05T21:46:38,570   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2026-03-05T21:46:38,572   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2026-03-05T21:46:38,573   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2026-03-05T21:46:38,574   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2026-03-05T21:46:38,576   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2026-03-05T21:46:38,577   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2026-03-05T21:46:38,579   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2026-03-05T21:46:38,580   adding 'deepspeed/pipe/__init__.py'
2026-03-05T21:46:38,582   adding 'deepspeed/profiling/__init__.py'
2026-03-05T21:46:38,583   adding 'deepspeed/profiling/config.py'
2026-03-05T21:46:38,584   adding 'deepspeed/profiling/constants.py'
2026-03-05T21:46:38,586   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2026-03-05T21:46:38,591   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2026-03-05T21:46:38,593   adding 'deepspeed/runtime/__init__.py'
2026-03-05T21:46:38,596   adding 'deepspeed/runtime/base_optimizer.py'
2026-03-05T21:46:38,599   adding 'deepspeed/runtime/bf16_optimizer.py'
2026-03-05T21:46:38,600   adding 'deepspeed/runtime/compiler.py'
2026-03-05T21:46:38,604   adding 'deepspeed/runtime/config.py'
2026-03-05T21:46:38,606   adding 'deepspeed/runtime/config_utils.py'
2026-03-05T21:46:38,608   adding 'deepspeed/runtime/constants.py'
2026-03-05T21:46:38,610   adding 'deepspeed/runtime/dataloader.py'
2026-03-05T21:46:38,611   adding 'deepspeed/runtime/eigenvalue.py'
2026-03-05T21:46:38,635   adding 'deepspeed/runtime/engine.py'
2026-03-05T21:46:38,638   adding 'deepspeed/runtime/hybrid_engine.py'
2026-03-05T21:46:38,642   adding 'deepspeed/runtime/lr_schedules.py'
2026-03-05T21:46:38,643   adding 'deepspeed/runtime/precision_config.py'
2026-03-05T21:46:38,645   adding 'deepspeed/runtime/progressive_layer_drop.py'
2026-03-05T21:46:38,646   adding 'deepspeed/runtime/quantize.py'
2026-03-05T21:46:38,648   adding 'deepspeed/runtime/sparse_tensor.py'
2026-03-05T21:46:38,650   adding 'deepspeed/runtime/state_dict_factory.py'
2026-03-05T21:46:38,651   adding 'deepspeed/runtime/torch_autocast.py'
2026-03-05T21:46:38,658   adding 'deepspeed/runtime/utils.py'
2026-03-05T21:46:38,660   adding 'deepspeed/runtime/weight_quantizer.py'
2026-03-05T21:46:38,662   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2026-03-05T21:46:38,666   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2026-03-05T21:46:38,668   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2026-03-05T21:46:38,670   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2026-03-05T21:46:38,671   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2026-03-05T21:46:38,672   adding 'deepspeed/runtime/checkpoint_engine/datastates_checkpoint_engine.py'
2026-03-05T21:46:38,674   adding 'deepspeed/runtime/checkpoint_engine/decoupled_checkpoint_engine.py'
2026-03-05T21:46:38,675   adding 'deepspeed/runtime/checkpoint_engine/fast_checkpoint_engine.py'
2026-03-05T21:46:38,677   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2026-03-05T21:46:38,678   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2026-03-05T21:46:38,679   adding 'deepspeed/runtime/checkpoint_engine/utils.py'
2026-03-05T21:46:38,681   adding 'deepspeed/runtime/comm/__init__.py'
2026-03-05T21:46:38,683   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2026-03-05T21:46:38,685   adding 'deepspeed/runtime/comm/compressed.py'
2026-03-05T21:46:38,686   adding 'deepspeed/runtime/comm/hccl.py'
2026-03-05T21:46:38,688   adding 'deepspeed/runtime/comm/mpi.py'
2026-03-05T21:46:38,689   adding 'deepspeed/runtime/comm/nccl.py'
2026-03-05T21:46:38,690   adding 'deepspeed/runtime/comm/utils.py'
2026-03-05T21:46:38,692   adding 'deepspeed/runtime/compression/__init__.py'
2026-03-05T21:46:38,693   adding 'deepspeed/runtime/compression/cupy.py'
2026-03-05T21:46:38,694   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2026-03-05T21:46:38,696   adding 'deepspeed/runtime/data_pipeline/config.py'
2026-03-05T21:46:38,697   adding 'deepspeed/runtime/data_pipeline/constants.py'
2026-03-05T21:46:38,699   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2026-03-05T21:46:38,700   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2026-03-05T21:46:38,702   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2026-03-05T21:46:38,703   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2026-03-05T21:46:38,705   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2026-03-05T21:46:38,746   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2026-03-05T21:46:38,748   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2026-03-05T21:46:38,754   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2026-03-05T21:46:38,756   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2026-03-05T21:46:38,759   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2026-03-05T21:46:38,761   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2026-03-05T21:46:38,764   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2026-03-05T21:46:38,766   adding 'deepspeed/runtime/domino/__init__.py'
2026-03-05T21:46:38,768   adding 'deepspeed/runtime/domino/async_linear.py'
2026-03-05T21:46:38,771   adding 'deepspeed/runtime/domino/transformer.py'
2026-03-05T21:46:38,773   adding 'deepspeed/runtime/fp16/__init__.py'
2026-03-05T21:46:38,776   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2026-03-05T21:46:38,778   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2026-03-05T21:46:38,781   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2026-03-05T21:46:38,783   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2026-03-05T21:46:38,785   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2026-03-05T21:46:38,789   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2026-03-05T21:46:38,791   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2026-03-05T21:46:38,793   adding 'deepspeed/runtime/model_checkpointing/__init__.py'
2026-03-05T21:46:38,795   adding 'deepspeed/runtime/model_checkpointing/config.py'
2026-03-05T21:46:38,797   adding 'deepspeed/runtime/model_checkpointing/constants.py'
2026-03-05T21:46:38,799   adding 'deepspeed/runtime/model_checkpointing/data_parallel_writer_factory.py'
2026-03-05T21:46:38,800   adding 'deepspeed/runtime/model_checkpointing/utils.py'
2026-03-05T21:46:38,802   adding 'deepspeed/runtime/model_checkpointing/writer_factory.py'
2026-03-05T21:46:38,804   adding 'deepspeed/runtime/pipe/__init__.py'
2026-03-05T21:46:38,811   adding 'deepspeed/runtime/pipe/engine.py'
2026-03-05T21:46:38,815   adding 'deepspeed/runtime/pipe/module.py'
2026-03-05T21:46:38,817   adding 'deepspeed/runtime/pipe/p2p.py'
2026-03-05T21:46:38,820   adding 'deepspeed/runtime/pipe/schedule.py'
2026-03-05T21:46:38,823   adding 'deepspeed/runtime/pipe/topology.py'
2026-03-05T21:46:38,824   adding 'deepspeed/runtime/sequence_parallel/__init__.py'
2026-03-05T21:46:38,826   adding 'deepspeed/runtime/sequence_parallel/parallel_state_sp.py'
2026-03-05T21:46:38,835   adding 'deepspeed/runtime/sequence_parallel/ulysses_sp.py'
2026-03-05T21:46:38,837   adding 'deepspeed/runtime/superoffload/__init__.py'
2026-03-05T21:46:38,839   adding 'deepspeed/runtime/superoffload/superoffload_stage3.py'
2026-03-05T21:46:38,841   adding 'deepspeed/runtime/superoffload/superoffload_utils.py'
2026-03-05T21:46:38,844   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2026-03-05T21:46:38,845   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2026-03-05T21:46:38,847   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2026-03-05T21:46:38,849   adding 'deepspeed/runtime/swap_tensor/constants.py'
2026-03-05T21:46:38,852   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2026-03-05T21:46:38,854   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2026-03-05T21:46:38,857   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2026-03-05T21:46:38,859   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2026-03-05T21:46:38,861   adding 'deepspeed/runtime/swap_tensor/utils.py'
2026-03-05T21:46:38,863   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2026-03-05T21:46:38,865   adding 'deepspeed/runtime/tensor_parallel/config.py'
2026-03-05T21:46:38,866   adding 'deepspeed/runtime/tensor_parallel/init_utils.py'
2026-03-05T21:46:38,868   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2026-03-05T21:46:38,870   adding 'deepspeed/runtime/zenflow/__init__.py'
2026-03-05T21:46:38,872   adding 'deepspeed/runtime/zenflow/engine.py'
2026-03-05T21:46:38,875   adding 'deepspeed/runtime/zenflow/engine_stage3.py'
2026-03-05T21:46:38,877   adding 'deepspeed/runtime/zenflow/zenflow_config.py'
2026-03-05T21:46:38,881   adding 'deepspeed/runtime/zenflow/zenflow_stage_1_and_2.py'
2026-03-05T21:46:38,883   adding 'deepspeed/runtime/zenflow/zenflow_utils.py'
2026-03-05T21:46:38,885   adding 'deepspeed/runtime/zero/__init__.py'
2026-03-05T21:46:38,888   adding 'deepspeed/runtime/zero/config.py'
2026-03-05T21:46:38,890   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2026-03-05T21:46:38,891   adding 'deepspeed/runtime/zero/leaf_module_config.py'
2026-03-05T21:46:38,893   adding 'deepspeed/runtime/zero/linear.py'
2026-03-05T21:46:38,895   adding 'deepspeed/runtime/zero/mics.py'
2026-03-05T21:46:38,897   adding 'deepspeed/runtime/zero/mics_utils.py'
2026-03-05T21:46:38,898   adding 'deepspeed/runtime/zero/offload_config.py'
2026-03-05T21:46:38,900   adding 'deepspeed/runtime/zero/offload_states.py'
2026-03-05T21:46:38,903   adding 'deepspeed/runtime/zero/parameter_offload.py'
2026-03-05T21:46:38,915   adding 'deepspeed/runtime/zero/partition_parameters.py'
2026-03-05T21:46:38,919   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2026-03-05T21:46:38,921   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2026-03-05T21:46:38,938   adding 'deepspeed/runtime/zero/stage3.py'
2026-03-05T21:46:38,954   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2026-03-05T21:46:38,957   adding 'deepspeed/runtime/zero/test.py'
2026-03-05T21:46:38,958   adding 'deepspeed/runtime/zero/tiling.py'
2026-03-05T21:46:38,960   adding 'deepspeed/runtime/zero/utils.py'
2026-03-05T21:46:38,962   adding 'deepspeed/runtime/zero/muon/__init__.py'
2026-03-05T21:46:38,963   adding 'deepspeed/runtime/zero/muon/muon_optimizer.py'
2026-03-05T21:46:38,965   adding 'deepspeed/runtime/zero/muon/original_muon.py'
2026-03-05T21:46:38,967   adding 'deepspeed/sequence/__init__.py'
2026-03-05T21:46:38,968   adding 'deepspeed/sequence/cross_entropy.py'
2026-03-05T21:46:38,972   adding 'deepspeed/sequence/fpdt_layer.py'
2026-03-05T21:46:38,975   adding 'deepspeed/sequence/layer.py'
2026-03-05T21:46:38,977   adding 'deepspeed/utils/__init__.py'
2026-03-05T21:46:38,979   adding 'deepspeed/utils/bwc.py'
2026-03-05T21:46:38,981   adding 'deepspeed/utils/comms_logging.py'
2026-03-05T21:46:38,982   adding 'deepspeed/utils/config.py'
2026-03-05T21:46:38,984   adding 'deepspeed/utils/debug.py'
2026-03-05T21:46:38,985   adding 'deepspeed/utils/exceptions.py'
2026-03-05T21:46:38,988   adding 'deepspeed/utils/groups.py'
2026-03-05T21:46:38,990   adding 'deepspeed/utils/init_on_device.py'
2026-03-05T21:46:38,991   adding 'deepspeed/utils/logging.py'
2026-03-05T21:46:38,993   adding 'deepspeed/utils/mixed_precision_linkage.py'
2026-03-05T21:46:38,994   adding 'deepspeed/utils/numa.py'
2026-03-05T21:46:38,996   adding 'deepspeed/utils/nvtx.py'
2026-03-05T21:46:38,998   adding 'deepspeed/utils/tensor_fragment.py'
2026-03-05T21:46:38,999   adding 'deepspeed/utils/timer.py'
2026-03-05T21:46:39,001   adding 'deepspeed/utils/torch.py'
2026-03-05T21:46:39,002   adding 'deepspeed/utils/types.py'
2026-03-05T21:46:39,003   adding 'deepspeed/utils/z3_leaf_module.py'
2026-03-05T21:46:39,007   adding 'deepspeed/utils/zero_to_fp32.py'
2026-03-05T21:46:39,009   adding 'deepspeed-0.18.7.data/scripts/deepspeed'
2026-03-05T21:46:39,010   adding 'deepspeed-0.18.7.data/scripts/deepspeed.pt'
2026-03-05T21:46:39,011   adding 'deepspeed-0.18.7.data/scripts/ds'
2026-03-05T21:46:39,012   adding 'deepspeed-0.18.7.data/scripts/ds_bench'
2026-03-05T21:46:39,014   adding 'deepspeed-0.18.7.data/scripts/ds_elastic'
2026-03-05T21:46:39,015   adding 'deepspeed-0.18.7.data/scripts/ds_io'
2026-03-05T21:46:39,016   adding 'deepspeed-0.18.7.data/scripts/ds_nvme_tune'
2026-03-05T21:46:39,017   adding 'deepspeed-0.18.7.data/scripts/ds_report'
2026-03-05T21:46:39,018   adding 'deepspeed-0.18.7.data/scripts/ds_ssh'
2026-03-05T21:46:39,019   adding 'deepspeed-0.18.7.data/scripts/dsr'
2026-03-05T21:46:39,023   adding 'deepspeed-0.18.7.dist-info/licenses/LICENSE'
2026-03-05T21:46:39,027   adding 'deepspeed-0.18.7.dist-info/METADATA'
2026-03-05T21:46:39,028   adding 'deepspeed-0.18.7.dist-info/WHEEL'
2026-03-05T21:46:39,029   adding 'deepspeed-0.18.7.dist-info/entry_points.txt'
2026-03-05T21:46:39,030   adding 'deepspeed-0.18.7.dist-info/top_level.txt'
2026-03-05T21:46:39,046   adding 'deepspeed-0.18.7.dist-info/RECORD'
2026-03-05T21:46:39,083   removing build/bdist.linux-armv7l/wheel
2026-03-05T21:46:39,327   deepspeed build time = 12.984767436981201 secs
2026-03-05T21:46:39,451   Building wheel for deepspeed (setup.py): finished with status 'done'
2026-03-05T21:46:39,471   Created wheel for deepspeed: filename=deepspeed-0.18.7-py3-none-any.whl size=1801184 sha256=e8fe68f4be025ab2af17d9046daaee6b9f98b4ddf9390ad91a3487069e0a4df7
2026-03-05T21:46:39,472   Stored in directory: /tmp/pip-ephem-wheel-cache-ngxr77qy/wheels/37/34/36/0cb53cb768e1bcc115b942ec8c778d60925c167342b6545257
2026-03-05T21:46:39,519 Successfully built deepspeed
2026-03-05T21:46:39,575 Removed build tracker: '/tmp/pip-build-tracker-v4ot7po8'