2025-06-08T19:18:25,797 Created temporary directory: /tmp/pip-build-tracker-sop76ve_
2025-06-08T19:18:25,798 Initialized build tracking at /tmp/pip-build-tracker-sop76ve_
2025-06-08T19:18:25,799 Created build tracker: /tmp/pip-build-tracker-sop76ve_
2025-06-08T19:18:25,799 Entered build tracker: /tmp/pip-build-tracker-sop76ve_
2025-06-08T19:18:25,800 Created temporary directory: /tmp/pip-wheel-bcqppjmw
2025-06-08T19:18:25,805 Created temporary directory: /tmp/pip-ephem-wheel-cache-4_gjwziq
2025-06-08T19:18:25,855 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2025-06-08T19:18:25,857 2 location(s) to search for versions of deepspeed:
2025-06-08T19:18:25,857 * https://pypi.org/simple/deepspeed/
2025-06-08T19:18:25,857 * https://www.piwheels.org/simple/deepspeed/
2025-06-08T19:18:25,858 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2025-06-08T19:18:25,859 Getting page https://pypi.org/simple/deepspeed/
2025-06-08T19:18:25,861 Found index url https://pypi.org/simple/
2025-06-08T19:18:26,093 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2025-06-08T19:18:26,117   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,117   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2025-06-08T19:18:26,118   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,119   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2025-06-08T19:18:26,119   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,120   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2025-06-08T19:18:26,120   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,121   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2025-06-08T19:18:26,122   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,122   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2025-06-08T19:18:26,123   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2025-06-08T19:18:26,124   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2025-06-08T19:18:26,124   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2025-06-08T19:18:26,125   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2025-06-08T19:18:26,126   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2025-06-08T19:18:26,126   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2025-06-08T19:18:26,127   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2025-06-08T19:18:26,127   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2025-06-08T19:18:26,128   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2025-06-08T19:18:26,128   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2025-06-08T19:18:26,129   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2025-06-08T19:18:26,130   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2025-06-08T19:18:26,130   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2025-06-08T19:18:26,131   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2025-06-08T19:18:26,131   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2025-06-08T19:18:26,132   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2025-06-08T19:18:26,133   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2025-06-08T19:18:26,133   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2025-06-08T19:18:26,134   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2025-06-08T19:18:26,135   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2025-06-08T19:18:26,135   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2025-06-08T19:18:26,136   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2025-06-08T19:18:26,137   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2025-06-08T19:18:26,137   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2025-06-08T19:18:26,138   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2025-06-08T19:18:26,138   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2025-06-08T19:18:26,139   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2025-06-08T19:18:26,140   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2025-06-08T19:18:26,140   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2025-06-08T19:18:26,141   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2025-06-08T19:18:26,142   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2025-06-08T19:18:26,142   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2025-06-08T19:18:26,143   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2025-06-08T19:18:26,143   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2025-06-08T19:18:26,144   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2025-06-08T19:18:26,145   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2025-06-08T19:18:26,145   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2025-06-08T19:18:26,146   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2025-06-08T19:18:26,147   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2025-06-08T19:18:26,148   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2025-06-08T19:18:26,148   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2025-06-08T19:18:26,149   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2025-06-08T19:18:26,149   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2025-06-08T19:18:26,150   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2025-06-08T19:18:26,151   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2025-06-08T19:18:26,151   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2025-06-08T19:18:26,152   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2025-06-08T19:18:26,153   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2025-06-08T19:18:26,153   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2025-06-08T19:18:26,154   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2025-06-08T19:18:26,155   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2025-06-08T19:18:26,155   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2025-06-08T19:18:26,156   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2025-06-08T19:18:26,157   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2025-06-08T19:18:26,158   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2025-06-08T19:18:26,158   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2025-06-08T19:18:26,159   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2025-06-08T19:18:26,160   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2025-06-08T19:18:26,161   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2025-06-08T19:18:26,161   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2025-06-08T19:18:26,162   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2025-06-08T19:18:26,163   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2025-06-08T19:18:26,163   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2025-06-08T19:18:26,164   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2025-06-08T19:18:26,165   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2025-06-08T19:18:26,165   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2025-06-08T19:18:26,166   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2025-06-08T19:18:26,167   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2025-06-08T19:18:26,167   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2025-06-08T19:18:26,168   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2025-06-08T19:18:26,169   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2025-06-08T19:18:26,169   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2025-06-08T19:18:26,170   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2025-06-08T19:18:26,171   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2025-06-08T19:18:26,172   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2025-06-08T19:18:26,172   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2025-06-08T19:18:26,173   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2025-06-08T19:18:26,174   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2025-06-08T19:18:26,174   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2025-06-08T19:18:26,175   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2025-06-08T19:18:26,175   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2025-06-08T19:18:26,176   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2025-06-08T19:18:26,177   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2025-06-08T19:18:26,177   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2025-06-08T19:18:26,178   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2025-06-08T19:18:26,179   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2025-06-08T19:18:26,179   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,180   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2025-06-08T19:18:26,180   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/2e/5c/2058713749655a6b1830ecb8d7db61637a396239610aeb11b59974d29b66/deepspeed-0.15.0-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,181   Found link https://files.pythonhosted.org/packages/13/14/5cde975724b07a70ef6cf58cf15efe8505c7c4dbf0a3d9e6ef36adc48775/deepspeed-0.15.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.0
2025-06-08T19:18:26,182   Found link https://files.pythonhosted.org/packages/09/48/915599bbe9e47b59cfc148937fb537d53bad2ea71121a74fec13214bc33a/deepspeed-0.15.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.1
2025-06-08T19:18:26,182   Found link https://files.pythonhosted.org/packages/a2/f7/ecd834b9a02beef30104845a520c1d138e6e7398b0ed14e5d347f3c40486/deepspeed-0.15.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.2
2025-06-08T19:18:26,183   Found link https://files.pythonhosted.org/packages/01/e3/2848c83b2645751a7315df0388c1df2b23c321b99a2e07cb1ad320db101d/deepspeed-0.15.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.3
2025-06-08T19:18:26,184   Found link https://files.pythonhosted.org/packages/34/c5/dfa824defc1919289a00cbb722aee92cee85ce1e11f7349779235dbe4810/deepspeed-0.15.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.15.4
2025-06-08T19:18:26,184   Found link https://files.pythonhosted.org/packages/eb/b0/d0fe1ecb4ca9a6b4be66a1b472d514eda0fdbb407481d51a0fcd2f38e733/deepspeed-0.16.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.0
2025-06-08T19:18:26,185   Found link https://files.pythonhosted.org/packages/85/c8/276e49b7c51fbd48ff50728eec19a5a896bcde2fdb881d0306ceae64f525/deepspeed-0.16.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.1
2025-06-08T19:18:26,186   Found link https://files.pythonhosted.org/packages/d6/79/49cdf7d168b9ddcefeec6fda7a094a98bb48b046d56c7f4b2e092124534f/deepspeed-0.16.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.2
2025-06-08T19:18:26,186   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/52/23/cfe2166f06f1817b73b8695addd2fded55f4189322bcf181cfb7feaba550/deepspeed-0.16.3-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,187   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/ce/92/853de2a32b3f9c0945e0c9e145eddac98e570c1faebcd58aa85e6dcd89ba/deepspeed-0.16.3-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,187   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/55/8f/57ee424e114478a667c604b2f3f05bbc1addc0afc089b9ab6a64b233063d/deepspeed-0.16.3-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,188   Found link https://files.pythonhosted.org/packages/69/c5/9617171e726b11a7a753315906ae0ee8944925c9b6f975f22845c382eda7/deepspeed-0.16.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.3
2025-06-08T19:18:26,188   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/3d/65/1a6394f5d6dee851e9ea59e385f6d6428e3bfe36f83c06e0336e14dcfd11/deepspeed-0.16.4-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,189   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a3/aa/bb67b63cc25c5e29e4ca3f8b155e0faf74d5a33acf2ec67e249206a36b0f/deepspeed-0.16.4-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,190   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d4/59/fd251661b78b049eed7ee46f0d8d51c69ae7fbb710716a1ebcc796a6b0fd/deepspeed-0.16.4-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,190   Found link https://files.pythonhosted.org/packages/b5/a9/f408e70e37fcd877e56e446081b40f2ce225f726a070cc4dfc478c570b58/deepspeed-0.16.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.4
2025-06-08T19:18:26,191   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/15/b0/be6cc74fd1e23da20d6c34db923858a8ae5017d39a13dedc188a935c646a/deepspeed-0.16.5-cp310-cp310-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,192   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/0b/78/9a87d137f83f53dd57f425ac174723c746c53029bf6cdce22eb9e805e3f0/deepspeed-0.16.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,192   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/80/f8/a9b1fca237fe8ea25f866956778280d0b735350f29fb6f4e0b548aa02a5f/deepspeed-0.16.5-cp312-cp312-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2025-06-08T19:18:26,193   Found link https://files.pythonhosted.org/packages/0d/88/96569b2acb3219c9c72068f9b952c59beffe366e7d1edd9e922e5c68f08b/deepspeed-0.16.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.5
2025-06-08T19:18:26,193   Found link https://files.pythonhosted.org/packages/cb/a3/1d758fcbcdb3f5ecf4e71907e293f17bae8a9f448b112e65c6195e90c2d3/deepspeed-0.16.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.6
2025-06-08T19:18:26,194   Found link https://files.pythonhosted.org/packages/06/b3/a3903de5c5b707170c5c27e1a40f4ef613f14d241bd84d8b151a2a8786f6/deepspeed-0.16.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.7
2025-06-08T19:18:26,195   Found link https://files.pythonhosted.org/packages/e1/27/f857569546dc97f64169df1cc35d1ec5161766c4a0ec32f2af5d39614a51/deepspeed-0.16.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.8
2025-06-08T19:18:26,196   Found link https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.16.9
2025-06-08T19:18:26,196   Found link https://files.pythonhosted.org/packages/1e/35/eef570f4da4a39d0e7f2e72757295fdba3718a8eca60d8d6dcfeb9e6f26d/deepspeed-0.17.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.0
2025-06-08T19:18:26,197   Found link https://files.pythonhosted.org/packages/38/10/a7f63e086c1e1c12e290c98363c748ef5ddd6313fde739d2aeccd5ed0cd4/deepspeed-0.17.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.1
2025-06-08T19:18:26,198   Found link https://files.pythonhosted.org/packages/8c/45/1ddcf8f8500d90fad9f3396bfb1295462d46a747ddcbfafcd7714d46827e/deepspeed-0.17.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.2
2025-06-08T19:18:26,198   Found link https://files.pythonhosted.org/packages/9e/6b/89faa30a38405cd2d7a81790b262673ca4c8e8ec97c2f8c433da04d7a002/deepspeed-0.17.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.3
2025-06-08T19:18:26,199   Found link https://files.pythonhosted.org/packages/84/b3/02d000bfd0d6f0ba3f5dac487e4151b3e9b4b3ee71336882102dc9ad79ad/deepspeed-0.17.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.17.4
2025-06-08T19:18:26,200 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2025-06-08T19:18:26,201 Getting page https://www.piwheels.org/simple/deepspeed/
2025-06-08T19:18:26,202 Found index url https://www.piwheels.org/simple/
2025-06-08T19:18:26,372 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T19:18:27,041 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T19:18:28,208 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T19:18:30,386 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T19:18:34,559 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))': /simple/deepspeed/
2025-06-08T19:18:34,732 Could not fetch URL https://www.piwheels.org/simple/deepspeed/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='www.piwheels.org', port=443): Max retries exceeded with url: /simple/deepspeed/ (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate is not yet valid (_ssl.c:992)'))) - skipping
2025-06-08T19:18:34,734 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2025-06-08T19:18:34,734 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2025-06-08T19:18:34,768 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2025-06-08T19:18:34,770 Collecting deepspeed==0.16.9
2025-06-08T19:18:34,772   Created temporary directory: /tmp/pip-unpack-avvxi8lh
2025-06-08T19:18:35,003   Downloading deepspeed-0.16.9.tar.gz (1.5 MB)
2025-06-08T19:18:38,070   Added deepspeed==0.16.9 from https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz to build tracker '/tmp/pip-build-tracker-sop76ve_'
2025-06-08T19:18:38,072   Running setup.py (path:/tmp/pip-wheel-bcqppjmw/deepspeed_18a7358e52a8472e8bbaed137f537023/setup.py) egg_info for package deepspeed
2025-06-08T19:18:38,073   Created temporary directory: /tmp/pip-pip-egg-info-cxo_t4jn
2025-06-08T19:18:38,074   Preparing metadata (setup.py): started
2025-06-08T19:18:38,075   Running command python setup.py egg_info
2025-06-08T19:18:39,469   fatal: not a git repository (or any of the parent directories): .git
2025-06-08T19:18:39,965   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-08T19:18:39,966    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-08T19:18:39,966   DS_BUILD_OPS=0
2025-06-08T19:18:39,967   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-08T19:18:39,967   version=0.16.9, git_hash=unknown, git_branch=unknown
2025-06-08T19:18:39,968   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-08T19:18:39,968   ext_modules=[]
2025-06-08T19:18:39,969   running egg_info
2025-06-08T19:18:39,994   creating /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info
2025-06-08T19:18:39,995   writing /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/PKG-INFO
2025-06-08T19:18:40,031   writing dependency_links to /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/dependency_links.txt
2025-06-08T19:18:40,033   writing entry points to /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/entry_points.txt
2025-06-08T19:18:40,052   writing requirements to /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/requires.txt
2025-06-08T19:18:40,053   writing top-level names to /tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/top_level.txt
2025-06-08T19:18:40,055   writing manifest file '/tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/SOURCES.txt'
2025-06-08T19:18:40,324   reading manifest file '/tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/SOURCES.txt'
2025-06-08T19:18:40,326   reading manifest template 'MANIFEST.in'
2025-06-08T19:18:40,328   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-08T19:18:40,329   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-08T19:18:42,844   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-08T19:18:44,125   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-08T19:18:44,991   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-08T19:18:45,146   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-08T19:18:45,208   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-08T19:18:45,216   adding license file 'LICENSE'
2025-06-08T19:18:45,262   writing manifest file '/tmp/pip-pip-egg-info-cxo_t4jn/deepspeed.egg-info/SOURCES.txt'
2025-06-08T19:18:45,265   deepspeed build time = 5.79151463508606 secs
2025-06-08T19:18:45,383   Preparing metadata (setup.py): finished with status 'done'
2025-06-08T19:18:45,389   Source in /tmp/pip-wheel-bcqppjmw/deepspeed_18a7358e52a8472e8bbaed137f537023 has version 0.16.9, which satisfies requirement deepspeed==0.16.9 from https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz
2025-06-08T19:18:45,390   Removed deepspeed==0.16.9 from https://files.pythonhosted.org/packages/4f/5c/7542904cddfaa50a9a7ae6770349d468773359f5af1718865452cea8729d/deepspeed-0.16.9.tar.gz from build tracker '/tmp/pip-build-tracker-sop76ve_'
2025-06-08T19:18:45,463 Created temporary directory: /tmp/pip-unpack-a8l6w11a
2025-06-08T19:18:45,464 Created temporary directory: /tmp/pip-unpack-y39vwdz9
2025-06-08T19:18:45,465 Building wheels for collected packages: deepspeed
2025-06-08T19:18:45,469   Created temporary directory: /tmp/pip-wheel-adryghtv
2025-06-08T19:18:45,470   DEPRECATION: Building 'deepspeed' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'deepspeed'. Discussion can be found at https://github.com/pypa/pip/issues/6334
2025-06-08T19:18:45,471   Building wheel for deepspeed (setup.py): started
2025-06-08T19:18:45,472   Destination directory: /tmp/pip-wheel-adryghtv
2025-06-08T19:18:45,472   Running command python setup.py bdist_wheel
2025-06-08T19:18:45,968   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2025-06-08T19:18:45,971    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2025-06-08T19:18:46,109   DS_BUILD_OPS=0
2025-06-08T19:18:46,243   Install Ops={'deepspeed_not_implemented': False, 'async_io': False, 'deepspeed_ccl_comm': False, 'deepspeed_shm_comm': False, 'cpu_adam': False, 'fused_adam': False}
2025-06-08T19:18:46,266   fatal: not a git repository (or any of the parent directories): .git
2025-06-08T19:18:46,268   version=0.16.9, git_hash=unknown, git_branch=unknown
2025-06-08T19:18:46,269   install_requires=['einops', 'hjson', 'msgpack', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic>=2.0.0', 'torch', 'tqdm']
2025-06-08T19:18:46,269   ext_modules=[]
2025-06-08T19:18:46,696   running bdist_wheel
2025-06-08T19:18:46,842   running build
2025-06-08T19:18:46,843   running build_py
2025-06-08T19:18:46,874   creating build/lib/deepspeed
2025-06-08T19:18:46,876   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2025-06-08T19:18:46,878   copying deepspeed/env_report.py -> build/lib/deepspeed
2025-06-08T19:18:46,881   copying deepspeed/__init__.py -> build/lib/deepspeed
2025-06-08T19:18:46,883   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2025-06-08T19:18:46,885   copying deepspeed/constants.py -> build/lib/deepspeed
2025-06-08T19:18:46,888   creating build/lib/deepspeed/pipe
2025-06-08T19:18:46,889   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2025-06-08T19:18:46,892   creating build/lib/deepspeed/utils
2025-06-08T19:18:46,893   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,895   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,898   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,900   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,902   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,904   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,906   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,908   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,911   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,913   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,915   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,917   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,919   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,921   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,924   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,926   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,928   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,931   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2025-06-08T19:18:46,934   creating build/lib/deepspeed/sequence
2025-06-08T19:18:46,935   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2025-06-08T19:18:46,938   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2025-06-08T19:18:46,940   copying deepspeed/sequence/fpdt_layer.py -> build/lib/deepspeed/sequence
2025-06-08T19:18:46,943   copying deepspeed/sequence/cross_entropy.py -> build/lib/deepspeed/sequence
2025-06-08T19:18:46,946   creating build/lib/deepspeed/monitor
2025-06-08T19:18:46,947   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,949   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,951   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,953   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,956   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,958   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,960   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,962   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2025-06-08T19:18:46,965   creating build/lib/deepspeed/module_inject
2025-06-08T19:18:46,966   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,968   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,970   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,973   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,976   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,979   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,981   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,983   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,986   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,989   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,992   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,994   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,996   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2025-06-08T19:18:46,999   creating build/lib/deepspeed/autotuning
2025-06-08T19:18:47,001   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,003   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,006   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,008   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,010   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,013   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2025-06-08T19:18:47,017   creating build/lib/deepspeed/nvme
2025-06-08T19:18:47,019   copying deepspeed/nvme/ds_aio_args.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,022   copying deepspeed/nvme/ds_aio_basic.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,024   copying deepspeed/nvme/ds_aio_handle.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,027   copying deepspeed/nvme/perf_sweep_utils.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,029   copying deepspeed/nvme/perf_run_sweep.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,033   copying deepspeed/nvme/ds_aio_job.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,035   copying deepspeed/nvme/__init__.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,038   copying deepspeed/nvme/validate_async_io.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,040   copying deepspeed/nvme/parse_nvme_stats.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,043   copying deepspeed/nvme/test_ds_aio_utils.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,046   copying deepspeed/nvme/perf_generate_param.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,048   copying deepspeed/nvme/test_ds_aio.py -> build/lib/deepspeed/nvme
2025-06-08T19:18:47,052   creating build/lib/deepspeed/compile
2025-06-08T19:18:47,053   copying deepspeed/compile/backend.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,056   copying deepspeed/compile/init_z3.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,059   copying deepspeed/compile/fx.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,062   copying deepspeed/compile/partitioner.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,065   copying deepspeed/compile/list_schedule.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,068   copying deepspeed/compile/__init__.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,071   copying deepspeed/compile/patch_compiled_func.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,073   copying deepspeed/compile/config.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,076   copying deepspeed/compile/inductor.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,079   copying deepspeed/compile/util.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,082   copying deepspeed/compile/patch_fake_tensor.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,084   copying deepspeed/compile/graph_param.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,087   copying deepspeed/compile/init_z1.py -> build/lib/deepspeed/compile
2025-06-08T19:18:47,090   creating build/lib/deepspeed/model_implementations
2025-06-08T19:18:47,091   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2025-06-08T19:18:47,095   creating build/lib/deepspeed/elasticity
2025-06-08T19:18:47,096   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,099   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,101   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,104   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,107   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,110   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2025-06-08T19:18:47,114   creating build/lib/deepspeed/linear
2025-06-08T19:18:47,115   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2025-06-08T19:18:47,118   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2025-06-08T19:18:47,121   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2025-06-08T19:18:47,124   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2025-06-08T19:18:47,127   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2025-06-08T19:18:47,130   creating build/lib/deepspeed/compression
2025-06-08T19:18:47,131   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,134   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,137   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,140   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,143   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,146   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,149   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,152   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2025-06-08T19:18:47,155   creating build/lib/deepspeed/moe
2025-06-08T19:18:47,157   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,160   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,162   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,165   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,168   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,171   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2025-06-08T19:18:47,174   creating build/lib/deepspeed/inference
2025-06-08T19:18:47,175   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2025-06-08T19:18:47,178   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2025-06-08T19:18:47,181   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2025-06-08T19:18:47,186   creating build/lib/deepspeed/accelerator
2025-06-08T19:18:47,187   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,190   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,193   copying deepspeed/accelerator/mlu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,196   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,199   copying deepspeed/accelerator/sdaa_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,202   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,205   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,208   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,211   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,213   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,216   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2025-06-08T19:18:47,219   creating build/lib/deepspeed/ops
2025-06-08T19:18:47,220   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2025-06-08T19:18:47,223   creating build/lib/deepspeed/nebula
2025-06-08T19:18:47,224   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2025-06-08T19:18:47,226   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2025-06-08T19:18:47,228   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2025-06-08T19:18:47,231   creating build/lib/deepspeed/profiling
2025-06-08T19:18:47,232   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2025-06-08T19:18:47,234   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2025-06-08T19:18:47,237   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2025-06-08T19:18:47,239   creating build/lib/deepspeed/launcher
2025-06-08T19:18:47,241   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,243   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,246   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,249   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,251   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,254   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2025-06-08T19:18:47,257   creating build/lib/deepspeed/runtime
2025-06-08T19:18:47,258   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,260   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,262   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,264   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,268   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,270   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,273   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,276   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,279   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,282   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,289   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,292   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,294   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,297   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,299   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,302   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,304   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,306   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2025-06-08T19:18:47,310   creating build/lib/deepspeed/comm
2025-06-08T19:18:47,311   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,315   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,317   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,319   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,321   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,323   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,325   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,328   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,331   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2025-06-08T19:18:47,334   creating build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,335   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,338   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,341   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,343   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,345   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,347   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,350   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,353   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,355   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,358   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2025-06-08T19:18:47,361   creating build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,362   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,364   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,367   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,369   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,371   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,374   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,377   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,379   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,381   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,384   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,387   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,389   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,392   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,394   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,397   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,400   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,403   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,406   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,408   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2025-06-08T19:18:47,412   creating build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,413   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,416   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,418   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,421   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,423   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,426   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,429   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2025-06-08T19:18:47,433   creating build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,434   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,437   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,439   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,441   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,443   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,445   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2025-06-08T19:18:47,448   creating build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,449   copying deepspeed/compile/passes/prefetch.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,452   copying deepspeed/compile/passes/__init__.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,454   copying deepspeed/compile/passes/offload_adam_states.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,457   copying deepspeed/compile/passes/offload_parameters.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,460   copying deepspeed/compile/passes/selective_gather.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,462   copying deepspeed/compile/passes/offload_activation.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,464   copying deepspeed/compile/passes/zero3_compile.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,467   copying deepspeed/compile/passes/zero1_compile.py -> build/lib/deepspeed/compile/passes
2025-06-08T19:18:47,470   creating build/lib/deepspeed/compile/profilers
2025-06-08T19:18:47,471   copying deepspeed/compile/profilers/__init__.py -> build/lib/deepspeed/compile/profilers
2025-06-08T19:18:47,473   copying deepspeed/compile/profilers/graph_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-08T19:18:47,476   copying deepspeed/compile/profilers/comm_profile.py -> build/lib/deepspeed/compile/profilers
2025-06-08T19:18:47,479   creating build/lib/deepspeed/model_implementations/features
2025-06-08T19:18:47,480   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2025-06-08T19:18:47,482   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2025-06-08T19:18:47,485   creating build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,487   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,489   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,491   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,493   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,496   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,498   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,501   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,503   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,506   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,508   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2025-06-08T19:18:47,511   creating build/lib/deepspeed/model_implementations/diffusers
2025-06-08T19:18:47,512   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T19:18:47,514   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T19:18:47,517   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2025-06-08T19:18:47,520   creating build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,521   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,523   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,525   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,527   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,530   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,532   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,534   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,537   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,539   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2025-06-08T19:18:47,542   creating build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,543   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,545   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,548   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,550   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,553   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2025-06-08T19:18:47,556   creating build/lib/deepspeed/inference/v2/modules
2025-06-08T19:18:47,558   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T19:18:47,561   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T19:18:47,563   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T19:18:47,566   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2025-06-08T19:18:47,569   creating build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,570   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,573   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,576   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,579   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,581   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,585   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,587   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2025-06-08T19:18:47,591   creating build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,592   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,596   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,598   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,602   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,605   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,608   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,611   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:47,614   creating build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:47,615   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:47,618   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:47,620   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:47,623   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:47,626   creating build/lib/deepspeed/inference/v2/kernels
2025-06-08T19:18:47,627   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-08T19:18:47,629   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2025-06-08T19:18:47,632   creating build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,633   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,636   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,638   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,641   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,643   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,646   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,648   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,651   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:47,654   creating build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,655   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,658   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,660   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,662   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,665   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,667   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,670   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:47,673   creating build/lib/deepspeed/inference/v2/modules/implementations
2025-06-08T19:18:47,674   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2025-06-08T19:18:47,677   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:47,679   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:47,682   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:47,684   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:47,686   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:47,688   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:47,691   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:47,692   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:47,695   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:47,698   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:47,700   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:47,703   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:47,705   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:47,708   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:47,709   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:47,712   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:47,716   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:47,717   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:47,719   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:47,722   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:47,724   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:47,726   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:47,729   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:47,732   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:47,733   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:47,736   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:47,738   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:47,741   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:47,744   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,745   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,748   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,751   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,753   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,755   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,758   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,760   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,762   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,765   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:47,768   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:47,769   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:47,772   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:47,774   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:47,778   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:47,783   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:47,785   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:47,789   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:47,793   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:47,795   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:47,799   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,800   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,803   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,806   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,809   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,812   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,815   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,817   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,820   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,823   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:47,826   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:47,828   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:47,830   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:47,833   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:47,835   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:47,839   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:47,840   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:47,843   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:47,845   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:47,848   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:47,851   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:47,852   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:47,854   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:47,856   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:47,859   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:47,864   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:47,866   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:47,869   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:47,872   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:47,875   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:47,878   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:47,879   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:47,882   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:47,884   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:47,886   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:47,890   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:47,891   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:47,893   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:47,895   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:47,898   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:47,901   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:47,903   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:47,906   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:47,908   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:47,911   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:47,915   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:47,916   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:47,919   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:47,921   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:47,923   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:47,924   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:47,927   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:47,928   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:47,931   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:47,933   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:47,935   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:47,937   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:47,940   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:47,941   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:47,944   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:47,947   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:47,948   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:47,950   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:47,953   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:47,954   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:47,956   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:47,959   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:47,961   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:47,964   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:47,966   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:47,969   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:47,972   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:47,973   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:47,976   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:47,979   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:47,980   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:47,983   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:47,986   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:47,987   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:47,990   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:47,993   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:47,994   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:47,997   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:48,000   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,001   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,003   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,006   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,008   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,010   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:48,014   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:48,015   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:48,018   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:48,240   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:48,242   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:48,245   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:48,249   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:48,252   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:48,256   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:48,257   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:48,260   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:48,263   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:48,264   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:48,266   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:48,269   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:48,272   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:48,273   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:48,276   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:48,278   creating build/lib/deepspeed/ops/aio
2025-06-08T19:18:48,280   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2025-06-08T19:18:48,283   creating build/lib/deepspeed/ops/adagrad
2025-06-08T19:18:48,284   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2025-06-08T19:18:48,286   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2025-06-08T19:18:48,290   creating build/lib/deepspeed/ops/gds
2025-06-08T19:18:48,291   copying deepspeed/ops/gds/__init__.py -> build/lib/deepspeed/ops/gds
2025-06-08T19:18:48,294   creating build/lib/deepspeed/ops/lamb
2025-06-08T19:18:48,295   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2025-06-08T19:18:48,298   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2025-06-08T19:18:48,301   creating build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,302   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,305   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,309   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,311   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,313   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,316   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,319   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2025-06-08T19:18:48,323   creating build/lib/deepspeed/ops/fp_quantizer
2025-06-08T19:18:48,324   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T19:18:48,326   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T19:18:48,329   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T19:18:48,332   copying deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/lib/deepspeed/ops/fp_quantizer
2025-06-08T19:18:48,336   creating build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,337   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,339   copying deepspeed/ops/op_builder/dc.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,342   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,344   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,346   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,349   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,351   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,353   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,356   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,359   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,362   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,365   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,368   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,371   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,373   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,375   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,378   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,381   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,383   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,386   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,388   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,392   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,395   copying deepspeed/ops/op_builder/gds.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,397   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,400   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2025-06-08T19:18:48,402   creating build/lib/deepspeed/ops/transformer
2025-06-08T19:18:48,403   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2025-06-08T19:18:48,406   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2025-06-08T19:18:48,409   creating build/lib/deepspeed/ops/compile
2025-06-08T19:18:48,410   copying deepspeed/ops/compile/__init__.py -> build/lib/deepspeed/ops/compile
2025-06-08T19:18:48,413   creating build/lib/deepspeed/ops/quantizer
2025-06-08T19:18:48,414   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2025-06-08T19:18:48,416   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2025-06-08T19:18:48,419   creating build/lib/deepspeed/ops/lion
2025-06-08T19:18:48,420   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2025-06-08T19:18:48,422   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2025-06-08T19:18:48,425   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2025-06-08T19:18:48,427   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2025-06-08T19:18:48,430   creating build/lib/deepspeed/ops/deepspeed4science
2025-06-08T19:18:48,431   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-08T19:18:48,434   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2025-06-08T19:18:48,437   creating build/lib/deepspeed/ops/adam
2025-06-08T19:18:48,438   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2025-06-08T19:18:48,441   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2025-06-08T19:18:48,443   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2025-06-08T19:18:48,445   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2025-06-08T19:18:48,449   creating build/lib/deepspeed/ops/random_ltd
2025-06-08T19:18:48,450   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2025-06-08T19:18:48,452   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2025-06-08T19:18:48,455   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:48,456   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:48,459   creating build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,461   copying deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,463   copying deepspeed/ops/op_builder/sdaa/__init__.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,466   copying deepspeed/ops/op_builder/sdaa/no_impl.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,468   copying deepspeed/ops/op_builder/sdaa/builder.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,470   copying deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:48,473   creating build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,475   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,477   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,479   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,482   copying deepspeed/ops/op_builder/cpu/async_io.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,484   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,486   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,489   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:48,492   creating build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,493   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,495   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,497   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,499   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,502   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,504   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,506   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,509   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,511   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,514   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:48,517   creating build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,518   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,521   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,523   copying deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,525   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,528   copying deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,530   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,533   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:48,536   creating build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,537   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,540   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,542   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,544   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,547   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,549   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,552   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,554   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,557   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2025-06-08T19:18:48,560   creating build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,562   copying deepspeed/ops/op_builder/mlu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,564   copying deepspeed/ops/op_builder/mlu/__init__.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,567   copying deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,570   copying deepspeed/ops/op_builder/mlu/no_impl.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,572   copying deepspeed/ops/op_builder/mlu/builder.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,575   copying deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:48,578   creating build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,579   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,583   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,586   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,589   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,592   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,594   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,597   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,600   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,603   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,606   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2025-06-08T19:18:48,610   creating build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,611   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,615   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,618   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,620   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,622   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,625   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,628   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,631   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,633   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,636   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:48,640   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,642   copying deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,644   copying deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,646   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,649   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,652   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,655   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,657   copying deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,660   copying deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,662   copying deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,665   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,668   copying deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,670   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,673   copying deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,675   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,678   copying deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,680   copying deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,682   copying deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,685   copying deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,687   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,690   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,692   copying deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,695   copying deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,698   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:48,701   creating build/lib/deepspeed/profiling/flops_profiler
2025-06-08T19:18:48,702   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-08T19:18:48,706   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2025-06-08T19:18:48,709   creating build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,710   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,713   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,716   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,721   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,724   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,727   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2025-06-08T19:18:48,731   creating build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:48,732   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:48,735   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:48,737   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:48,742   creating build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T19:18:48,743   copying deepspeed/runtime/tensor_parallel/tp_manager.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T19:18:48,745   copying deepspeed/runtime/tensor_parallel/__init__.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T19:18:48,748   copying deepspeed/runtime/tensor_parallel/config.py -> build/lib/deepspeed/runtime/tensor_parallel
2025-06-08T19:18:48,750   creating build/lib/deepspeed/runtime/fp16
2025-06-08T19:18:48,752   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T19:18:48,755   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T19:18:48,757   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T19:18:48,760   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2025-06-08T19:18:48,764   creating build/lib/deepspeed/runtime/domino
2025-06-08T19:18:48,765   copying deepspeed/runtime/domino/__init__.py -> build/lib/deepspeed/runtime/domino
2025-06-08T19:18:48,767   copying deepspeed/runtime/domino/transformer.py -> build/lib/deepspeed/runtime/domino
2025-06-08T19:18:48,771   copying deepspeed/runtime/domino/async_linear.py -> build/lib/deepspeed/runtime/domino
2025-06-08T19:18:48,774   creating build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:48,775   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:48,777   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:48,780   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:48,782   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:48,785   creating build/lib/deepspeed/runtime/compression
2025-06-08T19:18:48,786   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2025-06-08T19:18:48,789   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2025-06-08T19:18:48,792   creating build/lib/deepspeed/runtime/data_pipeline
2025-06-08T19:18:48,793   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T19:18:48,795   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T19:18:48,798   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T19:18:48,801   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2025-06-08T19:18:48,805   creating build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,806   copying deepspeed/runtime/zero/offload_states.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,809   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,812   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,814   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,817   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,822   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,825   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,829   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,831   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,835   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,839   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,842   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,845   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,847   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,853   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,855   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,857   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2025-06-08T19:18:48,860   creating build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,862   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,865   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,867   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,870   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,873   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,876   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,879   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,881   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,883   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2025-06-08T19:18:48,887   creating build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,888   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,891   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,893   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,896   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,899   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,902   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2025-06-08T19:18:48,905   creating build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:48,906   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:48,910   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:48,913   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:48,915   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:48,919   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,920   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,923   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,926   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,929   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,932   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,935   copying deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:48,939   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,940   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,942   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,945   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,947   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,950   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:48,953   running egg_info
2025-06-08T19:18:48,984   writing deepspeed.egg-info/PKG-INFO
2025-06-08T19:18:49,019   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2025-06-08T19:18:49,021   writing entry points to deepspeed.egg-info/entry_points.txt
2025-06-08T19:18:49,039   writing requirements to deepspeed.egg-info/requires.txt
2025-06-08T19:18:49,041   writing top-level names to deepspeed.egg-info/top_level.txt
2025-06-08T19:18:49,193   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-08T19:18:49,254   reading manifest template 'MANIFEST.in'
2025-06-08T19:18:49,256   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2025-06-08T19:18:49,257   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2025-06-08T19:18:51,237   warning: no files found matching '*.hip' under directory 'deepspeed'
2025-06-08T19:18:52,879   warning: no files found matching '*.cc' under directory 'deepspeed'
2025-06-08T19:18:53,694   warning: no files found matching '*.tr' under directory 'csrc'
2025-06-08T19:18:53,866   warning: no files found matching '*.cc' under directory 'csrc'
2025-06-08T19:18:53,934   warning: no files found matching '*.py' under directory 'benchmarks'
2025-06-08T19:18:53,942   adding license file 'LICENSE'
2025-06-08T19:18:54,000   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2025-06-08T19:18:54,009   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2025-06-08T19:18:54,009   !!

2025-06-08T19:18:54,010           ********************************************************************************
2025-06-08T19:18:54,011           ############################
2025-06-08T19:18:54,011           # Package would be ignored #
2025-06-08T19:18:54,012           ############################
2025-06-08T19:18:54,012           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2025-06-08T19:18:54,013           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,014           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,014           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2025-06-08T19:18:54,015           to the `packages` configuration field.

2025-06-08T19:18:54,016           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,016           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,017           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,018           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,019           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,020           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2025-06-08T19:18:54,020           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2025-06-08T19:18:54,021           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,021           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,022           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,022           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,023           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,025           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,025                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,025                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,026                 directory, all directories are treated like packages.
2025-06-08T19:18:54,026           ********************************************************************************

2025-06-08T19:18:54,027   !!
2025-06-08T19:18:54,027     check.warn(importable)
2025-06-08T19:18:54,028   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2025-06-08T19:18:54,028   !!

2025-06-08T19:18:54,029           ********************************************************************************
2025-06-08T19:18:54,030           ############################
2025-06-08T19:18:54,030           # Package would be ignored #
2025-06-08T19:18:54,031           ############################
2025-06-08T19:18:54,031           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2025-06-08T19:18:54,032           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,033           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,033           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2025-06-08T19:18:54,034           to the `packages` configuration field.

2025-06-08T19:18:54,034           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,035           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,035           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,036           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,037           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,038           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2025-06-08T19:18:54,038           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2025-06-08T19:18:54,039           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,039           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,040           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,041           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,042           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,044           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,045                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,045                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,045                 directory, all directories are treated like packages.
2025-06-08T19:18:54,046           ********************************************************************************

2025-06-08T19:18:54,047   !!
2025-06-08T19:18:54,047     check.warn(importable)
2025-06-08T19:18:54,048   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2025-06-08T19:18:54,048   !!

2025-06-08T19:18:54,049           ********************************************************************************
2025-06-08T19:18:54,050           ############################
2025-06-08T19:18:54,050           # Package would be ignored #
2025-06-08T19:18:54,051           ############################
2025-06-08T19:18:54,051           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2025-06-08T19:18:54,051           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,052           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,053           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2025-06-08T19:18:54,053           to the `packages` configuration field.

2025-06-08T19:18:54,054           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,055           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,055           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,056           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,057           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,058           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2025-06-08T19:18:54,059           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2025-06-08T19:18:54,059           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,060           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,060           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,061           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,063           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,064           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,065                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,065                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,066                 directory, all directories are treated like packages.
2025-06-08T19:18:54,066           ********************************************************************************

2025-06-08T19:18:54,067   !!
2025-06-08T19:18:54,068     check.warn(importable)
2025-06-08T19:18:54,068   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,069   !!

2025-06-08T19:18:54,070           ********************************************************************************
2025-06-08T19:18:54,070           ############################
2025-06-08T19:18:54,071           # Package would be ignored #
2025-06-08T19:18:54,071           ############################
2025-06-08T19:18:54,072           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2025-06-08T19:18:54,072           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,073           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,073           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2025-06-08T19:18:54,074           to the `packages` configuration field.

2025-06-08T19:18:54,075           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,075           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,076           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,076           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,077           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,078           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2025-06-08T19:18:54,079           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2025-06-08T19:18:54,079           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,080           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,080           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,081           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,082           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,084           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,084                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,085                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,085                 directory, all directories are treated like packages.
2025-06-08T19:18:54,086           ********************************************************************************

2025-06-08T19:18:54,086   !!
2025-06-08T19:18:54,087     check.warn(importable)
2025-06-08T19:18:54,087   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,088   !!

2025-06-08T19:18:54,089           ********************************************************************************
2025-06-08T19:18:54,089           ############################
2025-06-08T19:18:54,090           # Package would be ignored #
2025-06-08T19:18:54,091           ############################
2025-06-08T19:18:54,091           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2025-06-08T19:18:54,092           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,093           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,093           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2025-06-08T19:18:54,094           to the `packages` configuration field.

2025-06-08T19:18:54,095           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,095           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,096           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,097           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,098           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,099           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2025-06-08T19:18:54,100           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2025-06-08T19:18:54,100           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,101           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,101           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,102           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,104           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,105           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,106                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,106                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,106                 directory, all directories are treated like packages.
2025-06-08T19:18:54,107           ********************************************************************************

2025-06-08T19:18:54,108   !!
2025-06-08T19:18:54,108     check.warn(importable)
2025-06-08T19:18:54,109   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2025-06-08T19:18:54,109   !!

2025-06-08T19:18:54,110           ********************************************************************************
2025-06-08T19:18:54,111           ############################
2025-06-08T19:18:54,111           # Package would be ignored #
2025-06-08T19:18:54,112           ############################
2025-06-08T19:18:54,112           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2025-06-08T19:18:54,113           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,114           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,114           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2025-06-08T19:18:54,115           to the `packages` configuration field.

2025-06-08T19:18:54,116           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,116           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,117           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,118           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,119           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,120           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2025-06-08T19:18:54,121           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2025-06-08T19:18:54,121           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,122           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,122           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,123           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,124           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,126           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,126                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,127                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,127                 directory, all directories are treated like packages.
2025-06-08T19:18:54,128           ********************************************************************************

2025-06-08T19:18:54,129   !!
2025-06-08T19:18:54,129     check.warn(importable)
2025-06-08T19:18:54,130   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2025-06-08T19:18:54,130   !!

2025-06-08T19:18:54,131           ********************************************************************************
2025-06-08T19:18:54,131           ############################
2025-06-08T19:18:54,132           # Package would be ignored #
2025-06-08T19:18:54,132           ############################
2025-06-08T19:18:54,133           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2025-06-08T19:18:54,133           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,134           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,134           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2025-06-08T19:18:54,135           to the `packages` configuration field.

2025-06-08T19:18:54,136           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,136           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,137           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,137           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,138           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,139           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2025-06-08T19:18:54,140           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2025-06-08T19:18:54,140           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,141           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,141           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,142           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,143           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,145           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,145                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,146                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,146                 directory, all directories are treated like packages.
2025-06-08T19:18:54,147           ********************************************************************************

2025-06-08T19:18:54,148   !!
2025-06-08T19:18:54,149     check.warn(importable)
2025-06-08T19:18:54,149   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,150   !!

2025-06-08T19:18:54,151           ********************************************************************************
2025-06-08T19:18:54,151           ############################
2025-06-08T19:18:54,152           # Package would be ignored #
2025-06-08T19:18:54,152           ############################
2025-06-08T19:18:54,153           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2025-06-08T19:18:54,153           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,155           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,155           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2025-06-08T19:18:54,156           to the `packages` configuration field.

2025-06-08T19:18:54,157           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,157           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,158           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,158           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,159           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,160           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2025-06-08T19:18:54,161           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2025-06-08T19:18:54,161           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,162           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,162           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,163           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,164           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,165           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,166                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,166                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,167                 directory, all directories are treated like packages.
2025-06-08T19:18:54,167           ********************************************************************************

2025-06-08T19:18:54,168   !!
2025-06-08T19:18:54,169     check.warn(importable)
2025-06-08T19:18:54,169   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2025-06-08T19:18:54,170   !!

2025-06-08T19:18:54,171           ********************************************************************************
2025-06-08T19:18:54,171           ############################
2025-06-08T19:18:54,172           # Package would be ignored #
2025-06-08T19:18:54,172           ############################
2025-06-08T19:18:54,173           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2025-06-08T19:18:54,173           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,174           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,175           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2025-06-08T19:18:54,175           to the `packages` configuration field.

2025-06-08T19:18:54,176           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,177           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,177           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,178           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,185           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,186           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2025-06-08T19:18:54,187           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2025-06-08T19:18:54,187           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,188           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,188           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,189           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,190           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,192           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,192                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,193                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,193                 directory, all directories are treated like packages.
2025-06-08T19:18:54,194           ********************************************************************************

2025-06-08T19:18:54,194   !!
2025-06-08T19:18:54,195     check.warn(importable)
2025-06-08T19:18:54,195   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2025-06-08T19:18:54,196   !!

2025-06-08T19:18:54,197           ********************************************************************************
2025-06-08T19:18:54,197           ############################
2025-06-08T19:18:54,198           # Package would be ignored #
2025-06-08T19:18:54,198           ############################
2025-06-08T19:18:54,199           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2025-06-08T19:18:54,199           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,200           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,201           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2025-06-08T19:18:54,201           to the `packages` configuration field.

2025-06-08T19:18:54,202           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,203           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,203           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,204           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,205           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,206           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2025-06-08T19:18:54,207           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2025-06-08T19:18:54,207           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,208           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,209           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,210           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,211           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,212           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,213                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,213                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,214                 directory, all directories are treated like packages.
2025-06-08T19:18:54,214           ********************************************************************************

2025-06-08T19:18:54,215   !!
2025-06-08T19:18:54,216     check.warn(importable)
2025-06-08T19:18:54,216   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2025-06-08T19:18:54,217   !!

2025-06-08T19:18:54,218           ********************************************************************************
2025-06-08T19:18:54,219           ############################
2025-06-08T19:18:54,219           # Package would be ignored #
2025-06-08T19:18:54,220           ############################
2025-06-08T19:18:54,220           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2025-06-08T19:18:54,221           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,222           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,222           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2025-06-08T19:18:54,223           to the `packages` configuration field.

2025-06-08T19:18:54,223           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,224           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,224           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,225           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,226           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,227           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2025-06-08T19:18:54,228           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2025-06-08T19:18:54,228           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,229           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,229           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,230           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,231           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,232           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,233                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,234                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,234                 directory, all directories are treated like packages.
2025-06-08T19:18:54,235           ********************************************************************************

2025-06-08T19:18:54,236   !!
2025-06-08T19:18:54,236     check.warn(importable)
2025-06-08T19:18:54,237   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2025-06-08T19:18:54,238   !!

2025-06-08T19:18:54,239           ********************************************************************************
2025-06-08T19:18:54,239           ############################
2025-06-08T19:18:54,240           # Package would be ignored #
2025-06-08T19:18:54,240           ############################
2025-06-08T19:18:54,241           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2025-06-08T19:18:54,241           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,242           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,243           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2025-06-08T19:18:54,243           to the `packages` configuration field.

2025-06-08T19:18:54,245           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,245           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,246           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,247           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,248           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,249           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2025-06-08T19:18:54,249           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2025-06-08T19:18:54,250           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,251           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,251           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,252           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,253           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,254           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,254                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,255                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,255                 directory, all directories are treated like packages.
2025-06-08T19:18:54,256           ********************************************************************************

2025-06-08T19:18:54,257   !!
2025-06-08T19:18:54,257     check.warn(importable)
2025-06-08T19:18:54,257   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2025-06-08T19:18:54,258   !!

2025-06-08T19:18:54,259           ********************************************************************************
2025-06-08T19:18:54,259           ############################
2025-06-08T19:18:54,260           # Package would be ignored #
2025-06-08T19:18:54,260           ############################
2025-06-08T19:18:54,261           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2025-06-08T19:18:54,261           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,262           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,263           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2025-06-08T19:18:54,263           to the `packages` configuration field.

2025-06-08T19:18:54,264           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,265           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,265           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,267           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,268           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,269           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2025-06-08T19:18:54,269           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2025-06-08T19:18:54,270           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,271           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,271           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,272           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,273           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,275           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,275                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,276                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,276                 directory, all directories are treated like packages.
2025-06-08T19:18:54,277           ********************************************************************************

2025-06-08T19:18:54,278   !!
2025-06-08T19:18:54,279     check.warn(importable)
2025-06-08T19:18:54,279   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.compile' is absent from the `packages` configuration.
2025-06-08T19:18:54,280   !!

2025-06-08T19:18:54,281           ********************************************************************************
2025-06-08T19:18:54,281           ############################
2025-06-08T19:18:54,282           # Package would be ignored #
2025-06-08T19:18:54,282           ############################
2025-06-08T19:18:54,283           Python recognizes 'deepspeed.ops.csrc.compile' as an importable package[^1],
2025-06-08T19:18:54,283           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,284           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,284           package, please make sure that 'deepspeed.ops.csrc.compile' is explicitly added
2025-06-08T19:18:54,285           to the `packages` configuration field.

2025-06-08T19:18:54,286           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,286           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,287           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,288           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,289           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,290           If you don't want 'deepspeed.ops.csrc.compile' to be distributed and are
2025-06-08T19:18:54,290           already explicitly excluding 'deepspeed.ops.csrc.compile' via
2025-06-08T19:18:54,291           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,291           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,292           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,293           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,294           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,295           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,296                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,296                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,297                 directory, all directories are treated like packages.
2025-06-08T19:18:54,298           ********************************************************************************

2025-06-08T19:18:54,299   !!
2025-06-08T19:18:54,299     check.warn(importable)
2025-06-08T19:18:54,300   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2025-06-08T19:18:54,300   !!

2025-06-08T19:18:54,301           ********************************************************************************
2025-06-08T19:18:54,302           ############################
2025-06-08T19:18:54,302           # Package would be ignored #
2025-06-08T19:18:54,303           ############################
2025-06-08T19:18:54,303           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2025-06-08T19:18:54,304           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,305           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,306           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2025-06-08T19:18:54,306           to the `packages` configuration field.

2025-06-08T19:18:54,307           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,308           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,308           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,310           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,310           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,311           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2025-06-08T19:18:54,312           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2025-06-08T19:18:54,312           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,313           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,313           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,314           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,315           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,316           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,317                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,317                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,318                 directory, all directories are treated like packages.
2025-06-08T19:18:54,318           ********************************************************************************

2025-06-08T19:18:54,319   !!
2025-06-08T19:18:54,320     check.warn(importable)
2025-06-08T19:18:54,320   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2025-06-08T19:18:54,321   !!

2025-06-08T19:18:54,322           ********************************************************************************
2025-06-08T19:18:54,322           ############################
2025-06-08T19:18:54,323           # Package would be ignored #
2025-06-08T19:18:54,323           ############################
2025-06-08T19:18:54,324           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2025-06-08T19:18:54,324           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,325           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,326           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2025-06-08T19:18:54,326           to the `packages` configuration field.

2025-06-08T19:18:54,327           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,328           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,328           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,329           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,331           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,332           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2025-06-08T19:18:54,332           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2025-06-08T19:18:54,333           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,333           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,334           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,335           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,336           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,337           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,338                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,338                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,339                 directory, all directories are treated like packages.
2025-06-08T19:18:54,339           ********************************************************************************

2025-06-08T19:18:54,340   !!
2025-06-08T19:18:54,340     check.warn(importable)
2025-06-08T19:18:54,341   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2025-06-08T19:18:54,341   !!

2025-06-08T19:18:54,342           ********************************************************************************
2025-06-08T19:18:54,343           ############################
2025-06-08T19:18:54,343           # Package would be ignored #
2025-06-08T19:18:54,343           ############################
2025-06-08T19:18:54,344           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2025-06-08T19:18:54,344           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,345           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,346           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2025-06-08T19:18:54,348           to the `packages` configuration field.

2025-06-08T19:18:54,349           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,350           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,350           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,351           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,352           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,353           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2025-06-08T19:18:54,354           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2025-06-08T19:18:54,354           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,355           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,355           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,356           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,357           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,359           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,359                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,360                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,360                 directory, all directories are treated like packages.
2025-06-08T19:18:54,361           ********************************************************************************

2025-06-08T19:18:54,362   !!
2025-06-08T19:18:54,362     check.warn(importable)
2025-06-08T19:18:54,363   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2025-06-08T19:18:54,363   !!

2025-06-08T19:18:54,365           ********************************************************************************
2025-06-08T19:18:54,365           ############################
2025-06-08T19:18:54,366           # Package would be ignored #
2025-06-08T19:18:54,366           ############################
2025-06-08T19:18:54,367           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2025-06-08T19:18:54,367           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,368           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,369           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2025-06-08T19:18:54,369           to the `packages` configuration field.

2025-06-08T19:18:54,370           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,371           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,371           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,372           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,373           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,374           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2025-06-08T19:18:54,374           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2025-06-08T19:18:54,375           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,375           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,376           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,377           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,378           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,379           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,380                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,380                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,381                 directory, all directories are treated like packages.
2025-06-08T19:18:54,381           ********************************************************************************

2025-06-08T19:18:54,382   !!
2025-06-08T19:18:54,383     check.warn(importable)
2025-06-08T19:18:54,384   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2025-06-08T19:18:54,384   !!

2025-06-08T19:18:54,385           ********************************************************************************
2025-06-08T19:18:54,386           ############################
2025-06-08T19:18:54,386           # Package would be ignored #
2025-06-08T19:18:54,387           ############################
2025-06-08T19:18:54,387           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2025-06-08T19:18:54,388           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,389           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,389           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2025-06-08T19:18:54,390           to the `packages` configuration field.

2025-06-08T19:18:54,391           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,391           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,392           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,393           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,394           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,395           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2025-06-08T19:18:54,395           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2025-06-08T19:18:54,395           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,396           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,397           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,397           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,398           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,400           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,400                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,400                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,401                 directory, all directories are treated like packages.
2025-06-08T19:18:54,401           ********************************************************************************

2025-06-08T19:18:54,402   !!
2025-06-08T19:18:54,403     check.warn(importable)
2025-06-08T19:18:54,403   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2025-06-08T19:18:54,403   !!

2025-06-08T19:18:54,404           ********************************************************************************
2025-06-08T19:18:54,405           ############################
2025-06-08T19:18:54,405           # Package would be ignored #
2025-06-08T19:18:54,406           ############################
2025-06-08T19:18:54,406           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2025-06-08T19:18:54,407           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,408           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,408           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2025-06-08T19:18:54,409           to the `packages` configuration field.

2025-06-08T19:18:54,410           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,410           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,410           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,411           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,412           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,413           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2025-06-08T19:18:54,414           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2025-06-08T19:18:54,414           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,415           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,415           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,416           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,417           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,419           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,419                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,420                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,420                 directory, all directories are treated like packages.
2025-06-08T19:18:54,421           ********************************************************************************

2025-06-08T19:18:54,422   !!
2025-06-08T19:18:54,422     check.warn(importable)
2025-06-08T19:18:54,423   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2025-06-08T19:18:54,423   !!

2025-06-08T19:18:54,424           ********************************************************************************
2025-06-08T19:18:54,425           ############################
2025-06-08T19:18:54,425           # Package would be ignored #
2025-06-08T19:18:54,426           ############################
2025-06-08T19:18:54,426           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2025-06-08T19:18:54,427           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,427           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,428           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2025-06-08T19:18:54,428           to the `packages` configuration field.

2025-06-08T19:18:54,429           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,430           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,430           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,431           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,432           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,433           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2025-06-08T19:18:54,433           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2025-06-08T19:18:54,434           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,434           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,435           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,435           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,436           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,438           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,438                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,439                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,439                 directory, all directories are treated like packages.
2025-06-08T19:18:54,440           ********************************************************************************

2025-06-08T19:18:54,441   !!
2025-06-08T19:18:54,441     check.warn(importable)
2025-06-08T19:18:54,442   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2025-06-08T19:18:54,442   !!

2025-06-08T19:18:54,443           ********************************************************************************
2025-06-08T19:18:54,444           ############################
2025-06-08T19:18:54,444           # Package would be ignored #
2025-06-08T19:18:54,445           ############################
2025-06-08T19:18:54,445           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2025-06-08T19:18:54,446           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,447           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,447           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2025-06-08T19:18:54,448           to the `packages` configuration field.

2025-06-08T19:18:54,449           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,449           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,450           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,450           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,451           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,452           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2025-06-08T19:18:54,452           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2025-06-08T19:18:54,453           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,453           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,454           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,454           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,455           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,457           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,457                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,457                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,458                 directory, all directories are treated like packages.
2025-06-08T19:18:54,458           ********************************************************************************

2025-06-08T19:18:54,459   !!
2025-06-08T19:18:54,460     check.warn(importable)
2025-06-08T19:18:54,460   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2025-06-08T19:18:54,461   !!

2025-06-08T19:18:54,462           ********************************************************************************
2025-06-08T19:18:54,462           ############################
2025-06-08T19:18:54,463           # Package would be ignored #
2025-06-08T19:18:54,463           ############################
2025-06-08T19:18:54,463           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2025-06-08T19:18:54,464           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,465           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,465           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2025-06-08T19:18:54,466           to the `packages` configuration field.

2025-06-08T19:18:54,467           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,467           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,468           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,469           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,470           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,471           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2025-06-08T19:18:54,472           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2025-06-08T19:18:54,472           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,473           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,473           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,474           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,475           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,477           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,477                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,477                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,478                 directory, all directories are treated like packages.
2025-06-08T19:18:54,478           ********************************************************************************

2025-06-08T19:18:54,479   !!
2025-06-08T19:18:54,480     check.warn(importable)
2025-06-08T19:18:54,480   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,480   !!

2025-06-08T19:18:54,481           ********************************************************************************
2025-06-08T19:18:54,482           ############################
2025-06-08T19:18:54,482           # Package would be ignored #
2025-06-08T19:18:54,483           ############################
2025-06-08T19:18:54,483           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2025-06-08T19:18:54,484           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,484           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,485           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2025-06-08T19:18:54,485           to the `packages` configuration field.

2025-06-08T19:18:54,486           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,487           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,487           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,488           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,489           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,490           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2025-06-08T19:18:54,491           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2025-06-08T19:18:54,491           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,492           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,492           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,493           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,494           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,496           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,496                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,497                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,497                 directory, all directories are treated like packages.
2025-06-08T19:18:54,498           ********************************************************************************

2025-06-08T19:18:54,499   !!
2025-06-08T19:18:54,499     check.warn(importable)
2025-06-08T19:18:54,500   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.gds.py_lib' is absent from the `packages` configuration.
2025-06-08T19:18:54,500   !!

2025-06-08T19:18:54,502           ********************************************************************************
2025-06-08T19:18:54,502           ############################
2025-06-08T19:18:54,503           # Package would be ignored #
2025-06-08T19:18:54,504           ############################
2025-06-08T19:18:54,504           Python recognizes 'deepspeed.ops.csrc.gds.py_lib' as an importable package[^1],
2025-06-08T19:18:54,504           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,505           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,506           package, please make sure that 'deepspeed.ops.csrc.gds.py_lib' is explicitly added
2025-06-08T19:18:54,506           to the `packages` configuration field.

2025-06-08T19:18:54,507           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,508           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,508           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,509           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,510           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,511           If you don't want 'deepspeed.ops.csrc.gds.py_lib' to be distributed and are
2025-06-08T19:18:54,511           already explicitly excluding 'deepspeed.ops.csrc.gds.py_lib' via
2025-06-08T19:18:54,512           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,512           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,513           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,514           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,515           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,516           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,516                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,517                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,517                 directory, all directories are treated like packages.
2025-06-08T19:18:54,518           ********************************************************************************

2025-06-08T19:18:54,519   !!
2025-06-08T19:18:54,519     check.warn(importable)
2025-06-08T19:18:54,520   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,520   !!

2025-06-08T19:18:54,521           ********************************************************************************
2025-06-08T19:18:54,522           ############################
2025-06-08T19:18:54,523           # Package would be ignored #
2025-06-08T19:18:54,523           ############################
2025-06-08T19:18:54,524           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2025-06-08T19:18:54,524           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,526           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,526           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2025-06-08T19:18:54,527           to the `packages` configuration field.

2025-06-08T19:18:54,528           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,529           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,529           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,530           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,531           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,532           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2025-06-08T19:18:54,533           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2025-06-08T19:18:54,534           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,534           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,535           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,535           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,536           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,538           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,538                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,539                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,539                 directory, all directories are treated like packages.
2025-06-08T19:18:54,540           ********************************************************************************

2025-06-08T19:18:54,541   !!
2025-06-08T19:18:54,541     check.warn(importable)
2025-06-08T19:18:54,541   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2025-06-08T19:18:54,542   !!

2025-06-08T19:18:54,543           ********************************************************************************
2025-06-08T19:18:54,543           ############################
2025-06-08T19:18:54,544           # Package would be ignored #
2025-06-08T19:18:54,544           ############################
2025-06-08T19:18:54,545           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2025-06-08T19:18:54,545           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,546           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,547           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2025-06-08T19:18:54,547           to the `packages` configuration field.

2025-06-08T19:18:54,548           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,549           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,549           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,550           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,552           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,553           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2025-06-08T19:18:54,553           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2025-06-08T19:18:54,554           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,554           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,555           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,556           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,557           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,559           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,559                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,560                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,560                 directory, all directories are treated like packages.
2025-06-08T19:18:54,561           ********************************************************************************

2025-06-08T19:18:54,562   !!
2025-06-08T19:18:54,562     check.warn(importable)
2025-06-08T19:18:54,563   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2025-06-08T19:18:54,564   !!

2025-06-08T19:18:54,565           ********************************************************************************
2025-06-08T19:18:54,565           ############################
2025-06-08T19:18:54,566           # Package would be ignored #
2025-06-08T19:18:54,566           ############################
2025-06-08T19:18:54,567           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2025-06-08T19:18:54,567           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,568           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,568           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2025-06-08T19:18:54,569           to the `packages` configuration field.

2025-06-08T19:18:54,570           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,570           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,571           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,572           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,573           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,574           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2025-06-08T19:18:54,574           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2025-06-08T19:18:54,575           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,575           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,576           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,577           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,578           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,580           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,580                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,581                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,581                 directory, all directories are treated like packages.
2025-06-08T19:18:54,582           ********************************************************************************

2025-06-08T19:18:54,583   !!
2025-06-08T19:18:54,584     check.warn(importable)
2025-06-08T19:18:54,584   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2025-06-08T19:18:54,585   !!

2025-06-08T19:18:54,586           ********************************************************************************
2025-06-08T19:18:54,587           ############################
2025-06-08T19:18:54,587           # Package would be ignored #
2025-06-08T19:18:54,588           ############################
2025-06-08T19:18:54,588           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2025-06-08T19:18:54,589           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,590           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,591           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2025-06-08T19:18:54,591           to the `packages` configuration field.

2025-06-08T19:18:54,592           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,593           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,593           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,595           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,596           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,596           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2025-06-08T19:18:54,597           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2025-06-08T19:18:54,597           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,598           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,598           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,599           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,600           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,602           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,603                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,603                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,604                 directory, all directories are treated like packages.
2025-06-08T19:18:54,604           ********************************************************************************

2025-06-08T19:18:54,605   !!
2025-06-08T19:18:54,606     check.warn(importable)
2025-06-08T19:18:54,607   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2025-06-08T19:18:54,607   !!

2025-06-08T19:18:54,608           ********************************************************************************
2025-06-08T19:18:54,609           ############################
2025-06-08T19:18:54,609           # Package would be ignored #
2025-06-08T19:18:54,610           ############################
2025-06-08T19:18:54,610           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2025-06-08T19:18:54,611           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,612           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,612           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2025-06-08T19:18:54,613           to the `packages` configuration field.

2025-06-08T19:18:54,614           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,615           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,615           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,616           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,617           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,618           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2025-06-08T19:18:54,619           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2025-06-08T19:18:54,619           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,620           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,621           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,622           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,623           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,624           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,625                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,626                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,627                 directory, all directories are treated like packages.
2025-06-08T19:18:54,627           ********************************************************************************

2025-06-08T19:18:54,628   !!
2025-06-08T19:18:54,629     check.warn(importable)
2025-06-08T19:18:54,629   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2025-06-08T19:18:54,630   !!

2025-06-08T19:18:54,631           ********************************************************************************
2025-06-08T19:18:54,631           ############################
2025-06-08T19:18:54,632           # Package would be ignored #
2025-06-08T19:18:54,632           ############################
2025-06-08T19:18:54,633           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2025-06-08T19:18:54,633           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,634           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,635           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2025-06-08T19:18:54,636           to the `packages` configuration field.

2025-06-08T19:18:54,637           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,637           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,638           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,639           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,641           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2025-06-08T19:18:54,642           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2025-06-08T19:18:54,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,643           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,644           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,645           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,646           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,648           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,648                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,649                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,650                 directory, all directories are treated like packages.
2025-06-08T19:18:54,650           ********************************************************************************

2025-06-08T19:18:54,651   !!
2025-06-08T19:18:54,652     check.warn(importable)
2025-06-08T19:18:54,652   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2025-06-08T19:18:54,653   !!

2025-06-08T19:18:54,654           ********************************************************************************
2025-06-08T19:18:54,655           ############################
2025-06-08T19:18:54,655           # Package would be ignored #
2025-06-08T19:18:54,656           ############################
2025-06-08T19:18:54,657           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2025-06-08T19:18:54,657           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,658           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,659           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2025-06-08T19:18:54,659           to the `packages` configuration field.

2025-06-08T19:18:54,660           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,661           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,661           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,662           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,663           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,664           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2025-06-08T19:18:54,665           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2025-06-08T19:18:54,666           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,666           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,667           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,668           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,669           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,670           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,671                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,671                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,672                 directory, all directories are treated like packages.
2025-06-08T19:18:54,672           ********************************************************************************

2025-06-08T19:18:54,673   !!
2025-06-08T19:18:54,674     check.warn(importable)
2025-06-08T19:18:54,675   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,675   !!

2025-06-08T19:18:54,676           ********************************************************************************
2025-06-08T19:18:54,677           ############################
2025-06-08T19:18:54,677           # Package would be ignored #
2025-06-08T19:18:54,678           ############################
2025-06-08T19:18:54,678           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2025-06-08T19:18:54,679           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,680           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,680           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2025-06-08T19:18:54,681           to the `packages` configuration field.

2025-06-08T19:18:54,682           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,683           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,683           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,684           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,685           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,687           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2025-06-08T19:18:54,687           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2025-06-08T19:18:54,688           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,688           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,689           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,690           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,691           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,693           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,693                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,694                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,694                 directory, all directories are treated like packages.
2025-06-08T19:18:54,695           ********************************************************************************

2025-06-08T19:18:54,696   !!
2025-06-08T19:18:54,696     check.warn(importable)
2025-06-08T19:18:54,697   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2025-06-08T19:18:54,697   !!

2025-06-08T19:18:54,698           ********************************************************************************
2025-06-08T19:18:54,699           ############################
2025-06-08T19:18:54,700           # Package would be ignored #
2025-06-08T19:18:54,700           ############################
2025-06-08T19:18:54,701           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2025-06-08T19:18:54,701           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,702           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,703           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2025-06-08T19:18:54,704           to the `packages` configuration field.

2025-06-08T19:18:54,705           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,705           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,706           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,707           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,710           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2025-06-08T19:18:54,710           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2025-06-08T19:18:54,711           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,711           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,712           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,713           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,714           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,716           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,716                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,717                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,717                 directory, all directories are treated like packages.
2025-06-08T19:18:54,718           ********************************************************************************

2025-06-08T19:18:54,719   !!
2025-06-08T19:18:54,720     check.warn(importable)
2025-06-08T19:18:54,720   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2025-06-08T19:18:54,721   !!

2025-06-08T19:18:54,722           ********************************************************************************
2025-06-08T19:18:54,722           ############################
2025-06-08T19:18:54,723           # Package would be ignored #
2025-06-08T19:18:54,723           ############################
2025-06-08T19:18:54,724           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2025-06-08T19:18:54,724           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,725           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,725           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2025-06-08T19:18:54,726           to the `packages` configuration field.

2025-06-08T19:18:54,727           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,727           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,728           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,729           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,730           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,731           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2025-06-08T19:18:54,732           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2025-06-08T19:18:54,732           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,733           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,734           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,735           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,736           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,737           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,738                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,738                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,739                 directory, all directories are treated like packages.
2025-06-08T19:18:54,739           ********************************************************************************

2025-06-08T19:18:54,740   !!
2025-06-08T19:18:54,741     check.warn(importable)
2025-06-08T19:18:54,741   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,742   !!

2025-06-08T19:18:54,743           ********************************************************************************
2025-06-08T19:18:54,744           ############################
2025-06-08T19:18:54,744           # Package would be ignored #
2025-06-08T19:18:54,745           ############################
2025-06-08T19:18:54,746           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2025-06-08T19:18:54,746           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,747           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,748           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2025-06-08T19:18:54,749           to the `packages` configuration field.

2025-06-08T19:18:54,750           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,751           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,751           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,753           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,754           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,755           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2025-06-08T19:18:54,755           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2025-06-08T19:18:54,755           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,756           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,757           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,758           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,758           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,760           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,760                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,761                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,761                 directory, all directories are treated like packages.
2025-06-08T19:18:54,762           ********************************************************************************

2025-06-08T19:18:54,763   !!
2025-06-08T19:18:54,764     check.warn(importable)
2025-06-08T19:18:54,765   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2025-06-08T19:18:54,765   !!

2025-06-08T19:18:54,766           ********************************************************************************
2025-06-08T19:18:54,767           ############################
2025-06-08T19:18:54,767           # Package would be ignored #
2025-06-08T19:18:54,768           ############################
2025-06-08T19:18:54,769           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2025-06-08T19:18:54,770           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,771           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,771           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2025-06-08T19:18:54,772           to the `packages` configuration field.

2025-06-08T19:18:54,773           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,773           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,774           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,775           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,776           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,777           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2025-06-08T19:18:54,778           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2025-06-08T19:18:54,778           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,779           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,779           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,781           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,782           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,783           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,784                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,784                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,785                 directory, all directories are treated like packages.
2025-06-08T19:18:54,786           ********************************************************************************

2025-06-08T19:18:54,786   !!
2025-06-08T19:18:54,787     check.warn(importable)
2025-06-08T19:18:54,787   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2025-06-08T19:18:54,788   !!

2025-06-08T19:18:54,789           ********************************************************************************
2025-06-08T19:18:54,789           ############################
2025-06-08T19:18:54,790           # Package would be ignored #
2025-06-08T19:18:54,790           ############################
2025-06-08T19:18:54,791           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2025-06-08T19:18:54,791           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,792           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,793           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2025-06-08T19:18:54,793           to the `packages` configuration field.

2025-06-08T19:18:54,794           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,795           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,796           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,797           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,798           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,799           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2025-06-08T19:18:54,800           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2025-06-08T19:18:54,800           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,801           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,802           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,803           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,804           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,806           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,806                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,807                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,808                 directory, all directories are treated like packages.
2025-06-08T19:18:54,808           ********************************************************************************

2025-06-08T19:18:54,810   !!
2025-06-08T19:18:54,810     check.warn(importable)
2025-06-08T19:18:54,811   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2025-06-08T19:18:54,811   !!

2025-06-08T19:18:54,813           ********************************************************************************
2025-06-08T19:18:54,813           ############################
2025-06-08T19:18:54,814           # Package would be ignored #
2025-06-08T19:18:54,815           ############################
2025-06-08T19:18:54,815           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2025-06-08T19:18:54,816           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,817           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,818           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2025-06-08T19:18:54,818           to the `packages` configuration field.

2025-06-08T19:18:54,819           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,820           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,820           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,821           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,822           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,823           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2025-06-08T19:18:54,824           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2025-06-08T19:18:54,824           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,825           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,825           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,827           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,828           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,829           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,830                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,831                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,831                 directory, all directories are treated like packages.
2025-06-08T19:18:54,832           ********************************************************************************

2025-06-08T19:18:54,833   !!
2025-06-08T19:18:54,833     check.warn(importable)
2025-06-08T19:18:54,834   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2025-06-08T19:18:54,834   !!

2025-06-08T19:18:54,835           ********************************************************************************
2025-06-08T19:18:54,836           ############################
2025-06-08T19:18:54,836           # Package would be ignored #
2025-06-08T19:18:54,837           ############################
2025-06-08T19:18:54,837           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2025-06-08T19:18:54,838           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,839           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,840           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2025-06-08T19:18:54,841           to the `packages` configuration field.

2025-06-08T19:18:54,842           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,842           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,843           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,844           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,845           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,846           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2025-06-08T19:18:54,846           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2025-06-08T19:18:54,847           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,847           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,848           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,849           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,850           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,851           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,852                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,853                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,853                 directory, all directories are treated like packages.
2025-06-08T19:18:54,853           ********************************************************************************

2025-06-08T19:18:54,854   !!
2025-06-08T19:18:54,855     check.warn(importable)
2025-06-08T19:18:54,855   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2025-06-08T19:18:54,856   !!

2025-06-08T19:18:54,857           ********************************************************************************
2025-06-08T19:18:54,857           ############################
2025-06-08T19:18:54,858           # Package would be ignored #
2025-06-08T19:18:54,858           ############################
2025-06-08T19:18:54,859           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2025-06-08T19:18:54,859           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,860           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,861           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2025-06-08T19:18:54,861           to the `packages` configuration field.

2025-06-08T19:18:54,862           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,863           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,863           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,864           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,865           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,866           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2025-06-08T19:18:54,867           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2025-06-08T19:18:54,867           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,868           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,868           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,869           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,870           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,872           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,872                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,873                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,874                 directory, all directories are treated like packages.
2025-06-08T19:18:54,874           ********************************************************************************

2025-06-08T19:18:54,875   !!
2025-06-08T19:18:54,876     check.warn(importable)
2025-06-08T19:18:54,876   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2025-06-08T19:18:54,877   !!

2025-06-08T19:18:54,878           ********************************************************************************
2025-06-08T19:18:54,878           ############################
2025-06-08T19:18:54,879           # Package would be ignored #
2025-06-08T19:18:54,879           ############################
2025-06-08T19:18:54,880           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2025-06-08T19:18:54,880           but it is absent from setuptools' `packages` configuration.

2025-06-08T19:18:54,881           This leads to an ambiguous overall configuration. If you want to distribute this
2025-06-08T19:18:54,882           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2025-06-08T19:18:54,882           to the `packages` configuration field.

2025-06-08T19:18:54,883           Alternatively, you can also rely on setuptools' discovery methods
2025-06-08T19:18:54,883           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2025-06-08T19:18:54,884           instead of `find_packages(...)`/`find:`).

2025-06-08T19:18:54,885           You can read more about "package discovery" on setuptools documentation page:

2025-06-08T19:18:54,886           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2025-06-08T19:18:54,887           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2025-06-08T19:18:54,887           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2025-06-08T19:18:54,888           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2025-06-08T19:18:54,888           you can try to use `exclude_package_data`, or `include-package-data=False` in
2025-06-08T19:18:54,889           combination with a more fine grained `package-data` configuration.

2025-06-08T19:18:54,890           You can read more about "package data files" on setuptools documentation page:

2025-06-08T19:18:54,891           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2025-06-08T19:18:54,892           [^1]: For Python, any directory (with suitable naming) can be imported,
2025-06-08T19:18:54,893                 even if it does not contain any `.py` files.
2025-06-08T19:18:54,893                 On the other hand, currently there is no concept of package data
2025-06-08T19:18:54,894                 directory, all directories are treated like packages.
2025-06-08T19:18:54,894           ********************************************************************************

2025-06-08T19:18:54,895   !!
2025-06-08T19:18:54,896     check.warn(importable)
2025-06-08T19:18:54,896   creating build/lib/deepspeed/autotuning/config_templates
2025-06-08T19:18:54,897   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T19:18:54,897   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T19:18:54,898   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T19:18:54,898   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2025-06-08T19:18:54,899   creating build/lib/deepspeed/ops/csrc/adagrad
2025-06-08T19:18:54,900   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2025-06-08T19:18:54,900   creating build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,901   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,901   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,902   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,903   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,904   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2025-06-08T19:18:54,904   creating build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,905   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,906   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,906   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,907   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,907   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,908   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:54,908   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,909   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,910   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,910   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,911   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,911   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,912   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,913   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,913   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,914   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,916   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,918   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,919   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,920   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,920   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:54,921   creating build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-08T19:18:54,921   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2025-06-08T19:18:54,922   creating build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,923   copying deepspeed/ops/csrc/compile/deepcompile.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,923   copying deepspeed/ops/csrc/compile/init.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,924   copying deepspeed/ops/csrc/compile/util.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,925   copying deepspeed/ops/csrc/compile/z1.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,926   copying deepspeed/ops/csrc/compile/z1.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,926   copying deepspeed/ops/csrc/compile/z3.cpp -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,927   copying deepspeed/ops/csrc/compile/z3.h -> build/lib/deepspeed/ops/csrc/compile
2025-06-08T19:18:54,927   creating build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-08T19:18:54,928   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2025-06-08T19:18:54,929   creating build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:54,929   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:54,930   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:54,931   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:54,931   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:54,932   creating build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-08T19:18:54,932   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2025-06-08T19:18:54,933   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:54,938   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:54,939   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:54,939   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:54,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:54,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:54,942   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,943   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,943   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,946   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:54,946   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,950   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:54,950   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:54,951   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:54,951   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:54,952   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:54,952   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:54,953   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:54,953   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:54,954   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:54,954   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:54,955   creating build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,955   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,956   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,956   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,957   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,958   copying deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,958   copying deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/lib/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:54,959   creating build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,959   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,960   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,960   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,961   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,961   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,962   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,962   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,963   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,963   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,963   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,964   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,965   copying deepspeed/ops/csrc/includes/deepcompile.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,965   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,965   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,966   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,966   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,967   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,967   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,968   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,969   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,969   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,970   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,970   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,972   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,975   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,977   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,981   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,983   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,986   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,988   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2025-06-08T19:18:54,991   creating build/lib/deepspeed/ops/csrc/lamb
2025-06-08T19:18:54,992   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2025-06-08T19:18:54,995   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2025-06-08T19:18:54,998   creating build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:54,999   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:55,002   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:55,005   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:55,007   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:55,010   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2025-06-08T19:18:55,013   creating build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,014   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,016   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,020   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,023   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,027   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,030   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,033   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2025-06-08T19:18:55,036   creating build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:55,037   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:55,040   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:55,043   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:55,046   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:55,049   creating build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-08T19:18:55,050   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2025-06-08T19:18:55,053   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:55,055   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:55,058   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:55,061   creating build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-08T19:18:55,062   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2025-06-08T19:18:55,064   creating build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,066   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,069   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,073   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,077   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,080   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,083   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,087   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,091   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2025-06-08T19:18:55,094   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,095   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,098   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,101   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,104   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,108   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,111   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,115   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,118   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,121   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,124   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:55,127   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:55,129   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:55,132   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:55,135   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:55,138   creating build/lib/deepspeed/ops/csrc/utils
2025-06-08T19:18:55,140   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2025-06-08T19:18:55,142   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T19:18:55,144   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T19:18:55,147   creating build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:55,149   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:55,152   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:55,155   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:55,158   creating build/lib/deepspeed/ops/csrc/xpu/common
2025-06-08T19:18:55,159   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2025-06-08T19:18:55,162   creating build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,163   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,166   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,169   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,172   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,175   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:55,178   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-08T19:18:55,180   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2025-06-08T19:18:55,183   creating build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:55,184   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:55,187   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:55,190   creating build/lib/deepspeed/inference/v2/ragged/includes
2025-06-08T19:18:55,191   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2025-06-08T19:18:55,194   creating build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,195   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,198   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,202   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,204   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,209   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:55,212   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:55,215   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T19:18:55,216   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T19:18:55,219   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:55,220   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:55,223   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:55,226   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:55,229   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:55,232   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:55,235   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T19:18:55,236   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T19:18:55,239   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:55,242   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:55,246   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:55,249   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:55,252   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:55,255   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:55,258   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:55,261   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:55,263   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:55,266   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:55,270   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:55,272   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:55,275   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:55,278   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:55,280   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:55,283   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:55,285   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:55,288   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:55,291   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:55,293   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:55,296   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:55,298   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:55,301   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:55,304   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:55,306   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:55,309   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:55,312   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:55,315   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:55,317   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:55,319   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:55,322   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:55,325   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:55,328   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:55,332   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:55,335   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,336   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,339   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,342   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,345   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,347   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,350   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,353   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,356   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,359   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:55,362   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:55,365   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:55,368   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:55,371   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:55,374   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:55,380   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:55,383   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:55,386   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:55,389   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:55,392   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:55,394   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:55,398   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:55,401   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:55,404   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:55,407   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:55,410   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:55,413   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:55,416   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:55,419   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:55,421   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:55,424   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:55,428   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:55,431   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:55,495   running build_scripts
2025-06-08T19:18:55,496   creating build/scripts-3.11
2025-06-08T19:18:55,497   copying and adjusting bin/deepspeed -> build/scripts-3.11
2025-06-08T19:18:55,499   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2025-06-08T19:18:55,501   copying and adjusting bin/ds -> build/scripts-3.11
2025-06-08T19:18:55,503   copying bin/ds_ssh -> build/scripts-3.11
2025-06-08T19:18:55,506   copying and adjusting bin/ds_report -> build/scripts-3.11
2025-06-08T19:18:55,507   copying and adjusting bin/ds_bench -> build/scripts-3.11
2025-06-08T19:18:55,509   copying and adjusting bin/dsr -> build/scripts-3.11
2025-06-08T19:18:55,511   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2025-06-08T19:18:55,512   copying and adjusting bin/ds_nvme_tune -> build/scripts-3.11
2025-06-08T19:18:55,514   copying and adjusting bin/ds_io -> build/scripts-3.11
2025-06-08T19:18:55,515   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2025-06-08T19:18:55,516   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2025-06-08T19:18:55,516   changing mode of build/scripts-3.11/ds from 644 to 755
2025-06-08T19:18:55,517   changing mode of build/scripts-3.11/ds_report from 644 to 755
2025-06-08T19:18:55,518   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2025-06-08T19:18:55,518   changing mode of build/scripts-3.11/dsr from 644 to 755
2025-06-08T19:18:55,519   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2025-06-08T19:18:55,519   changing mode of build/scripts-3.11/ds_nvme_tune from 644 to 755
2025-06-08T19:18:55,520   changing mode of build/scripts-3.11/ds_io from 644 to 755
2025-06-08T19:18:55,551   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2025-06-08T19:18:55,551   !!

2025-06-08T19:18:55,553           ********************************************************************************
2025-06-08T19:18:55,553           Please avoid running ``setup.py`` directly.
2025-06-08T19:18:55,554           Instead, use pypa/build, pypa/installer or other
2025-06-08T19:18:55,554           standards-based tools.

2025-06-08T19:18:55,555           By 2025-Oct-31, you need to update your project and remove deprecated calls
2025-06-08T19:18:55,556           or your builds will no longer be supported.

2025-06-08T19:18:55,557           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2025-06-08T19:18:55,558           ********************************************************************************

2025-06-08T19:18:55,559   !!
2025-06-08T19:18:55,559     self.initialize_options()
2025-06-08T19:18:55,580   installing to build/bdist.linux-armv7l/wheel
2025-06-08T19:18:55,581   running install
2025-06-08T19:18:55,606   running install_lib
2025-06-08T19:18:55,636   creating build/bdist.linux-armv7l/wheel
2025-06-08T19:18:55,639   creating build/bdist.linux-armv7l/wheel/deepspeed
2025-06-08T19:18:55,641   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2025-06-08T19:18:55,642   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2025-06-08T19:18:55,644   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T19:18:55,646   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T19:18:55,649   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2025-06-08T19:18:55,650   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,653   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,656   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,658   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,660   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,662   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,665   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,667   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,669   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,671   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,674   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,677   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,680   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,682   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,686   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,688   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,691   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,695   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2025-06-08T19:18:55,697   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T19:18:55,701   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2025-06-08T19:18:55,702   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T19:18:55,705   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T19:18:55,707   copying build/lib/deepspeed/sequence/fpdt_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T19:18:55,711   copying build/lib/deepspeed/sequence/cross_entropy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2025-06-08T19:18:55,714   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2025-06-08T19:18:55,715   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,717   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,719   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,722   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,724   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,726   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,729   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,731   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2025-06-08T19:18:55,733   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T19:18:55,736   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2025-06-08T19:18:55,737   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,739   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,741   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,745   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,748   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,750   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,752   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,755   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,758   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,761   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,765   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,767   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,771   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2025-06-08T19:18:55,773   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,776   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,779   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,782   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2025-06-08T19:18:55,784   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,787   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,789   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,792   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,795   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,797   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,799   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2025-06-08T19:18:55,802   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,804   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,806   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,809   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,812   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,814   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,817   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,819   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,821   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,824   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,827   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,829   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,832   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,835   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,838   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,840   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2025-06-08T19:18:55,842   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2025-06-08T19:18:55,846   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2025-06-08T19:18:55,848   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2025-06-08T19:18:55,850   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T19:18:55,852   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T19:18:55,854   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T19:18:55,857   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2025-06-08T19:18:55,859   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,861   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,865   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2025-06-08T19:18:55,866   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,868   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,870   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,872   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,874   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,877   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2025-06-08T19:18:55,879   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,881   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,884   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,887   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2025-06-08T19:18:55,891   creating build/bdist.linux-armv7l/wheel/deepspeed/nvme
2025-06-08T19:18:55,892   copying build/lib/deepspeed/nvme/ds_aio_args.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,895   copying build/lib/deepspeed/nvme/ds_aio_basic.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,897   copying build/lib/deepspeed/nvme/ds_aio_handle.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,900   copying build/lib/deepspeed/nvme/perf_sweep_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,902   copying build/lib/deepspeed/nvme/perf_run_sweep.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,905   copying build/lib/deepspeed/nvme/ds_aio_job.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,907   copying build/lib/deepspeed/nvme/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,909   copying build/lib/deepspeed/nvme/validate_async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,911   copying build/lib/deepspeed/nvme/parse_nvme_stats.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,914   copying build/lib/deepspeed/nvme/test_ds_aio_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,916   copying build/lib/deepspeed/nvme/perf_generate_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,919   copying build/lib/deepspeed/nvme/test_ds_aio.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nvme
2025-06-08T19:18:55,922   creating build/bdist.linux-armv7l/wheel/deepspeed/compile
2025-06-08T19:18:55,923   copying build/lib/deepspeed/compile/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,926   copying build/lib/deepspeed/compile/init_z3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,929   copying build/lib/deepspeed/compile/fx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,931   copying build/lib/deepspeed/compile/partitioner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,934   copying build/lib/deepspeed/compile/list_schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,937   copying build/lib/deepspeed/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,939   copying build/lib/deepspeed/compile/patch_compiled_func.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,942   copying build/lib/deepspeed/compile/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,945   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/passes
2025-06-08T19:18:55,946   copying build/lib/deepspeed/compile/passes/prefetch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,949   copying build/lib/deepspeed/compile/passes/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,951   copying build/lib/deepspeed/compile/passes/offload_adam_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,954   copying build/lib/deepspeed/compile/passes/offload_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,956   copying build/lib/deepspeed/compile/passes/selective_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,959   copying build/lib/deepspeed/compile/passes/offload_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,961   copying build/lib/deepspeed/compile/passes/zero3_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,964   copying build/lib/deepspeed/compile/passes/zero1_compile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/passes
2025-06-08T19:18:55,967   creating build/bdist.linux-armv7l/wheel/deepspeed/compile/profilers
2025-06-08T19:18:55,968   copying build/lib/deepspeed/compile/profilers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T19:18:55,971   copying build/lib/deepspeed/compile/profilers/graph_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T19:18:55,974   copying build/lib/deepspeed/compile/profilers/comm_profile.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile/profilers
2025-06-08T19:18:55,977   copying build/lib/deepspeed/compile/inductor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,980   copying build/lib/deepspeed/compile/util.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,983   copying build/lib/deepspeed/compile/patch_fake_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,986   copying build/lib/deepspeed/compile/graph_param.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,988   copying build/lib/deepspeed/compile/init_z1.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compile
2025-06-08T19:18:55,990   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2025-06-08T19:18:55,993   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2025-06-08T19:18:55,995   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2025-06-08T19:18:55,996   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-08T19:18:55,999   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2025-06-08T19:18:56,002   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2025-06-08T19:18:56,003   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,005   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,007   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,009   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,011   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,013   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,017   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,019   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,021   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,023   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2025-06-08T19:18:56,026   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2025-06-08T19:18:56,029   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2025-06-08T19:18:56,030   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T19:18:56,032   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T19:18:56,035   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2025-06-08T19:18:56,038   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2025-06-08T19:18:56,039   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,042   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,044   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,047   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,049   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,052   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2025-06-08T19:18:56,055   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2025-06-08T19:18:56,056   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T19:18:56,060   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T19:18:56,062   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T19:18:56,064   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T19:18:56,066   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2025-06-08T19:18:56,070   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2025-06-08T19:18:56,071   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,074   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,077   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,079   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,082   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,085   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,088   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,091   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2025-06-08T19:18:56,094   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2025-06-08T19:18:56,095   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,098   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,100   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,103   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,105   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,108   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2025-06-08T19:18:56,110   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2025-06-08T19:18:56,112   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T19:18:56,114   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T19:18:56,116   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2025-06-08T19:18:56,120   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2025-06-08T19:18:56,121   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,124   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,127   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2025-06-08T19:18:56,128   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T19:18:56,132   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,133   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,135   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,138   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,140   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,142   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,145   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,147   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,150   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2025-06-08T19:18:56,152   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T19:18:56,154   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T19:18:56,157   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,158   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,160   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,162   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,165   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,167   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,170   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,172   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2025-06-08T19:18:56,174   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2025-06-08T19:18:56,177   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2025-06-08T19:18:56,178   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2025-06-08T19:18:56,181   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:56,183   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:56,186   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2025-06-08T19:18:56,189   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:56,190   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:56,192   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2025-06-08T19:18:56,195   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:56,196   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:56,199   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2025-06-08T19:18:56,202   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:56,203   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:56,206   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:56,208   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2025-06-08T19:18:56,210   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:56,212   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:56,214   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2025-06-08T19:18:56,217   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:56,219   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:56,221   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2025-06-08T19:18:56,224   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:56,225   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:56,228   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:56,230   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2025-06-08T19:18:56,233   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,235   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,238   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,241   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,243   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2025-06-08T19:18:56,245   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,248   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2025-06-08T19:18:56,250   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2025-06-08T19:18:56,252   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,254   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,257   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,260   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,263   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:56,265   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:56,267   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2025-06-08T19:18:56,270   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,272   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2025-06-08T19:18:56,275   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,281   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:56,282   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:56,285   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:56,287   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:56,289   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2025-06-08T19:18:56,293   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,294   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,296   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,299   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,301   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,303   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,306   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,308   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,311   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,313   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2025-06-08T19:18:56,316   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:56,317   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:56,320   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:56,322   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:56,324   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2025-06-08T19:18:56,327   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:56,329   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:56,331   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:56,333   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:56,335   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2025-06-08T19:18:56,338   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,340   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,342   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,345   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,347   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,350   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,352   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,354   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,357   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,360   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2025-06-08T19:18:56,362   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,365   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,367   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,371   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:56,372   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:56,374   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:56,376   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:56,379   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2025-06-08T19:18:56,382   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,385   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:56,387   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:56,389   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:56,391   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:56,393   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2025-06-08T19:18:56,397   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:56,398   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:56,400   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:56,403   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:56,405   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2025-06-08T19:18:56,408   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:56,409   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:56,411   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:56,413   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:56,415   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2025-06-08T19:18:56,419   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:56,420   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:56,422   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:56,424   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:56,426   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2025-06-08T19:18:56,428   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,432   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:56,433   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:56,435   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:56,437   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:56,439   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2025-06-08T19:18:56,442   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:56,443   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:56,446   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:56,448   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:56,450   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2025-06-08T19:18:56,453   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,456   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2025-06-08T19:18:56,459   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,461   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2025-06-08T19:18:56,464   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2025-06-08T19:18:56,465   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T19:18:56,467   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T19:18:56,470   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T19:18:56,472   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2025-06-08T19:18:56,475   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2025-06-08T19:18:56,477   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:56,479   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,480   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,485   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2025-06-08T19:18:56,495   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,496   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,499   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,501   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,506   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,508   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2025-06-08T19:18:56,511   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,512   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,514   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,517   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,519   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2025-06-08T19:18:56,527   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T19:18:56,528   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2025-06-08T19:18:56,530   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:56,532   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2025-06-08T19:18:56,535   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:56,537   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:56,539   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:56,541   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:56,544   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2025-06-08T19:18:56,546   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:56,547   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:56,550   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:56,552   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2025-06-08T19:18:56,555   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,556   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,562   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,565   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,567   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,569   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,574   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2025-06-08T19:18:56,577   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,578   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,580   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,582   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,584   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,587   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,589   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2025-06-08T19:18:56,592   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,593   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,596   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,598   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,601   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,603   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,605   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2025-06-08T19:18:56,608   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,610   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,612   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,615   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,617   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,619   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,622   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2025-06-08T19:18:56,624   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-08T19:18:56,627   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:56,628   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:56,631   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,632   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,635   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,637   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,640   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,641   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,644   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,646   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,649   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,652   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,654   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,656   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,659   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,662   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2025-06-08T19:18:56,664   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,667   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,669   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2025-06-08T19:18:56,673   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:56,674   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:56,676   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:56,679   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:56,681   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2025-06-08T19:18:56,684   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2025-06-08T19:18:56,687   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,689   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,691   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,693   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,695   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,698   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,701   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,703   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,705   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2025-06-08T19:18:56,708   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,709   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,712   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,714   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,717   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,719   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2025-06-08T19:18:56,722   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,723   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,725   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,728   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,731   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,733   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,735   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,737   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2025-06-08T19:18:56,740   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,742   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,744   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,747   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,749   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,751   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2025-06-08T19:18:56,754   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,756   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,758   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,761   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,765   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,768   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2025-06-08T19:18:56,770   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2025-06-08T19:18:56,773   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:56,775   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,776   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,779   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,781   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,783   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,785   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,788   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2025-06-08T19:18:56,791   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T19:18:56,792   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2025-06-08T19:18:56,794   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:56,797   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,798   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,801   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,803   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,805   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,807   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2025-06-08T19:18:56,810   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2025-06-08T19:18:56,813   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2025-06-08T19:18:56,814   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T19:18:56,817   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T19:18:56,819   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T19:18:56,822   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T19:18:56,824   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2025-06-08T19:18:56,827   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2025-06-08T19:18:56,828   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,831   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,833   copying build/lib/deepspeed/accelerator/mlu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,836   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,838   copying build/lib/deepspeed/accelerator/sdaa_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,841   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,844   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,846   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,849   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,852   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,854   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2025-06-08T19:18:56,858   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2025-06-08T19:18:56,860   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2025-06-08T19:18:56,861   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2025-06-08T19:18:56,864   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2025-06-08T19:18:56,865   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-08T19:18:56,867   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2025-06-08T19:18:56,871   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/gds
2025-06-08T19:18:56,872   copying build/lib/deepspeed/ops/gds/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/gds
2025-06-08T19:18:56,875   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2025-06-08T19:18:56,876   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-08T19:18:56,879   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2025-06-08T19:18:56,882   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2025-06-08T19:18:56,883   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,886   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,890   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,892   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,895   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:56,896   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:56,899   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:56,901   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:56,903   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2025-06-08T19:18:56,905   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,908   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,911   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2025-06-08T19:18:56,915   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2025-06-08T19:18:56,916   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T19:18:56,918   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T19:18:56,921   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T19:18:56,923   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm_triton.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2025-06-08T19:18:56,927   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2025-06-08T19:18:56,928   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,931   copying build/lib/deepspeed/ops/op_builder/dc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,933   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,935   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,937   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,940   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,941   copying build/lib/deepspeed/ops/op_builder/sdaa/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,944   copying build/lib/deepspeed/ops/op_builder/sdaa/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,946   copying build/lib/deepspeed/ops/op_builder/sdaa/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,948   copying build/lib/deepspeed/ops/op_builder/sdaa/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,951   copying build/lib/deepspeed/ops/op_builder/sdaa/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/sdaa
2025-06-08T19:18:56,953   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,955   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,957   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,961   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,962   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,964   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,966   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,968   copying build/lib/deepspeed/ops/op_builder/cpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,971   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,973   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,975   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2025-06-08T19:18:56,977   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,980   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,982   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,984   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,986   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,989   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,991   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,993   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,995   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:56,998   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,000   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,003   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,004   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,007   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,009   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,011   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,014   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,016   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,018   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,021   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,024   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,026   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2025-06-08T19:18:57,029   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,031   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,033   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,035   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,037   copying build/lib/deepspeed/ops/op_builder/hpu/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,040   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,042   copying build/lib/deepspeed/ops/op_builder/hpu/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,044   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,046   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2025-06-08T19:18:57,049   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,050   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,053   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,055   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,057   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,059   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,061   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,064   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,066   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,068   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2025-06-08T19:18:57,071   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,074   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,077   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,078   copying build/lib/deepspeed/ops/op_builder/mlu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,080   copying build/lib/deepspeed/ops/op_builder/mlu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,083   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,085   copying build/lib/deepspeed/ops/op_builder/mlu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,087   copying build/lib/deepspeed/ops/op_builder/mlu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,090   copying build/lib/deepspeed/ops/op_builder/mlu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/mlu
2025-06-08T19:18:57,092   copying build/lib/deepspeed/ops/op_builder/gds.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,094   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,096   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2025-06-08T19:18:57,099   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2025-06-08T19:18:57,101   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2025-06-08T19:18:57,102   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-08T19:18:57,105   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2025-06-08T19:18:57,108   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2025-06-08T19:18:57,109   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,113   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,116   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,117   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,120   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,123   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,125   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,128   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,130   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,133   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,136   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,138   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,141   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2025-06-08T19:18:57,143   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,145   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,148   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,150   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,153   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,155   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,159   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,160   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,163   copying build/lib/deepspeed/ops/transformer/inference/op_binding/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,165   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,167   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,169   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,172   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,174   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,177   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_relu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,179   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,181   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,184   copying build/lib/deepspeed/ops/transformer/inference/op_binding/pad_transform.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,186   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,189   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_residual.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,191   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,193   copying build/lib/deepspeed/ops/transformer/inference/op_binding/bias_gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,195   copying build/lib/deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,198   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,200   copying build/lib/deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,203   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,205   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,208   copying build/lib/deepspeed/ops/transformer/inference/op_binding/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,210   copying build/lib/deepspeed/ops/transformer/inference/op_binding/workspace.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,214   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2025-06-08T19:18:57,216   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,219   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2025-06-08T19:18:57,222   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/compile
2025-06-08T19:18:57,223   copying build/lib/deepspeed/ops/compile/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/compile
2025-06-08T19:18:57,226   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2025-06-08T19:18:57,228   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-08T19:18:57,230   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2025-06-08T19:18:57,233   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2025-06-08T19:18:57,234   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T19:18:57,236   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T19:18:57,239   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T19:18:57,241   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2025-06-08T19:18:57,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2025-06-08T19:18:57,245   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-08T19:18:57,247   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2025-06-08T19:18:57,251   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2025-06-08T19:18:57,252   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T19:18:57,255   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T19:18:57,257   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T19:18:57,259   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2025-06-08T19:18:57,262   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2025-06-08T19:18:57,264   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-08T19:18:57,266   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2025-06-08T19:18:57,269   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2025-06-08T19:18:57,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2025-06-08T19:18:57,273   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2025-06-08T19:18:57,275   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2025-06-08T19:18:57,278   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,279   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,281   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,283   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,286   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,288   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,290   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,293   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,295   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,297   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,299   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,302   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,304   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,306   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,309   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,311   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,313   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,315   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2025-06-08T19:18:57,319   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,320   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,322   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,324   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,327   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,329   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,332   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2025-06-08T19:18:57,335   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2025-06-08T19:18:57,337   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2025-06-08T19:18:57,340   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds
2025-06-08T19:18:57,342   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,344   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,347   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,349   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,351   copying build/lib/deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,353   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,356   copying build/lib/deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/gds/py_lib
2025-06-08T19:18:57,358   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2025-06-08T19:18:57,360   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2025-06-08T19:18:57,362   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2025-06-08T19:18:57,364   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-08T19:18:57,367   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2025-06-08T19:18:57,370   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2025-06-08T19:18:57,371   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2025-06-08T19:18:57,374   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:57,376   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:57,377   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:57,380   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2025-06-08T19:18:57,382   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:57,385   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2025-06-08T19:18:57,389   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2025-06-08T19:18:57,391   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,393   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,396   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,398   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,400   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,403   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,405   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,407   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,410   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,413   copying build/lib/deepspeed/ops/csrc/includes/deepcompile.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,416   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,418   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,421   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,424   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,426   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,429   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,432   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,434   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,436   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,439   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,441   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,444   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,447   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,450   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,453   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,455   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,458   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,460   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,463   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,466   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2025-06-08T19:18:57,469   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,470   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,473   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,476   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,479   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,484   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,487   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,490   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,494   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2025-06-08T19:18:57,496   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:57,498   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:57,502   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:57,505   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2025-06-08T19:18:57,509   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,513   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,516   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,520   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,523   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,526   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,528   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,531   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,535   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,538   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,541   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2025-06-08T19:18:57,543   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2025-06-08T19:18:57,548   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2025-06-08T19:18:57,549   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2025-06-08T19:18:57,551   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2025-06-08T19:18:57,554   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2025-06-08T19:18:57,555   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2025-06-08T19:18:57,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:57,560   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:57,563   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:57,565   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:57,568   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2025-06-08T19:18:57,572   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2025-06-08T19:18:57,574   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2025-06-08T19:18:57,575   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2025-06-08T19:18:57,578   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:57,579   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:57,582   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2025-06-08T19:18:57,585   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/compile
2025-06-08T19:18:57,586   copying build/lib/deepspeed/ops/csrc/compile/util.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,589   copying build/lib/deepspeed/ops/csrc/compile/z1.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,591   copying build/lib/deepspeed/ops/csrc/compile/deepcompile.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,594   copying build/lib/deepspeed/ops/csrc/compile/z3.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,596   copying build/lib/deepspeed/ops/csrc/compile/z1.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,599   copying build/lib/deepspeed/ops/csrc/compile/z3.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,602   copying build/lib/deepspeed/ops/csrc/compile/init.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/compile
2025-06-08T19:18:57,605   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2025-06-08T19:18:57,606   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T19:18:57,609   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T19:18:57,611   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T19:18:57,614   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T19:18:57,616   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2025-06-08T19:18:57,620   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2025-06-08T19:18:57,622   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,624   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,629   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:57,630   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:57,633   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2025-06-08T19:18:57,637   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,639   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,644   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,647   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,652   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,656   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,660   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,664   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,668   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,671   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,674   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2025-06-08T19:18:57,677   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,678   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,682   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,684   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,688   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,691   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,694   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,697   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2025-06-08T19:18:57,702   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:57,704   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:57,707   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:57,710   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:57,713   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2025-06-08T19:18:57,716   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2025-06-08T19:18:57,720   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2025-06-08T19:18:57,721   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2025-06-08T19:18:57,723   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2025-06-08T19:18:57,727   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,728   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,731   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,733   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,736   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,739   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2025-06-08T19:18:57,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2025-06-08T19:18:57,743   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2025-06-08T19:18:57,746   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:57,748   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:57,751   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:57,754   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2025-06-08T19:18:57,757   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2025-06-08T19:18:57,758   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2025-06-08T19:18:57,761   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2025-06-08T19:18:57,763   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T19:18:57,765   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T19:18:57,768   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T19:18:57,770   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T19:18:57,772   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2025-06-08T19:18:57,776   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:57,777   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:57,780   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:57,782   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:57,785   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2025-06-08T19:18:57,789   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,790   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,793   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,796   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,799   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,802   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,804   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,807   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2025-06-08T19:18:57,811   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2025-06-08T19:18:57,812   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T19:18:57,815   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T19:18:57,817   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2025-06-08T19:18:57,820   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2025-06-08T19:18:57,822   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2025-06-08T19:18:57,823   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-08T19:18:57,828   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2025-06-08T19:18:57,830   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T19:18:57,832   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T19:18:57,834   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2025-06-08T19:18:57,837   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2025-06-08T19:18:57,838   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,840   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,843   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,846   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,848   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,851   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2025-06-08T19:18:57,855   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2025-06-08T19:18:57,856   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2025-06-08T19:18:57,858   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,860   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,863   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,867   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,870   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,872   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2025-06-08T19:18:57,875   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,877   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,880   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:57,881   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:57,884   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:57,886   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2025-06-08T19:18:57,889   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,892   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,895   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,897   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,901   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,904   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,907   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/tensor_parallel
2025-06-08T19:18:57,908   copying build/lib/deepspeed/runtime/tensor_parallel/tp_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T19:18:57,911   copying build/lib/deepspeed/runtime/tensor_parallel/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T19:18:57,913   copying build/lib/deepspeed/runtime/tensor_parallel/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/tensor_parallel
2025-06-08T19:18:57,916   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2025-06-08T19:18:57,918   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T19:18:57,921   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T19:18:57,923   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T19:18:57,926   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2025-06-08T19:18:57,930   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2025-06-08T19:18:57,931   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T19:18:57,934   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T19:18:57,937   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T19:18:57,939   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2025-06-08T19:18:57,942   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,946   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,952   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,956   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/domino
2025-06-08T19:18:57,957   copying build/lib/deepspeed/runtime/domino/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T19:18:57,960   copying build/lib/deepspeed/runtime/domino/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T19:18:57,963   copying build/lib/deepspeed/runtime/domino/async_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/domino
2025-06-08T19:18:57,965   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,968   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,972   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:57,974   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:57,976   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:57,979   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:57,982   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2025-06-08T19:18:57,985   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,988   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2025-06-08T19:18:57,989   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-08T19:18:57,992   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2025-06-08T19:18:57,994   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:57,997   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2025-06-08T19:18:57,999   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,001   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,004   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,007   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,010   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,013   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,017   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2025-06-08T19:18:58,020   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T19:18:58,023   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,025   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,027   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,030   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,033   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,035   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2025-06-08T19:18:58,037   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T19:18:58,040   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T19:18:58,043   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2025-06-08T19:18:58,046   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:58,049   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2025-06-08T19:18:58,051   copying build/lib/deepspeed/runtime/zero/offload_states.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,053   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,057   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,059   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,062   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,066   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,069   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,072   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,075   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,078   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,083   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,086   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,088   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,091   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,097   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,099   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,102   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2025-06-08T19:18:58,105   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,106   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,109   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,112   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,115   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,119   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,122   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,125   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,128   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,131   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2025-06-08T19:18:58,134   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:58,138   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2025-06-08T19:18:58,140   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,143   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,146   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,148   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,151   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,154   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2025-06-08T19:18:58,157   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2025-06-08T19:18:58,162   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2025-06-08T19:18:58,163   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,167   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,169   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,172   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,174   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,176   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,179   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,182   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,184   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2025-06-08T19:18:58,188   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2025-06-08T19:18:58,190   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,192   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,195   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,198   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,200   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,203   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,206   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,209   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,212   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,215   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2025-06-08T19:18:58,217   running install_egg_info
2025-06-08T19:18:58,256   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.16.9-py3.11.egg-info
2025-06-08T19:18:58,271   running install_scripts
2025-06-08T19:18:58,273   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,275   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,278   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,280   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,282   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,285   copying build/scripts-3.11/ds_io -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,287   copying build/scripts-3.11/ds_nvme_tune -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,289   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,292   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,295   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,297   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts
2025-06-08T19:18:58,300   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_ssh to 755
2025-06-08T19:18:58,300   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_elastic to 755
2025-06-08T19:18:58,301   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_report to 755
2025-06-08T19:18:58,302   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_bench to 755
2025-06-08T19:18:58,303   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_io to 755
2025-06-08T19:18:58,304   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds_nvme_tune to 755
2025-06-08T19:18:58,304   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/dsr to 755
2025-06-08T19:18:58,305   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/deepspeed.pt to 755
2025-06-08T19:18:58,306   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/ds to 755
2025-06-08T19:18:58,307   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.data/scripts/deepspeed to 755
2025-06-08T19:18:58,324   creating build/bdist.linux-armv7l/wheel/deepspeed-0.16.9.dist-info/WHEEL
2025-06-08T19:18:58,328   creating '/tmp/pip-wheel-adryghtv/deepspeed-0.16.9-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2025-06-08T19:18:58,333   adding 'deepspeed/__init__.py'
2025-06-08T19:18:58,335   adding 'deepspeed/constants.py'
2025-06-08T19:18:58,338   adding 'deepspeed/env_report.py'
2025-06-08T19:18:58,340   adding 'deepspeed/git_version_info.py'
2025-06-08T19:18:58,342   adding 'deepspeed/git_version_info_installed.py'
2025-06-08T19:18:58,345   adding 'deepspeed/accelerator/__init__.py'
2025-06-08T19:18:58,347   adding 'deepspeed/accelerator/abstract_accelerator.py'
2025-06-08T19:18:58,350   adding 'deepspeed/accelerator/cpu_accelerator.py'
2025-06-08T19:18:58,353   adding 'deepspeed/accelerator/cuda_accelerator.py'
2025-06-08T19:18:58,355   adding 'deepspeed/accelerator/hpu_accelerator.py'
2025-06-08T19:18:58,358   adding 'deepspeed/accelerator/mlu_accelerator.py'
2025-06-08T19:18:58,360   adding 'deepspeed/accelerator/mps_accelerator.py'
2025-06-08T19:18:58,362   adding 'deepspeed/accelerator/npu_accelerator.py'
2025-06-08T19:18:58,365   adding 'deepspeed/accelerator/real_accelerator.py'
2025-06-08T19:18:58,367   adding 'deepspeed/accelerator/sdaa_accelerator.py'
2025-06-08T19:18:58,369   adding 'deepspeed/accelerator/xpu_accelerator.py'
2025-06-08T19:18:58,372   adding 'deepspeed/autotuning/__init__.py'
2025-06-08T19:18:58,378   adding 'deepspeed/autotuning/autotuner.py'
2025-06-08T19:18:58,380   adding 'deepspeed/autotuning/config.py'
2025-06-08T19:18:58,381   adding 'deepspeed/autotuning/constants.py'
2025-06-08T19:18:58,384   adding 'deepspeed/autotuning/scheduler.py'
2025-06-08T19:18:58,386   adding 'deepspeed/autotuning/utils.py'
2025-06-08T19:18:58,388   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2025-06-08T19:18:58,389   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2025-06-08T19:18:58,391   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2025-06-08T19:18:58,392   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2025-06-08T19:18:58,394   adding 'deepspeed/autotuning/tuner/__init__.py'
2025-06-08T19:18:58,396   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2025-06-08T19:18:58,398   adding 'deepspeed/autotuning/tuner/cost_model.py'
2025-06-08T19:18:58,399   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2025-06-08T19:18:58,401   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2025-06-08T19:18:58,403   adding 'deepspeed/autotuning/tuner/utils.py'
2025-06-08T19:18:58,405   adding 'deepspeed/checkpoint/__init__.py'
2025-06-08T19:18:58,407   adding 'deepspeed/checkpoint/constants.py'
2025-06-08T19:18:58,409   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2025-06-08T19:18:58,413   adding 'deepspeed/checkpoint/ds_to_universal.py'
2025-06-08T19:18:58,414   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2025-06-08T19:18:58,416   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2025-06-08T19:18:58,417   adding 'deepspeed/checkpoint/reshape_utils.py'
2025-06-08T19:18:58,419   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2025-06-08T19:18:58,420   adding 'deepspeed/checkpoint/utils.py'
2025-06-08T19:18:58,422   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2025-06-08T19:18:58,424   adding 'deepspeed/comm/__init__.py'
2025-06-08T19:18:58,426   adding 'deepspeed/comm/backend.py'
2025-06-08T19:18:58,427   adding 'deepspeed/comm/ccl.py'
2025-06-08T19:18:58,431   adding 'deepspeed/comm/comm.py'
2025-06-08T19:18:58,432   adding 'deepspeed/comm/config.py'
2025-06-08T19:18:58,433   adding 'deepspeed/comm/constants.py'
2025-06-08T19:18:58,435   adding 'deepspeed/comm/reduce_op.py'
2025-06-08T19:18:58,437   adding 'deepspeed/comm/torch.py'
2025-06-08T19:18:58,439   adding 'deepspeed/comm/utils.py'
2025-06-08T19:18:58,440   adding 'deepspeed/compile/__init__.py'
2025-06-08T19:18:58,442   adding 'deepspeed/compile/backend.py'
2025-06-08T19:18:58,444   adding 'deepspeed/compile/config.py'
2025-06-08T19:18:58,445   adding 'deepspeed/compile/fx.py'
2025-06-08T19:18:58,447   adding 'deepspeed/compile/graph_param.py'
2025-06-08T19:18:58,448   adding 'deepspeed/compile/inductor.py'
2025-06-08T19:18:58,450   adding 'deepspeed/compile/init_z1.py'
2025-06-08T19:18:58,451   adding 'deepspeed/compile/init_z3.py'
2025-06-08T19:18:58,454   adding 'deepspeed/compile/list_schedule.py'
2025-06-08T19:18:58,455   adding 'deepspeed/compile/partitioner.py'
2025-06-08T19:18:58,457   adding 'deepspeed/compile/patch_compiled_func.py'
2025-06-08T19:18:58,458   adding 'deepspeed/compile/patch_fake_tensor.py'
2025-06-08T19:18:58,460   adding 'deepspeed/compile/util.py'
2025-06-08T19:18:58,462   adding 'deepspeed/compile/passes/__init__.py'
2025-06-08T19:18:58,464   adding 'deepspeed/compile/passes/offload_activation.py'
2025-06-08T19:18:58,466   adding 'deepspeed/compile/passes/offload_adam_states.py'
2025-06-08T19:18:58,468   adding 'deepspeed/compile/passes/offload_parameters.py'
2025-06-08T19:18:58,470   adding 'deepspeed/compile/passes/prefetch.py'
2025-06-08T19:18:58,471   adding 'deepspeed/compile/passes/selective_gather.py'
2025-06-08T19:18:58,473   adding 'deepspeed/compile/passes/zero1_compile.py'
2025-06-08T19:18:58,474   adding 'deepspeed/compile/passes/zero3_compile.py'
2025-06-08T19:18:58,476   adding 'deepspeed/compile/profilers/__init__.py'
2025-06-08T19:18:58,478   adding 'deepspeed/compile/profilers/comm_profile.py'
2025-06-08T19:18:58,480   adding 'deepspeed/compile/profilers/graph_profile.py'
2025-06-08T19:18:58,482   adding 'deepspeed/compression/__init__.py'
2025-06-08T19:18:58,485   adding 'deepspeed/compression/basic_layer.py'
2025-06-08T19:18:58,487   adding 'deepspeed/compression/compress.py'
2025-06-08T19:18:58,490   adding 'deepspeed/compression/config.py'
2025-06-08T19:18:58,491   adding 'deepspeed/compression/constants.py'
2025-06-08T19:18:58,493   adding 'deepspeed/compression/helper.py'
2025-06-08T19:18:58,495   adding 'deepspeed/compression/scheduler.py'
2025-06-08T19:18:58,497   adding 'deepspeed/compression/utils.py'
2025-06-08T19:18:58,499   adding 'deepspeed/elasticity/__init__.py'
2025-06-08T19:18:58,500   adding 'deepspeed/elasticity/config.py'
2025-06-08T19:18:58,502   adding 'deepspeed/elasticity/constants.py'
2025-06-08T19:18:58,503   adding 'deepspeed/elasticity/elastic_agent.py'
2025-06-08T19:18:58,506   adding 'deepspeed/elasticity/elasticity.py'
2025-06-08T19:18:58,508   adding 'deepspeed/elasticity/utils.py'
2025-06-08T19:18:58,509   adding 'deepspeed/inference/__init__.py'
2025-06-08T19:18:58,512   adding 'deepspeed/inference/config.py'
2025-06-08T19:18:58,515   adding 'deepspeed/inference/engine.py'
2025-06-08T19:18:58,518   adding 'deepspeed/inference/quantization/__init__.py'
2025-06-08T19:18:58,519   adding 'deepspeed/inference/quantization/layers.py'
2025-06-08T19:18:58,521   adding 'deepspeed/inference/quantization/quantization.py'
2025-06-08T19:18:58,522   adding 'deepspeed/inference/quantization/quantization_context.py'
2025-06-08T19:18:58,524   adding 'deepspeed/inference/quantization/utils.py'
2025-06-08T19:18:58,526   adding 'deepspeed/inference/v2/__init__.py'
2025-06-08T19:18:58,527   adding 'deepspeed/inference/v2/allocator.py'
2025-06-08T19:18:58,529   adding 'deepspeed/inference/v2/config_v2.py'
2025-06-08T19:18:58,530   adding 'deepspeed/inference/v2/engine_factory.py'
2025-06-08T19:18:58,532   adding 'deepspeed/inference/v2/engine_v2.py'
2025-06-08T19:18:58,533   adding 'deepspeed/inference/v2/inference_parameter.py'
2025-06-08T19:18:58,535   adding 'deepspeed/inference/v2/inference_utils.py'
2025-06-08T19:18:58,536   adding 'deepspeed/inference/v2/logging.py'
2025-06-08T19:18:58,537   adding 'deepspeed/inference/v2/scheduling_utils.py'
2025-06-08T19:18:58,539   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2025-06-08T19:18:58,541   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2025-06-08T19:18:58,542   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2025-06-08T19:18:58,543   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2025-06-08T19:18:58,545   adding 'deepspeed/inference/v2/kernels/__init__.py'
2025-06-08T19:18:58,547   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2025-06-08T19:18:58,548   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2025-06-08T19:18:58,550   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2025-06-08T19:18:58,552   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2025-06-08T19:18:58,553   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2025-06-08T19:18:58,554   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2025-06-08T19:18:58,556   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2025-06-08T19:18:58,557   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2025-06-08T19:18:58,559   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2025-06-08T19:18:58,561   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2025-06-08T19:18:58,562   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2025-06-08T19:18:58,564   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2025-06-08T19:18:58,566   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2025-06-08T19:18:58,567   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2025-06-08T19:18:58,569   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2025-06-08T19:18:58,570   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2025-06-08T19:18:58,572   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2025-06-08T19:18:58,573   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2025-06-08T19:18:58,575   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2025-06-08T19:18:58,577   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2025-06-08T19:18:58,579   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2025-06-08T19:18:58,580   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2025-06-08T19:18:58,582   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2025-06-08T19:18:58,584   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2025-06-08T19:18:58,586   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2025-06-08T19:18:58,587   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2025-06-08T19:18:58,590   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2025-06-08T19:18:58,592   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2025-06-08T19:18:58,593   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2025-06-08T19:18:58,594   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2025-06-08T19:18:58,596   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2025-06-08T19:18:58,598   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2025-06-08T19:18:58,599   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2025-06-08T19:18:58,601   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2025-06-08T19:18:58,602   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2025-06-08T19:18:58,604   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2025-06-08T19:18:58,606   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2025-06-08T19:18:58,607   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2025-06-08T19:18:58,608   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2025-06-08T19:18:58,610   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2025-06-08T19:18:58,611   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2025-06-08T19:18:58,613   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2025-06-08T19:18:58,615   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2025-06-08T19:18:58,616   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2025-06-08T19:18:58,617   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2025-06-08T19:18:58,619   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2025-06-08T19:18:58,621   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2025-06-08T19:18:58,623   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2025-06-08T19:18:58,625   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2025-06-08T19:18:58,627   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2025-06-08T19:18:58,629   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2025-06-08T19:18:58,630   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2025-06-08T19:18:58,632   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2025-06-08T19:18:58,633   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2025-06-08T19:18:58,635   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2025-06-08T19:18:58,636   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2025-06-08T19:18:58,638   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2025-06-08T19:18:58,639   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2025-06-08T19:18:58,641   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2025-06-08T19:18:58,642   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2025-06-08T19:18:58,644   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2025-06-08T19:18:58,646   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2025-06-08T19:18:58,648   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2025-06-08T19:18:58,649   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2025-06-08T19:18:58,652   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2025-06-08T19:18:58,655   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2025-06-08T19:18:58,657   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2025-06-08T19:18:58,658   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2025-06-08T19:18:58,660   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2025-06-08T19:18:58,662   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2025-06-08T19:18:58,663   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2025-06-08T19:18:58,664   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2025-06-08T19:18:58,667   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2025-06-08T19:18:58,669   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2025-06-08T19:18:58,670   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2025-06-08T19:18:58,672   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2025-06-08T19:18:58,673   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2025-06-08T19:18:58,674   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2025-06-08T19:18:58,676   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2025-06-08T19:18:58,678   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2025-06-08T19:18:58,679   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2025-06-08T19:18:58,680   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2025-06-08T19:18:58,682   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2025-06-08T19:18:58,683   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2025-06-08T19:18:58,685   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2025-06-08T19:18:58,687   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2025-06-08T19:18:58,689   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2025-06-08T19:18:58,690   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2025-06-08T19:18:58,691   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2025-06-08T19:18:58,693   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2025-06-08T19:18:58,695   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2025-06-08T19:18:58,696   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2025-06-08T19:18:58,698   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2025-06-08T19:18:58,700   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2025-06-08T19:18:58,701   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2025-06-08T19:18:58,703   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2025-06-08T19:18:58,704   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2025-06-08T19:18:58,706   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2025-06-08T19:18:58,708   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2025-06-08T19:18:58,710   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2025-06-08T19:18:58,712   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2025-06-08T19:18:58,714   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2025-06-08T19:18:58,715   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2025-06-08T19:18:58,717   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2025-06-08T19:18:58,718   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2025-06-08T19:18:58,720   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2025-06-08T19:18:58,722   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2025-06-08T19:18:58,723   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2025-06-08T19:18:58,724   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2025-06-08T19:18:58,725   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2025-06-08T19:18:58,727   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2025-06-08T19:18:58,729   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2025-06-08T19:18:58,730   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2025-06-08T19:18:58,731   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2025-06-08T19:18:58,733   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2025-06-08T19:18:58,735   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2025-06-08T19:18:58,736   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2025-06-08T19:18:58,737   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2025-06-08T19:18:58,739   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2025-06-08T19:18:58,740   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2025-06-08T19:18:58,743   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2025-06-08T19:18:58,744   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2025-06-08T19:18:58,746   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2025-06-08T19:18:58,749   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2025-06-08T19:18:58,752   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2025-06-08T19:18:58,754   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2025-06-08T19:18:58,756   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2025-06-08T19:18:58,758   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2025-06-08T19:18:58,760   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2025-06-08T19:18:58,761   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2025-06-08T19:18:58,762   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2025-06-08T19:18:58,764   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2025-06-08T19:18:58,765   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2025-06-08T19:18:58,766   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2025-06-08T19:18:58,768   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2025-06-08T19:18:58,769   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2025-06-08T19:18:58,771   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2025-06-08T19:18:58,772   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2025-06-08T19:18:58,774   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2025-06-08T19:18:58,776   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2025-06-08T19:18:58,778   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2025-06-08T19:18:58,779   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2025-06-08T19:18:58,781   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2025-06-08T19:18:58,783   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2025-06-08T19:18:58,784   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2025-06-08T19:18:58,786   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2025-06-08T19:18:58,788   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2025-06-08T19:18:58,789   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2025-06-08T19:18:58,791   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2025-06-08T19:18:58,792   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2025-06-08T19:18:58,794   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2025-06-08T19:18:58,796   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2025-06-08T19:18:58,797   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2025-06-08T19:18:58,799   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2025-06-08T19:18:58,801   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2025-06-08T19:18:58,802   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2025-06-08T19:18:58,804   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2025-06-08T19:18:58,805   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2025-06-08T19:18:58,807   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2025-06-08T19:18:58,808   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2025-06-08T19:18:58,810   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2025-06-08T19:18:58,812   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2025-06-08T19:18:58,813   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2025-06-08T19:18:58,815   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2025-06-08T19:18:58,817   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2025-06-08T19:18:58,818   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2025-06-08T19:18:58,820   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2025-06-08T19:18:58,821   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2025-06-08T19:18:58,823   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2025-06-08T19:18:58,824   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2025-06-08T19:18:58,826   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2025-06-08T19:18:58,827   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2025-06-08T19:18:58,829   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2025-06-08T19:18:58,831   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2025-06-08T19:18:58,833   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2025-06-08T19:18:58,834   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2025-06-08T19:18:58,836   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2025-06-08T19:18:58,837   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2025-06-08T19:18:58,839   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2025-06-08T19:18:58,840   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2025-06-08T19:18:58,842   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2025-06-08T19:18:58,844   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2025-06-08T19:18:58,845   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2025-06-08T19:18:58,846   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2025-06-08T19:18:58,848   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2025-06-08T19:18:58,850   adding 'deepspeed/inference/v2/modules/__init__.py'
2025-06-08T19:18:58,851   adding 'deepspeed/inference/v2/modules/ds_module.py'
2025-06-08T19:18:58,853   adding 'deepspeed/inference/v2/modules/heuristics.py'
2025-06-08T19:18:58,854   adding 'deepspeed/inference/v2/modules/module_registry.py'
2025-06-08T19:18:58,856   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2025-06-08T19:18:58,857   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2025-06-08T19:18:58,859   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2025-06-08T19:18:58,860   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2025-06-08T19:18:58,861   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2025-06-08T19:18:58,862   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2025-06-08T19:18:58,864   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2025-06-08T19:18:58,866   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2025-06-08T19:18:58,867   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2025-06-08T19:18:58,869   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2025-06-08T19:18:58,871   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2025-06-08T19:18:58,872   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2025-06-08T19:18:58,874   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2025-06-08T19:18:58,875   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2025-06-08T19:18:58,877   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2025-06-08T19:18:58,879   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2025-06-08T19:18:58,881   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2025-06-08T19:18:58,883   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2025-06-08T19:18:58,884   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2025-06-08T19:18:58,886   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2025-06-08T19:18:58,887   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2025-06-08T19:18:58,889   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2025-06-08T19:18:58,890   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2025-06-08T19:18:58,892   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2025-06-08T19:18:58,894   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2025-06-08T19:18:58,895   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2025-06-08T19:18:58,897   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2025-06-08T19:18:58,898   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2025-06-08T19:18:58,900   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2025-06-08T19:18:58,901   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2025-06-08T19:18:58,903   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2025-06-08T19:18:58,904   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2025-06-08T19:18:58,906   adding 'deepspeed/inference/v2/ragged/__init__.py'
2025-06-08T19:18:58,908   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2025-06-08T19:18:58,910   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2025-06-08T19:18:58,912   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2025-06-08T19:18:58,914   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2025-06-08T19:18:58,916   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2025-06-08T19:18:58,918   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2025-06-08T19:18:58,920   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2025-06-08T19:18:58,921   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2025-06-08T19:18:58,923   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2025-06-08T19:18:58,925   adding 'deepspeed/launcher/__init__.py'
2025-06-08T19:18:58,926   adding 'deepspeed/launcher/constants.py'
2025-06-08T19:18:58,928   adding 'deepspeed/launcher/launch.py'
2025-06-08T19:18:58,930   adding 'deepspeed/launcher/launcher_helper.py'
2025-06-08T19:18:58,932   adding 'deepspeed/launcher/multinode_runner.py'
2025-06-08T19:18:58,935   adding 'deepspeed/launcher/runner.py'
2025-06-08T19:18:58,937   adding 'deepspeed/linear/__init__.py'
2025-06-08T19:18:58,939   adding 'deepspeed/linear/config.py'
2025-06-08T19:18:58,940   adding 'deepspeed/linear/context_manager.py'
2025-06-08T19:18:58,942   adding 'deepspeed/linear/optimized_linear.py'
2025-06-08T19:18:58,944   adding 'deepspeed/linear/quantization.py'
2025-06-08T19:18:58,945   adding 'deepspeed/model_implementations/__init__.py'
2025-06-08T19:18:58,947   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2025-06-08T19:18:58,949   adding 'deepspeed/model_implementations/diffusers/unet.py'
2025-06-08T19:18:58,950   adding 'deepspeed/model_implementations/diffusers/vae.py'
2025-06-08T19:18:58,952   adding 'deepspeed/model_implementations/features/__init__.py'
2025-06-08T19:18:58,953   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2025-06-08T19:18:58,955   adding 'deepspeed/model_implementations/transformers/__init__.py'
2025-06-08T19:18:58,956   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2025-06-08T19:18:58,958   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2025-06-08T19:18:58,959   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2025-06-08T19:18:58,960   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2025-06-08T19:18:58,962   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2025-06-08T19:18:58,963   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2025-06-08T19:18:58,965   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2025-06-08T19:18:58,966   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2025-06-08T19:18:58,968   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2025-06-08T19:18:58,970   adding 'deepspeed/module_inject/__init__.py'
2025-06-08T19:18:58,973   adding 'deepspeed/module_inject/auto_tp.py'
2025-06-08T19:18:58,975   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2025-06-08T19:18:58,977   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2025-06-08T19:18:58,979   adding 'deepspeed/module_inject/inject.py'
2025-06-08T19:18:58,982   adding 'deepspeed/module_inject/layers.py'
2025-06-08T19:18:58,985   adding 'deepspeed/module_inject/load_checkpoint.py'
2025-06-08T19:18:58,986   adding 'deepspeed/module_inject/module_quantize.py'
2025-06-08T19:18:58,988   adding 'deepspeed/module_inject/policy.py'
2025-06-08T19:18:58,992   adding 'deepspeed/module_inject/replace_module.py'
2025-06-08T19:18:58,994   adding 'deepspeed/module_inject/replace_policy.py'
2025-06-08T19:18:58,995   adding 'deepspeed/module_inject/tp_shard.py'
2025-06-08T19:18:58,996   adding 'deepspeed/module_inject/utils.py'
2025-06-08T19:18:58,998   adding 'deepspeed/module_inject/containers/__init__.py'
2025-06-08T19:18:59,001   adding 'deepspeed/module_inject/containers/base.py'
2025-06-08T19:18:59,002   adding 'deepspeed/module_inject/containers/base_moe.py'
2025-06-08T19:18:59,004   adding 'deepspeed/module_inject/containers/bert.py'
2025-06-08T19:18:59,006   adding 'deepspeed/module_inject/containers/bloom.py'
2025-06-08T19:18:59,007   adding 'deepspeed/module_inject/containers/clip.py'
2025-06-08T19:18:59,009   adding 'deepspeed/module_inject/containers/distil_bert.py'
2025-06-08T19:18:59,010   adding 'deepspeed/module_inject/containers/gpt2.py'
2025-06-08T19:18:59,011   adding 'deepspeed/module_inject/containers/gptj.py'
2025-06-08T19:18:59,013   adding 'deepspeed/module_inject/containers/gptneo.py'
2025-06-08T19:18:59,015   adding 'deepspeed/module_inject/containers/gptneox.py'
2025-06-08T19:18:59,016   adding 'deepspeed/module_inject/containers/internlm.py'
2025-06-08T19:18:59,018   adding 'deepspeed/module_inject/containers/llama.py'
2025-06-08T19:18:59,020   adding 'deepspeed/module_inject/containers/llama2.py'
2025-06-08T19:18:59,021   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2025-06-08T19:18:59,023   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2025-06-08T19:18:59,025   adding 'deepspeed/module_inject/containers/opt.py'
2025-06-08T19:18:59,026   adding 'deepspeed/module_inject/containers/unet.py'
2025-06-08T19:18:59,027   adding 'deepspeed/module_inject/containers/vae.py'
2025-06-08T19:18:59,029   adding 'deepspeed/module_inject/containers/features/__init__.py'
2025-06-08T19:18:59,031   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2025-06-08T19:18:59,033   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2025-06-08T19:18:59,035   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2025-06-08T19:18:59,036   adding 'deepspeed/module_inject/containers/features/megatron.py'
2025-06-08T19:18:59,038   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2025-06-08T19:18:59,039   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2025-06-08T19:18:59,041   adding 'deepspeed/moe/__init__.py'
2025-06-08T19:18:59,043   adding 'deepspeed/moe/experts.py'
2025-06-08T19:18:59,044   adding 'deepspeed/moe/layer.py'
2025-06-08T19:18:59,046   adding 'deepspeed/moe/mappings.py'
2025-06-08T19:18:59,050   adding 'deepspeed/moe/sharded_moe.py'
2025-06-08T19:18:59,052   adding 'deepspeed/moe/utils.py'
2025-06-08T19:18:59,053   adding 'deepspeed/monitor/__init__.py'
2025-06-08T19:18:59,055   adding 'deepspeed/monitor/comet.py'
2025-06-08T19:18:59,057   adding 'deepspeed/monitor/config.py'
2025-06-08T19:18:59,058   adding 'deepspeed/monitor/csv_monitor.py'
2025-06-08T19:18:59,060   adding 'deepspeed/monitor/monitor.py'
2025-06-08T19:18:59,061   adding 'deepspeed/monitor/tensorboard.py'
2025-06-08T19:18:59,063   adding 'deepspeed/monitor/utils.py'
2025-06-08T19:18:59,064   adding 'deepspeed/monitor/wandb.py'
2025-06-08T19:18:59,066   adding 'deepspeed/nebula/__init__.py'
2025-06-08T19:18:59,068   adding 'deepspeed/nebula/config.py'
2025-06-08T19:18:59,069   adding 'deepspeed/nebula/constants.py'
2025-06-08T19:18:59,071   adding 'deepspeed/nvme/__init__.py'
2025-06-08T19:18:59,073   adding 'deepspeed/nvme/ds_aio_args.py'
2025-06-08T19:18:59,074   adding 'deepspeed/nvme/ds_aio_basic.py'
2025-06-08T19:18:59,076   adding 'deepspeed/nvme/ds_aio_handle.py'
2025-06-08T19:18:59,077   adding 'deepspeed/nvme/ds_aio_job.py'
2025-06-08T19:18:59,079   adding 'deepspeed/nvme/parse_nvme_stats.py'
2025-06-08T19:18:59,080   adding 'deepspeed/nvme/perf_generate_param.py'
2025-06-08T19:18:59,082   adding 'deepspeed/nvme/perf_run_sweep.py'
2025-06-08T19:18:59,084   adding 'deepspeed/nvme/perf_sweep_utils.py'
2025-06-08T19:18:59,086   adding 'deepspeed/nvme/test_ds_aio.py'
2025-06-08T19:18:59,087   adding 'deepspeed/nvme/test_ds_aio_utils.py'
2025-06-08T19:18:59,089   adding 'deepspeed/nvme/validate_async_io.py'
2025-06-08T19:18:59,091   adding 'deepspeed/ops/__init__.py'
2025-06-08T19:18:59,093   adding 'deepspeed/ops/adagrad/__init__.py'
2025-06-08T19:18:59,095   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2025-06-08T19:18:59,097   adding 'deepspeed/ops/adam/__init__.py'
2025-06-08T19:18:59,099   adding 'deepspeed/ops/adam/cpu_adam.py'
2025-06-08T19:18:59,102   adding 'deepspeed/ops/adam/fused_adam.py'
2025-06-08T19:18:59,103   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2025-06-08T19:18:59,105   adding 'deepspeed/ops/aio/__init__.py'
2025-06-08T19:18:59,107   adding 'deepspeed/ops/compile/__init__.py'
2025-06-08T19:18:59,110   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2025-06-08T19:18:59,111   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2025-06-08T19:18:59,113   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2025-06-08T19:18:59,114   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2025-06-08T19:18:59,116   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2025-06-08T19:18:59,118   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2025-06-08T19:18:59,121   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2025-06-08T19:18:59,122   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2025-06-08T19:18:59,124   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2025-06-08T19:18:59,125   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2025-06-08T19:18:59,126   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2025-06-08T19:18:59,128   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2025-06-08T19:18:59,130   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.cpp'
2025-06-08T19:18:59,131   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_op_desc.h'
2025-06-08T19:18:59,132   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2025-06-08T19:18:59,134   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2025-06-08T19:18:59,135   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.cpp'
2025-06-08T19:18:59,136   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_cpu_op.h'
2025-06-08T19:18:59,137   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2025-06-08T19:18:59,139   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2025-06-08T19:18:59,140   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2025-06-08T19:18:59,141   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2025-06-08T19:18:59,143   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2025-06-08T19:18:59,144   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2025-06-08T19:18:59,145   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2025-06-08T19:18:59,147   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2025-06-08T19:18:59,149   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.cpp'
2025-06-08T19:18:59,150   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_io_handle.h'
2025-06-08T19:18:59,152   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2025-06-08T19:18:59,153   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2025-06-08T19:18:59,156   adding 'deepspeed/ops/csrc/compile/deepcompile.cpp'
2025-06-08T19:18:59,157   adding 'deepspeed/ops/csrc/compile/init.cpp'
2025-06-08T19:18:59,159   adding 'deepspeed/ops/csrc/compile/util.cpp'
2025-06-08T19:18:59,160   adding 'deepspeed/ops/csrc/compile/z1.cpp'
2025-06-08T19:18:59,162   adding 'deepspeed/ops/csrc/compile/z1.h'
2025-06-08T19:18:59,164   adding 'deepspeed/ops/csrc/compile/z3.cpp'
2025-06-08T19:18:59,166   adding 'deepspeed/ops/csrc/compile/z3.h'
2025-06-08T19:18:59,168   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2025-06-08T19:18:59,171   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2025-06-08T19:18:59,175   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2025-06-08T19:18:59,176   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2025-06-08T19:18:59,178   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2025-06-08T19:18:59,180   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2025-06-08T19:18:59,182   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2025-06-08T19:18:59,184   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2025-06-08T19:18:59,186   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2025-06-08T19:18:59,188   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2025-06-08T19:18:59,197   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2025-06-08T19:18:59,202   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2025-06-08T19:18:59,205   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2025-06-08T19:18:59,208   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2025-06-08T19:18:59,210   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2025-06-08T19:18:59,211   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2025-06-08T19:18:59,213   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2025-06-08T19:18:59,215   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2025-06-08T19:18:59,218   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2025-06-08T19:18:59,221   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2025-06-08T19:18:59,223   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2025-06-08T19:18:59,225   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2025-06-08T19:18:59,233   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2025-06-08T19:18:59,237   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2025-06-08T19:18:59,238   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2025-06-08T19:18:59,243   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2025-06-08T19:18:59,246   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2025-06-08T19:18:59,250   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2025-06-08T19:18:59,252   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2025-06-08T19:18:59,254   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2025-06-08T19:18:59,256   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2025-06-08T19:18:59,257   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2025-06-08T19:18:59,260   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2025-06-08T19:18:59,262   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2025-06-08T19:18:59,264   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2025-06-08T19:18:59,266   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2025-06-08T19:18:59,269   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.cpp'
2025-06-08T19:18:59,270   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_op.h'
2025-06-08T19:18:59,271   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_gds_utils.h'
2025-06-08T19:18:59,273   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.cpp'
2025-06-08T19:18:59,274   adding 'deepspeed/ops/csrc/gds/py_lib/deepspeed_py_gds_handle.h'
2025-06-08T19:18:59,276   adding 'deepspeed/ops/csrc/gds/py_lib/py_ds_gds.cpp'
2025-06-08T19:18:59,279   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2025-06-08T19:18:59,280   adding 'deepspeed/ops/csrc/includes/Timer.h'
2025-06-08T19:18:59,281   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2025-06-08T19:18:59,283   adding 'deepspeed/ops/csrc/includes/compat.h'
2025-06-08T19:18:59,284   adding 'deepspeed/ops/csrc/includes/context.h'
2025-06-08T19:18:59,286   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2025-06-08T19:18:59,288   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2025-06-08T19:18:59,290   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2025-06-08T19:18:59,291   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2025-06-08T19:18:59,293   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2025-06-08T19:18:59,294   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2025-06-08T19:18:59,297   adding 'deepspeed/ops/csrc/includes/deepcompile.h'
2025-06-08T19:18:59,299   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2025-06-08T19:18:59,300   adding 'deepspeed/ops/csrc/includes/dropout.h'
2025-06-08T19:18:59,302   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2025-06-08T19:18:59,303   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2025-06-08T19:18:59,305   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2025-06-08T19:18:59,306   adding 'deepspeed/ops/csrc/includes/gelu.h'
2025-06-08T19:18:59,308   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2025-06-08T19:18:59,309   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2025-06-08T19:18:59,312   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2025-06-08T19:18:59,314   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2025-06-08T19:18:59,315   adding 'deepspeed/ops/csrc/includes/quantization.h'
2025-06-08T19:18:59,317   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2025-06-08T19:18:59,319   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2025-06-08T19:18:59,321   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2025-06-08T19:18:59,323   adding 'deepspeed/ops/csrc/includes/simd.h'
2025-06-08T19:18:59,325   adding 'deepspeed/ops/csrc/includes/softmax.h'
2025-06-08T19:18:59,326   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2025-06-08T19:18:59,327   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2025-06-08T19:18:59,329   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2025-06-08T19:18:59,331   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2025-06-08T19:18:59,333   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2025-06-08T19:18:59,335   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2025-06-08T19:18:59,336   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2025-06-08T19:18:59,338   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2025-06-08T19:18:59,339   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2025-06-08T19:18:59,341   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2025-06-08T19:18:59,344   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2025-06-08T19:18:59,346   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2025-06-08T19:18:59,349   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2025-06-08T19:18:59,351   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2025-06-08T19:18:59,353   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2025-06-08T19:18:59,355   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2025-06-08T19:18:59,357   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2025-06-08T19:18:59,359   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2025-06-08T19:18:59,360   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2025-06-08T19:18:59,362   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2025-06-08T19:18:59,364   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2025-06-08T19:18:59,367   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2025-06-08T19:18:59,368   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2025-06-08T19:18:59,370   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2025-06-08T19:18:59,373   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2025-06-08T19:18:59,376   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2025-06-08T19:18:59,380   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2025-06-08T19:18:59,383   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2025-06-08T19:18:59,385   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2025-06-08T19:18:59,390   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2025-06-08T19:18:59,393   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2025-06-08T19:18:59,395   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2025-06-08T19:18:59,398   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2025-06-08T19:18:59,400   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2025-06-08T19:18:59,403   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2025-06-08T19:18:59,405   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2025-06-08T19:18:59,407   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2025-06-08T19:18:59,413   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2025-06-08T19:18:59,415   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2025-06-08T19:18:59,417   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2025-06-08T19:18:59,419   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2025-06-08T19:18:59,422   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2025-06-08T19:18:59,425   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2025-06-08T19:18:59,427   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2025-06-08T19:18:59,429   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2025-06-08T19:18:59,431   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2025-06-08T19:18:59,433   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2025-06-08T19:18:59,435   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2025-06-08T19:18:59,436   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2025-06-08T19:18:59,438   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2025-06-08T19:18:59,440   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2025-06-08T19:18:59,442   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2025-06-08T19:18:59,444   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2025-06-08T19:18:59,445   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2025-06-08T19:18:59,447   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2025-06-08T19:18:59,448   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2025-06-08T19:18:59,450   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2025-06-08T19:18:59,452   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2025-06-08T19:18:59,454   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2025-06-08T19:18:59,456   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2025-06-08T19:18:59,457   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2025-06-08T19:18:59,459   adding 'deepspeed/ops/fp_quantizer/fp8_gemm_triton.py'
2025-06-08T19:18:59,460   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2025-06-08T19:18:59,462   adding 'deepspeed/ops/gds/__init__.py'
2025-06-08T19:18:59,464   adding 'deepspeed/ops/lamb/__init__.py'
2025-06-08T19:18:59,466   adding 'deepspeed/ops/lamb/fused_lamb.py'
2025-06-08T19:18:59,468   adding 'deepspeed/ops/lion/__init__.py'
2025-06-08T19:18:59,470   adding 'deepspeed/ops/lion/cpu_lion.py'
2025-06-08T19:18:59,471   adding 'deepspeed/ops/lion/fused_lion.py'
2025-06-08T19:18:59,472   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2025-06-08T19:18:59,475   adding 'deepspeed/ops/op_builder/__init__.py'
2025-06-08T19:18:59,476   adding 'deepspeed/ops/op_builder/all_ops.py'
2025-06-08T19:18:59,478   adding 'deepspeed/ops/op_builder/async_io.py'
2025-06-08T19:18:59,482   adding 'deepspeed/ops/op_builder/builder.py'
2025-06-08T19:18:59,484   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2025-06-08T19:18:59,485   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2025-06-08T19:18:59,486   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2025-06-08T19:18:59,488   adding 'deepspeed/ops/op_builder/dc.py'
2025-06-08T19:18:59,489   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2025-06-08T19:18:59,491   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2025-06-08T19:18:59,492   adding 'deepspeed/ops/op_builder/fused_adam.py'
2025-06-08T19:18:59,494   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2025-06-08T19:18:59,495   adding 'deepspeed/ops/op_builder/fused_lion.py'
2025-06-08T19:18:59,496   adding 'deepspeed/ops/op_builder/gds.py'
2025-06-08T19:18:59,498   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2025-06-08T19:18:59,499   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2025-06-08T19:18:59,501   adding 'deepspeed/ops/op_builder/quantizer.py'
2025-06-08T19:18:59,502   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2025-06-08T19:18:59,504   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2025-06-08T19:18:59,505   adding 'deepspeed/ops/op_builder/random_ltd.py'
2025-06-08T19:18:59,506   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2025-06-08T19:18:59,507   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2025-06-08T19:18:59,509   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2025-06-08T19:18:59,510   adding 'deepspeed/ops/op_builder/transformer.py'
2025-06-08T19:18:59,511   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2025-06-08T19:18:59,513   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2025-06-08T19:18:59,515   adding 'deepspeed/ops/op_builder/cpu/async_io.py'
2025-06-08T19:18:59,516   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2025-06-08T19:18:59,518   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2025-06-08T19:18:59,519   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2025-06-08T19:18:59,520   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2025-06-08T19:18:59,522   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2025-06-08T19:18:59,524   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2025-06-08T19:18:59,525   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2025-06-08T19:18:59,526   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2025-06-08T19:18:59,528   adding 'deepspeed/ops/op_builder/hpu/fp_quantizer.py'
2025-06-08T19:18:59,529   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2025-06-08T19:18:59,530   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2025-06-08T19:18:59,532   adding 'deepspeed/ops/op_builder/hpu/transformer_inference.py'
2025-06-08T19:18:59,534   adding 'deepspeed/ops/op_builder/mlu/__init__.py'
2025-06-08T19:18:59,535   adding 'deepspeed/ops/op_builder/mlu/builder.py'
2025-06-08T19:18:59,536   adding 'deepspeed/ops/op_builder/mlu/cpu_adagrad.py'
2025-06-08T19:18:59,538   adding 'deepspeed/ops/op_builder/mlu/cpu_adam.py'
2025-06-08T19:18:59,539   adding 'deepspeed/ops/op_builder/mlu/fused_adam.py'
2025-06-08T19:18:59,540   adding 'deepspeed/ops/op_builder/mlu/no_impl.py'
2025-06-08T19:18:59,542   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2025-06-08T19:18:59,544   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2025-06-08T19:18:59,545   adding 'deepspeed/ops/op_builder/npu/builder.py'
2025-06-08T19:18:59,547   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2025-06-08T19:18:59,548   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2025-06-08T19:18:59,549   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2025-06-08T19:18:59,551   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2025-06-08T19:18:59,553   adding 'deepspeed/ops/op_builder/npu/inference.py'
2025-06-08T19:18:59,554   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2025-06-08T19:18:59,558   adding 'deepspeed/ops/op_builder/sdaa/__init__.py'
2025-06-08T19:18:59,559   adding 'deepspeed/ops/op_builder/sdaa/builder.py'
2025-06-08T19:18:59,561   adding 'deepspeed/ops/op_builder/sdaa/cpu_adam.py'
2025-06-08T19:18:59,562   adding 'deepspeed/ops/op_builder/sdaa/fused_adam.py'
2025-06-08T19:18:59,564   adding 'deepspeed/ops/op_builder/sdaa/no_impl.py'
2025-06-08T19:18:59,566   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2025-06-08T19:18:59,568   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2025-06-08T19:18:59,569   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2025-06-08T19:18:59,571   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2025-06-08T19:18:59,572   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2025-06-08T19:18:59,573   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2025-06-08T19:18:59,575   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2025-06-08T19:18:59,576   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2025-06-08T19:18:59,577   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2025-06-08T19:18:59,579   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2025-06-08T19:18:59,581   adding 'deepspeed/ops/quantizer/__init__.py'
2025-06-08T19:18:59,582   adding 'deepspeed/ops/quantizer/quantizer.py'
2025-06-08T19:18:59,584   adding 'deepspeed/ops/random_ltd/__init__.py'
2025-06-08T19:18:59,586   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2025-06-08T19:18:59,588   adding 'deepspeed/ops/sparse_attention/__init__.py'
2025-06-08T19:18:59,589   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2025-06-08T19:18:59,594   adding 'deepspeed/ops/sparse_attention/matmul.py'
2025-06-08T19:18:59,596   adding 'deepspeed/ops/sparse_attention/softmax.py'
2025-06-08T19:18:59,599   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2025-06-08T19:18:59,601   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2025-06-08T19:18:59,604   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2025-06-08T19:18:59,607   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2025-06-08T19:18:59,608   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2025-06-08T19:18:59,610   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2025-06-08T19:18:59,611   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2025-06-08T19:18:59,613   adding 'deepspeed/ops/transformer/__init__.py'
2025-06-08T19:18:59,616   adding 'deepspeed/ops/transformer/transformer.py'
2025-06-08T19:18:59,618   adding 'deepspeed/ops/transformer/inference/__init__.py'
2025-06-08T19:18:59,619   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2025-06-08T19:18:59,621   adding 'deepspeed/ops/transformer/inference/config.py'
2025-06-08T19:18:59,622   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2025-06-08T19:18:59,624   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2025-06-08T19:18:59,625   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2025-06-08T19:18:59,627   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2025-06-08T19:18:59,629   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2025-06-08T19:18:59,631   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2025-06-08T19:18:59,633   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2025-06-08T19:18:59,635   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2025-06-08T19:18:59,636   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2025-06-08T19:18:59,638   adding 'deepspeed/ops/transformer/inference/op_binding/bias_add.py'
2025-06-08T19:18:59,639   adding 'deepspeed/ops/transformer/inference/op_binding/bias_gelu.py'
2025-06-08T19:18:59,641   adding 'deepspeed/ops/transformer/inference/op_binding/bias_relu.py'
2025-06-08T19:18:59,642   adding 'deepspeed/ops/transformer/inference/op_binding/bias_residual.py'
2025-06-08T19:18:59,644   adding 'deepspeed/ops/transformer/inference/op_binding/einsum_sec_sm_ecm.py'
2025-06-08T19:18:59,645   adding 'deepspeed/ops/transformer/inference/op_binding/gated_activation.py'
2025-06-08T19:18:59,647   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2025-06-08T19:18:59,649   adding 'deepspeed/ops/transformer/inference/op_binding/layer_norm.py'
2025-06-08T19:18:59,650   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2025-06-08T19:18:59,652   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2025-06-08T19:18:59,653   adding 'deepspeed/ops/transformer/inference/op_binding/moe_res_matmul.py'
2025-06-08T19:18:59,655   adding 'deepspeed/ops/transformer/inference/op_binding/pad_transform.py'
2025-06-08T19:18:59,656   adding 'deepspeed/ops/transformer/inference/op_binding/pre_rms_norm.py'
2025-06-08T19:18:59,657   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2025-06-08T19:18:59,659   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2025-06-08T19:18:59,660   adding 'deepspeed/ops/transformer/inference/op_binding/rms_norm.py'
2025-06-08T19:18:59,662   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2025-06-08T19:18:59,663   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2025-06-08T19:18:59,664   adding 'deepspeed/ops/transformer/inference/op_binding/vector_add.py'
2025-06-08T19:18:59,666   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2025-06-08T19:18:59,667   adding 'deepspeed/ops/transformer/inference/op_binding/workspace.py'
2025-06-08T19:18:59,669   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2025-06-08T19:18:59,672   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2025-06-08T19:18:59,673   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2025-06-08T19:18:59,675   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2025-06-08T19:18:59,678   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2025-06-08T19:18:59,679   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2025-06-08T19:18:59,681   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2025-06-08T19:18:59,682   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2025-06-08T19:18:59,684   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2025-06-08T19:18:59,686   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2025-06-08T19:18:59,687   adding 'deepspeed/pipe/__init__.py'
2025-06-08T19:18:59,689   adding 'deepspeed/profiling/__init__.py'
2025-06-08T19:18:59,690   adding 'deepspeed/profiling/config.py'
2025-06-08T19:18:59,692   adding 'deepspeed/profiling/constants.py'
2025-06-08T19:18:59,694   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2025-06-08T19:18:59,699   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2025-06-08T19:18:59,702   adding 'deepspeed/runtime/__init__.py'
2025-06-08T19:18:59,704   adding 'deepspeed/runtime/base_optimizer.py'
2025-06-08T19:18:59,707   adding 'deepspeed/runtime/bf16_optimizer.py'
2025-06-08T19:18:59,708   adding 'deepspeed/runtime/compiler.py'
2025-06-08T19:18:59,713   adding 'deepspeed/runtime/config.py'
2025-06-08T19:18:59,715   adding 'deepspeed/runtime/config_utils.py'
2025-06-08T19:18:59,717   adding 'deepspeed/runtime/constants.py'
2025-06-08T19:18:59,719   adding 'deepspeed/runtime/dataloader.py'
2025-06-08T19:18:59,720   adding 'deepspeed/runtime/eigenvalue.py'
2025-06-08T19:18:59,742   adding 'deepspeed/runtime/engine.py'
2025-06-08T19:18:59,745   adding 'deepspeed/runtime/hybrid_engine.py'
2025-06-08T19:18:59,749   adding 'deepspeed/runtime/lr_schedules.py'
2025-06-08T19:18:59,751   adding 'deepspeed/runtime/progressive_layer_drop.py'
2025-06-08T19:18:59,752   adding 'deepspeed/runtime/quantize.py'
2025-06-08T19:18:59,754   adding 'deepspeed/runtime/sparse_tensor.py'
2025-06-08T19:18:59,756   adding 'deepspeed/runtime/state_dict_factory.py'
2025-06-08T19:18:59,761   adding 'deepspeed/runtime/utils.py'
2025-06-08T19:18:59,763   adding 'deepspeed/runtime/weight_quantizer.py'
2025-06-08T19:18:59,765   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2025-06-08T19:18:59,770   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2025-06-08T19:18:59,771   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2025-06-08T19:18:59,773   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2025-06-08T19:18:59,774   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2025-06-08T19:18:59,776   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2025-06-08T19:18:59,777   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2025-06-08T19:18:59,779   adding 'deepspeed/runtime/comm/__init__.py'
2025-06-08T19:18:59,781   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2025-06-08T19:18:59,782   adding 'deepspeed/runtime/comm/compressed.py'
2025-06-08T19:18:59,784   adding 'deepspeed/runtime/comm/hccl.py'
2025-06-08T19:18:59,786   adding 'deepspeed/runtime/comm/mpi.py'
2025-06-08T19:18:59,788   adding 'deepspeed/runtime/comm/nccl.py'
2025-06-08T19:18:59,790   adding 'deepspeed/runtime/compression/__init__.py'
2025-06-08T19:18:59,791   adding 'deepspeed/runtime/compression/cupy.py'
2025-06-08T19:18:59,793   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2025-06-08T19:18:59,794   adding 'deepspeed/runtime/data_pipeline/config.py'
2025-06-08T19:18:59,796   adding 'deepspeed/runtime/data_pipeline/constants.py'
2025-06-08T19:18:59,797   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2025-06-08T19:18:59,799   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2025-06-08T19:18:59,801   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2025-06-08T19:18:59,802   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2025-06-08T19:18:59,804   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2025-06-08T19:18:59,805   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2025-06-08T19:18:59,807   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2025-06-08T19:18:59,812   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2025-06-08T19:18:59,815   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2025-06-08T19:18:59,819   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2025-06-08T19:18:59,820   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2025-06-08T19:18:59,824   adding 'deepspeed/runtime/data_pipeline/data_sampling/variable_batch_size_and_lr.py'
2025-06-08T19:18:59,826   adding 'deepspeed/runtime/domino/__init__.py'
2025-06-08T19:18:59,827   adding 'deepspeed/runtime/domino/async_linear.py'
2025-06-08T19:18:59,830   adding 'deepspeed/runtime/domino/transformer.py'
2025-06-08T19:18:59,832   adding 'deepspeed/runtime/fp16/__init__.py'
2025-06-08T19:18:59,835   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2025-06-08T19:18:59,837   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2025-06-08T19:18:59,840   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2025-06-08T19:18:59,842   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2025-06-08T19:18:59,844   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2025-06-08T19:18:59,847   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2025-06-08T19:18:59,850   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2025-06-08T19:18:59,852   adding 'deepspeed/runtime/pipe/__init__.py'
2025-06-08T19:18:59,859   adding 'deepspeed/runtime/pipe/engine.py'
2025-06-08T19:18:59,864   adding 'deepspeed/runtime/pipe/module.py'
2025-06-08T19:18:59,866   adding 'deepspeed/runtime/pipe/p2p.py'
2025-06-08T19:18:59,868   adding 'deepspeed/runtime/pipe/schedule.py'
2025-06-08T19:18:59,871   adding 'deepspeed/runtime/pipe/topology.py'
2025-06-08T19:18:59,873   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2025-06-08T19:18:59,874   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2025-06-08T19:18:59,876   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2025-06-08T19:18:59,877   adding 'deepspeed/runtime/swap_tensor/constants.py'
2025-06-08T19:18:59,880   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2025-06-08T19:18:59,882   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2025-06-08T19:18:59,885   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2025-06-08T19:18:59,886   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2025-06-08T19:18:59,888   adding 'deepspeed/runtime/swap_tensor/utils.py'
2025-06-08T19:18:59,890   adding 'deepspeed/runtime/tensor_parallel/__init__.py'
2025-06-08T19:18:59,892   adding 'deepspeed/runtime/tensor_parallel/config.py'
2025-06-08T19:18:59,893   adding 'deepspeed/runtime/tensor_parallel/tp_manager.py'
2025-06-08T19:18:59,895   adding 'deepspeed/runtime/zero/__init__.py'
2025-06-08T19:18:59,898   adding 'deepspeed/runtime/zero/config.py'
2025-06-08T19:18:59,901   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2025-06-08T19:18:59,902   adding 'deepspeed/runtime/zero/linear.py'
2025-06-08T19:18:59,905   adding 'deepspeed/runtime/zero/mics.py'
2025-06-08T19:18:59,907   adding 'deepspeed/runtime/zero/mics_utils.py'
2025-06-08T19:18:59,909   adding 'deepspeed/runtime/zero/offload_config.py'
2025-06-08T19:18:59,910   adding 'deepspeed/runtime/zero/offload_states.py'
2025-06-08T19:18:59,914   adding 'deepspeed/runtime/zero/parameter_offload.py'
2025-06-08T19:18:59,927   adding 'deepspeed/runtime/zero/partition_parameters.py'
2025-06-08T19:18:59,931   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2025-06-08T19:18:59,933   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2025-06-08T19:18:59,950   adding 'deepspeed/runtime/zero/stage3.py'
2025-06-08T19:18:59,964   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2025-06-08T19:18:59,966   adding 'deepspeed/runtime/zero/test.py'
2025-06-08T19:18:59,968   adding 'deepspeed/runtime/zero/tiling.py'
2025-06-08T19:18:59,970   adding 'deepspeed/runtime/zero/utils.py'
2025-06-08T19:18:59,972   adding 'deepspeed/sequence/__init__.py'
2025-06-08T19:18:59,973   adding 'deepspeed/sequence/cross_entropy.py'
2025-06-08T19:18:59,977   adding 'deepspeed/sequence/fpdt_layer.py'
2025-06-08T19:18:59,980   adding 'deepspeed/sequence/layer.py'
2025-06-08T19:18:59,982   adding 'deepspeed/utils/__init__.py'
2025-06-08T19:18:59,983   adding 'deepspeed/utils/bwc.py'
2025-06-08T19:18:59,985   adding 'deepspeed/utils/comms_logging.py'
2025-06-08T19:18:59,986   adding 'deepspeed/utils/config.py'
2025-06-08T19:18:59,988   adding 'deepspeed/utils/debug.py'
2025-06-08T19:18:59,989   adding 'deepspeed/utils/exceptions.py'
2025-06-08T19:18:59,992   adding 'deepspeed/utils/groups.py'
2025-06-08T19:18:59,994   adding 'deepspeed/utils/init_on_device.py'
2025-06-08T19:18:59,996   adding 'deepspeed/utils/logging.py'
2025-06-08T19:18:59,997   adding 'deepspeed/utils/mixed_precision_linkage.py'
2025-06-08T19:18:59,999   adding 'deepspeed/utils/numa.py'
2025-06-08T19:19:00,000   adding 'deepspeed/utils/nvtx.py'
2025-06-08T19:19:00,003   adding 'deepspeed/utils/tensor_fragment.py'
2025-06-08T19:19:00,005   adding 'deepspeed/utils/timer.py'
2025-06-08T19:19:00,006   adding 'deepspeed/utils/torch.py'
2025-06-08T19:19:00,007   adding 'deepspeed/utils/types.py'
2025-06-08T19:19:00,009   adding 'deepspeed/utils/z3_leaf_module.py'
2025-06-08T19:19:00,013   adding 'deepspeed/utils/zero_to_fp32.py'
2025-06-08T19:19:00,016   adding 'deepspeed-0.16.9.data/scripts/deepspeed'
2025-06-08T19:19:00,017   adding 'deepspeed-0.16.9.data/scripts/deepspeed.pt'
2025-06-08T19:19:00,018   adding 'deepspeed-0.16.9.data/scripts/ds'
2025-06-08T19:19:00,020   adding 'deepspeed-0.16.9.data/scripts/ds_bench'
2025-06-08T19:19:00,021   adding 'deepspeed-0.16.9.data/scripts/ds_elastic'
2025-06-08T19:19:00,022   adding 'deepspeed-0.16.9.data/scripts/ds_io'
2025-06-08T19:19:00,024   adding 'deepspeed-0.16.9.data/scripts/ds_nvme_tune'
2025-06-08T19:19:00,025   adding 'deepspeed-0.16.9.data/scripts/ds_report'
2025-06-08T19:19:00,026   adding 'deepspeed-0.16.9.data/scripts/ds_ssh'
2025-06-08T19:19:00,027   adding 'deepspeed-0.16.9.data/scripts/dsr'
2025-06-08T19:19:00,031   adding 'deepspeed-0.16.9.dist-info/licenses/LICENSE'
2025-06-08T19:19:00,037   adding 'deepspeed-0.16.9.dist-info/METADATA'
2025-06-08T19:19:00,038   adding 'deepspeed-0.16.9.dist-info/WHEEL'
2025-06-08T19:19:00,039   adding 'deepspeed-0.16.9.dist-info/entry_points.txt'
2025-06-08T19:19:00,040   adding 'deepspeed-0.16.9.dist-info/top_level.txt'
2025-06-08T19:19:00,057   adding 'deepspeed-0.16.9.dist-info/RECORD'
2025-06-08T19:19:00,090   removing build/bdist.linux-armv7l/wheel
2025-06-08T19:19:00,400   deepspeed build time = 14.129932880401611 secs
2025-06-08T19:19:00,529   Building wheel for deepspeed (setup.py): finished with status 'done'
2025-06-08T19:19:00,550   Created wheel for deepspeed: filename=deepspeed-0.16.9-py3-none-any.whl size=1644433 sha256=92e997f08ef2dfe72ce84292b8747f4dee177f80704f7a7191712a35da9cd095
2025-06-08T19:19:00,552   Stored in directory: /tmp/pip-ephem-wheel-cache-4_gjwziq/wheels/b9/ac/79/a454936d70b601056346a28d4347456cbdf57587851eab3cf3
2025-06-08T19:19:00,599 Successfully built deepspeed
2025-06-08T19:19:00,643 Removed build tracker: '/tmp/pip-build-tracker-sop76ve_'